Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement new information architecture for Evaluations #604

Open
cesr opened this issue Nov 13, 2024 · 0 comments
Open

Implement new information architecture for Evaluations #604

cesr opened this issue Nov 13, 2024 · 0 comments

Comments

@cesr
Copy link
Contributor

cesr commented Nov 13, 2024

Right now evaluations are created at the workspace level and then connected to a prompt.

It makes more sense to create those evaluations directly at the prompt level as usually evaluations are specific to a single prompt. It will also simplify the user experience.

Also this will make it super easy to version evaluations, which is currently not possible.

@cesr cesr converted this from a draft issue Nov 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

1 participant