Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Discussion on skipping examples #792

Open
stephenbach opened this issue Jun 28, 2022 · 0 comments
Open

Discussion on skipping examples #792

stephenbach opened this issue Jun 28, 2022 · 0 comments

Comments

@stephenbach
Copy link
Member

Continuing the discussion from PR #788 to double check some stuff. The contributing guide says

Filtering prompts. If a prompt is applied to an example and produces an empty string,
that prompt/example pair will be skipped. You can therefore create prompts that only
apply to a subset of the examples by wrapping them in Jinja if statements.

I could have sworn it was either a blank input/output/or totally blank, as supported by the way the tests are written. Did we change this at some point? Perhaps we can run a check on existing prompts or change the code further to allow all options?

Also related to #749.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant