feat: Add HyDE and reranking to evaluation #18
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
yoomlam
approved these changes
Apr 19, 2024
| @@ -30,6 +32,13 @@ | |||
| Please answer using the following context: | |||
| {context}""" | |||
|
|
|||
| HYDE_PROMPT = """Please write a hypothetical document that would answer the following question about SNAP (food stamps.) | |||
There was a problem hiding this comment.
Suggested change
| HYDE_PROMPT = """Please write a hypothetical document that would answer the following question about SNAP (food stamps.) | |
| HYDE_PROMPT = """Please write a hypothetical document that would answer the following question about SNAP (food stamps). |
| @@ -5,6 +5,7 @@ | |||
| beautifulsoup4 | |||
| chainlit | |||
| chromadb | |||
| cohere | |||
There was a problem hiding this comment.
Reminder to run pip-compile requirements.in to update requirements.txt
There was a problem hiding this comment.
Read this comment, thought "ah right", and then pushed merge 😂 -- I'll update on the base branch now before merging.
|
I changed the base branch so that I only see the changes compared to PR #17, which I approved. |
|
Looking forward to discussing the results! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Ticket
Resolves https://navalabs.atlassian.net/browse/DST-180
Changes
Context for reviewers