Skip to content

Commit

Permalink
fix: update with backtesting
Browse files Browse the repository at this point in the history
  • Loading branch information
Joyce-Tchamdjou committed Jul 2, 2024
1 parent 965f9a4 commit 153e951
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -93,6 +93,12 @@ python3 rag.py deepeval tchoung-te --run_ids_file=runs.csv

Whenever you change a parameter that can affect RAG, you can execute all inputs present in evals/base_ragas_evaluation.csv using langsmith to track them. Then you just have to get the runs and execute above command. As it's just 27 elements, you will be able to compare results manually.

### Backtesting the prompt
```
cd etl/
python3 backtesting_prompt.py
```
Create the dataset on which you want to test the new prompt on langSmith. Then run the file above to backtest and see the results of the new prompt on the dataset. You would specify in the file the name of the dataset before running

## Contributors ✨

Expand Down

0 comments on commit 153e951

Please sign in to comment.