diff --git a/CHANGELOG.md b/CHANGELOG.md index 5ae50ce00..f8f8af0d0 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -2,6 +2,20 @@ ## Unreleased +### Breaking Changes +... + +### New Features +... + +### Fixes +... + +### Deprecations +... + +## 2.0.0 + ### Breaking Changes - Changed the behavior of `IncrementalEvaluator::do_evaluate` such that it now sends all `SuccessfulExampleOutput`s to `do_incremental_evaluate` instead of only the new `SuccessfulExampleOutput`s. diff --git a/README.md b/README.md index f8f157f18..28b2b19bd 100644 --- a/README.md +++ b/README.md @@ -176,8 +176,7 @@ The how-tos are quick lookups about how to do things. Compared to the tutorials, | [...create a dataset](./src/documentation/how_tos/how_to_create_a_dataset.ipynb) | Create a dataset used for running a task | | [...run a task on a dataset](./src/documentation/how_tos/how_to_run_a_task_on_a_dataset.ipynb) | Run a task on a whole dataset instead of single examples | | [...evaluate multiple runs](./src/documentation/how_tos/how_to_evaluate_runs.ipynb) | Evaluate (multiple) runs in a single evaluation | -| [...aggregate multiple evaluations](./src/documentation/how_tos/how_to_aggregate_evaluations.ipynb) | Aggregate (multiple) evaluations in a single - aggregation | +| [...aggregate multiple evaluations](./src/documentation/how_tos/how_to_aggregate_evaluations.ipynb) | Aggregate (multiple) evaluations in a single aggregation | | [...retrieve data for analysis](./src/documentation/how_tos/how_to_retrieve_data_for_analysis.ipynb) | Retrieve experiment data in multiple different ways | | [...implement a custom human evaluation](./src/documentation/how_tos/how_to_human_evaluation_via_argilla.ipynb) | Necessary steps to create an evaluation with humans as a judge via Argilla | | [...implement elo evaluations](./src/documentation/how_tos/how_to_implement_elo_evaluations.ipynb) | Evaluate runs and create ELO ranking for them | diff --git a/pyproject.toml b/pyproject.toml index 44d20f361..906ccbffb 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -4,7 +4,7 @@ build-backend = "poetry.core.masonry.api" [tool.poetry] name = "intelligence-layer" -version = "1.2.0" +version = "2.0.0" description = "" authors = ["Aleph Alpha Engineering "] readme = "README.md"