Releases: tatsu-lab/alpaca_eval
Releases · tatsu-lab/alpaca_eval
Release v0.2.7
What's Changed
- Update WizardLM 13B V1.2 results by @victorsungo in #99
- [ENH] llama70B and chunking by @YannDubs in #100
- [ENH] add pipeline meta parser by @YannDubs in #103
- [CLEAN] Single annotator not abstract by @YannDubs in #104
- Add OpenChat 3.1 Results by @imoneoi in #105
- [ENH] add example with HF API by @YannDubs in #106
Full Changelog: v0.2.6...v0.2.7
Release v0.2.6
What's Changed
- [STYLE] fix ill-formatted logging message by @YannDubs in #97
- [STYLE] PR medium eval (ANNOTATOR_COLUMN) by @YannDubs in #98
Full Changelog: v0.2.5...v0.2.6
Release v0.2.5
Release v0.2.4
What's Changed
- Add Baichuan-13B-Chat Results by @inferLLM in #85
- Add ChatGLM2-6B Results by @inferLLM in #86
- [ENH] add chat llama2 by @YannDubs in #87
- [ENH] automatically add minimal/verified by @YannDubs in #88
- [ENH] add replicate + llama 70B by @YannDubs in #90
- [ENH] add llama 70B outputs by @YannDubs in #91
- [ENH] optionally return raw completions by @YannDubs in #92
- [ENH] eval_parser by @YannDubs in #93
- [ENH] json parser by @YannDubs in #94
New Contributors
Full Changelog: v0.2.3...v0.2.4
Release v0.2.3
Release v0.2.2
What's Changed
Full Changelog: v0.2.1...v0.2.2
Release v0.2.1
What's Changed
- Update WizardLM 13B V1.1 results by @victorsungo in #66
- [ENH] make. it easier to cache to a DB by @YannDubs in #73
- add vicuna v1.3 results by @rtaori in #74
- gpt4 annotations for vicuna v1.3 by @rtaori in #75
New Contributors
- @victorsungo made their first contribution in #66
Full Changelog: v0.2.0...v0.2.1
Release v0.2.0
v0.1.7
What's Changed
- Add Custom OpenAI API Endpoint Support and OpenChat Results by @imoneoi in #42
- get falcon models running decoding by @rtaori in #47
- [TEST] test by @YannDubs in #50
- [ENH] upgrade anthropic 0.3 by @YannDubs in #54
- [CLEAN] black by @YannDubs in #55
- [TEST] setting up test CI by @YannDubs in #56
- Add Baize v2 13B by @JetRunner in #49
- [CI] leaderboard formatting by @YannDubs in #58
- format leaderboard for baize by @YannDubs in #59
- [ENH] remove inputs from example by @YannDubs in #60
- [CLEAN] setting up precommit by @YannDubs in #61
New Contributors
- @imoneoi made their first contribution in #42
- @JetRunner made their first contribution in #49
Full Changelog: v0.1.6...v0.1.7.1