Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store models meta information in a CSV file, so it can be further used in data visualization #298

Merged
merged 7 commits into from
Aug 6, 2024

Conversation

ruiAzevedo19
Copy link
Collaborator

Part of #296

@ruiAzevedo19 ruiAzevedo19 added the enhancement New feature or request label Jul 30, 2024
@ruiAzevedo19 ruiAzevedo19 added this to the v0.6.0 milestone Jul 30, 2024
@ruiAzevedo19 ruiAzevedo19 self-assigned this Jul 30, 2024
@ruiAzevedo19 ruiAzevedo19 requested a review from bauersimon July 30, 2024 15:43
provider/openrouter/openrouter.go Show resolved Hide resolved
provider/openrouter/openrouter.go Show resolved Hide resolved
util/io.go Outdated Show resolved Hide resolved
cmd/eval-dev-quality/cmd/report.go Outdated Show resolved Hide resolved
@ruiAzevedo19 ruiAzevedo19 changed the title Store models cost information along with the corresponding scoring in a CSV file, so it can be used for data visualization Store models meta information in a CSV file, so it can be further used in data visualization Jul 31, 2024
@ruiAzevedo19 ruiAzevedo19 requested a review from bauersimon July 31, 2024 11:31
@ruiAzevedo19 ruiAzevedo19 modified the milestones: v0.6.0, v0.7.0 Aug 1, 2024
model/llm/llm.go Outdated Show resolved Hide resolved
cmd/eval-dev-quality/cmd/report.go Outdated Show resolved Hide resolved
@ruiAzevedo19 ruiAzevedo19 requested a review from bauersimon August 1, 2024 12:48
@ruiAzevedo19 ruiAzevedo19 force-pushed the 296-model-costs branch 2 times, most recently from e723387 to e86e508 Compare August 1, 2024 13:57
cmd/eval-dev-quality/cmd/report.go Outdated Show resolved Hide resolved
cmd/eval-dev-quality/cmd/report.go Outdated Show resolved Hide resolved
evaluate/report/csv.go Outdated Show resolved Hide resolved
cmd/eval-dev-quality/cmd/report_test.go Outdated Show resolved Hide resolved
@bauersimon
Copy link
Member

LGTM... will test-drive once more locally and then merge after #308 is in.

…e JSON response, to avoid these values to be converted latter on

Part of #296
…der to the model package, since it is model related

Part of #296
…e it can error if the file already exists

Part of #296
… generic name, since it can sort all kind of CSV records

Part of #296
@ruiAzevedo19 ruiAzevedo19 merged commit 49cc4e0 into main Aug 6, 2024
5 checks passed
@ruiAzevedo19 ruiAzevedo19 deleted the 296-model-costs branch August 6, 2024 10:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants