-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add new benchmark: Galician bench #2155
base: main
Are you sure you want to change the base?
Conversation
@@ -0,0 +1,28 @@ | |||
group: flores |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
group: flores | |
tag: flores |
@@ -0,0 +1,27 @@ | |||
group: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should remove this as it refers to the original mgsm paper. Also is this human translated? The dataset page doesn't say
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We will remove the group. As for translation, it is human translated. We will ask the authors to add this information in the dataset page. Thank you!
@@ -0,0 +1,20 @@ | |||
group: | |||
- pawsx |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should remove this as well
@@ -0,0 +1,70 @@ | |||
group: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
group: | |
tag: |
@@ -0,0 +1,36 @@ | |||
group: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
group: | |
tag: |
@@ -0,0 +1,15 @@ | |||
group: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
group: | |
tag: |
@@ -0,0 +1,22 @@ | |||
group: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should remove this
These are the changes done:
With these, it should all be fine now. Thank you! |
GalicianBench is a benchmark for tasks in Galician that cover several evaluation areas. The datasets consist of professional translations of relevant English datasets and newly created datasets in Galician. The README.md contains detailed information on all the tasks included in the benchmark.