-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
提供的本地数据集文件夹结构有误,无法直接使用 #39
Comments
指定data.zip里的数据作为评测数据,应该是本地模式才生效,需要指定:--dataset-hub Local 参考readme中给到的示例如下: |
你好,指定了--dataset-hub Local也不对,需要手动修改 |
目录指定确实不好用,特别是ceval这种包含子目录的,简直炸裂,不改地址就空等,改地址就说地址错误 |
https://modelscope.oss-cn-beijing.aliyuncs.com/open_data/benchmark/data.zip 解压后 ceval 的路径为 data/ceval,而 ceval_adapter 中加载的路径为 data/modelscope/ceval-exam,需要手动修改才能正常加载本地数据集。
建议更新托管数据集。
The text was updated successfully, but these errors were encountered: