Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to Locate Configuration Files ZeRO_3_cpu.json and sft.json in run_cpsft.sh #2

Open
keesh0410 opened this issue May 5, 2024 · 1 comment

Comments

@keesh0410
Copy link

Description:
I'm encountering an issue while trying to run run_cpsft.sh script. It seems that the configuration files ZeRO_3_cpu.json and sft.json are missing or not being found by the script. This prevents the script from executing properly.

Steps to Reproduce:

Clone the repository.
Navigate to the directory containing run_cpsft.sh.
Execute run_cpsft.sh.
Expected Behavior:
The script should run successfully with the specified configuration files ZeRO_3_cpu.json and sft.json.

Actual Behavior:
The script fails with an error indicating that it couldn't find the ZeRO_3_cpu.json and sft.json configuration files.

@YijuGuo
Copy link
Collaborator

YijuGuo commented Jul 16, 2024

Thank you for your attention. Here are the details you requested:

  1. The address for ZeRO_3_cpu.json is: src/CPSFT/cpsft/deepspeed_config/ZeRO_3_cpu.json.

  2. sft.json refers to the SFT training data that you have processed during the CPSFT Data Preparation phase.

If you have any further questions or need additional assistance, feel free to let me know.

Best regards,
Yiju Guo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants