New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

作者，这个项目支持断点续训嘛 #72

Open

1737686924 opened this issue Apr 28, 2024 · 2 comments

1737686924 commented Apr 28, 2024

想要训练出一个比较大的模型，必然要支持断点续训，请问支持嘛，如果没有，有计划支持嘛

wdndev commented May 1, 2024

可以看一下这个项目，使用transformers库进行训练，支持断点训练，zero等优化技术。
https://github.com/wdndev/tiny-llm-zh

Tongjilibo commented May 16, 2024

可以看下这个项目：https://github.com/Tongjilibo/build_MiniLLM_from_scratch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment