Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SPPO Implementation on Axolotl! #21

Open
kaykyr opened this issue Jul 11, 2024 · 0 comments
Open

SPPO Implementation on Axolotl! #21

kaykyr opened this issue Jul 11, 2024 · 0 comments

Comments

@kaykyr
Copy link

kaykyr commented Jul 11, 2024

Hey guys! For who is interested, I recently submitted a pull request to implements SPPO on Axolotl trainer, you can fallow the pull request here:
axolotl-ai-cloud/axolotl#1735

Original SPPO implementation fork:
https://github.com/kaykyr/axolotl

See examples/llama3/sppo-qlora-8b.yml config file to see how train SPPO.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant