Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RecurrentGemma 9b support #252

Open
fizzAI opened this issue Jun 17, 2024 · 1 comment
Open

RecurrentGemma 9b support #252

fizzAI opened this issue Jun 17, 2024 · 1 comment
Assignees
Labels
Feature New feature or request stat:awaiting response Status - Awaiting response from author

Comments

@fizzAI
Copy link

fizzAI commented Jun 17, 2024

Hi!
Are there currently any plans to support the 9b version of RecurrentGemma that recently released?

@KumarGitesh2024 KumarGitesh2024 self-assigned this Jun 17, 2024
@KumarGitesh2024 KumarGitesh2024 added the Feature New feature or request label Jun 17, 2024
@pculliton
Copy link
Collaborator

Hi! We do have plans to support RecurrentGemma 9b. There is some internal work to be done - I think it's likely that we'll be able to release it around the end of June. If contributors want to help, we could definitely use help with:

  • Adding a recurrent 9b configuration to convert_weights.py (and configs.h)
  • Testing that the configuration works with the output of convert_weights.py
  • Letting us know if it does not work.

This would save us some time in launching it! Thanks for raising this issue.

@tilakrayal tilakrayal added the stat:awaiting response Status - Awaiting response from author label Jun 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature New feature or request stat:awaiting response Status - Awaiting response from author
Projects
None yet
Development

No branches or pull requests

4 participants