New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Incorporate Mia's codebase #91

Open

zkokaja opened this issue Nov 2, 2022 · 2 comments

Assignees

Contributor

zkokaja commented Nov 2, 2022

Major changes:

map any model to any tokenizer
use automap for device usage
largest bloom model needs downloading
perplexity calculation

zkokaja assigned hvgazula

Contributor Author

zkokaja commented Nov 2, 2022

Do we need to align a model with the 20b version with LCS every time? Or can we can use the new in_model column in the pickles.

Contributor Author

zkokaja commented Feb 2, 2023

Do this in combination with #122

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment