New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Monkey patch for original LLaMA2 code. #4

Open

WeixuanXiong opened this issue Aug 14, 2023 · 1 comment

WeixuanXiong commented Aug 14, 2023

作者您好，感谢您的分享！
目前我的工作基于meta发布的原始llama2的代码和权重上，不知道本仓库是否有更新基于原始llama2仓库的rerope的patch的实现方式的计划呢？

Owner

bojone commented Aug 14, 2023

我稍微看了一下，meta版llama2代码改起来可能比transformers版还简单，可以自行尝试一下。

主要是我平时根本不用torch，改transformers版已经有点勉强了，实在不好改～

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment