New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

codebook indices可以直接和文本token交互吗？ #23

Open

pantianrui opened this issue Sep 22, 2024 · 1 comment

pantianrui commented Sep 22, 2024

您好。我看到codebook indices是一系列的整数index，那是否可以用它们直接和文本的token在llm中交互呢？并且quantized vectors是由一系列的codebook得到的，有没有emb2vq的可能啊？我对codebook不熟，很抱歉打扰到您。

Owner

Plachtaa commented Sep 23, 2024

只要你愿意做当然可以

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment