New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问内置的预训练任务是什么？ #89

Open

qq240035000 opened this issue Jun 27, 2023 · 0 comments

qq240035000 commented Jun 27, 2023

谢谢大佬们的工作，麻烦问一下内置的预训练任务是什么，是预测单词，判断是否是原本的单词等这些常见的自监督任务吗？有没有介绍相关文档啊，我想用一些没有打标的文本去做预训练。。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment