Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bert实现的参数问题 #7

Open
syydhhd opened this issue May 5, 2022 · 2 comments
Open

bert实现的参数问题 #7

syydhhd opened this issue May 5, 2022 · 2 comments

Comments

@syydhhd
Copy link

syydhhd commented May 5, 2022

在进行模型的Bert实现的训练过程中，我使用的参数和学习率与默认参数一致，但是训练结果很差，模型对训练集的拟合程度甚至无法达到50%，请问是参数的问题吗，如果是，请问Bert模型的训练参数是怎样设置的呢？
@UACurry
Copy link

UACurry commented May 9, 2023

请问解决了吗

@WHU-ZQH
Copy link
Owner

WHU-ZQH commented May 9, 2023

之前的代码在is_bert=1时可能存在问题，论文投稿时代码有所更新。更新后的代码和训练超参数会在近两天内发布，请耐心等待:)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@UACurry @WHU-ZQH @syydhhd