Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

transformer训练准确度低 #18

Open
Augus753 opened this issue Dec 3, 2019 · 3 comments
Open

transformer训练准确度低 #18

Augus753 opened this issue Dec 3, 2019 · 3 comments

Comments

@Augus753
Copy link

Augus753 commented Dec 3, 2019

你好。很感谢您提供的代码教程。目前发现transformer训练准确度低。只有不到60%,大大低于TextCNN的85%,请问您当时测试也是如此吗?若是提高,可以给点建议吗?谢谢
text_classifier/models/transformer.py

@VerusHao
Copy link

VerusHao commented May 9, 2020

transformer训练过程最后维度归一化时矩阵相乘维度出错,你改了什么地方吗

@wuxi-xc
Copy link

wuxi-xc commented Oct 19, 2022

请问transformer在进行中文二分类时运行test.py出现InvalidArgumentError (see above for traceback): Inputs to operation transformer/transformer-1/multi_head_atten/Select of type Select must have the same size and shape. Input 0: [8,150,150] != input 1: [240,150,150]错误是什么原因了谢谢

@wuxi-xc
Copy link

wuxi-xc commented Oct 19, 2022

您好,请问您在运行test.py时会出现错误吗,求解急

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants