Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Different end-to-end results of DAMD #231

Open
Red-Liu199 opened this issue Mar 17, 2022 · 1 comment
Open

Different end-to-end results of DAMD #231

Red-Liu199 opened this issue Mar 17, 2022 · 1 comment

Comments

@Red-Liu199
Copy link

After I installed ConvLab-2 and run test_DAMD.py in ConvLab-2/tests/ directory, I got a complete and success rate of 34.3 and 29.5, which is different from that in the README.md.

Besides, I observed some generated dialogs and found that the ABUS cannot recognize some lexicalized entity. For instance, when the dialog system informs ABUS that the car type is 'BMW', it still asks for the car type in later turns.

@zqwerty
Copy link
Member

zqwerty commented Mar 17, 2022

As mentioned in the README.md, the results are for commits before bdc9dba (inclusive). We've made some modification to ABUS to fix some bugs.

when the dialog system informs ABUS that the car type is 'BMW', it still asks for the car type in later turns

ABUS takes dialog acts as input. The problem may come from user NLU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants