Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

calculation of F1score in the paper #3

Open
ZhixiangWang-CN opened this issue May 6, 2023 · 1 comment
Open

calculation of F1score in the paper #3

ZhixiangWang-CN opened this issue May 6, 2023 · 1 comment

Comments

@ZhixiangWang-CN
Copy link

Firstly, congratulations on publishing an excellent article on Radiology! However, during the reading process, I had doubts about the calculation of the binary F1 score. Is this calculation aimed at the accuracy of the recommended structured template, or at the accuracy of binary diagnosis for GPT after completing the structuring?

@kbressem
Copy link
Owner

kbressem commented May 8, 2023

For the Chest-Xrays we had binary annotations, which allowed to calculate the F1 score (data and annotations will be published in the near future as well).
For the longer reports, we did not provide any scores but did manual verification of correctness.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants