Zero-shot grounding results on SIIM-ACR are not reproducible

[HieuPhan33]

Hi,

Since the zero-shot grounding code for SIIM-ACR is not released, I have adapted the test.py under Zero-shot-grounding_RSNA folder.

I changed the target class from 'pneumonia' to 'pneumothorax', which is a target disease in SIIM-ACR.
I tested it on a 20% random subset of SIIM dataset.

I got a very low result:
Recall=23.34
Precision=0.04
Dice=0.06
IoU=0.03

Could you please advise how to fine-tune the code or model to reproduce your results?

[fuying-wang]

Hi,

Did you solve this problem?

[HieuPhan33]

Hi,

Unfortunately, I didn't solve the problem.