Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

testing with gpt4 API and getting "" in output after submitting a test case #5

Open
pleabargain opened this issue Jun 7, 2023 · 3 comments

Comments

@pleabargain
Copy link

image
json is empty
image

test case attached
testcase.txt

@pleabargain
Copy link
Author

pleabargain commented Jun 7, 2023

confirmed bug
JS console on latest chrome is free of errors or warnings

image

I used a test case provided on your site and JSON came back as ""
HISTORY: The patient is a 53-year-old female presenting with right shoulder pain, with a request to evaluate for synovitis. COMPARISON: No prior studies are available for comparison. TECHNIQUE: A 3T MRI of the right shoulder was performed, including axial, coronal, and sagittal sequences with proton density fat saturation and T1- and T2-weighted images. FINDINGS: The MRI reveals minimal degenerative changes in the acromioclavicular joint. There is a small amount of fluid in the subacromial subdeltoid bursa and a moderate-sized glenohumeral joint effusion with synovitis. Mild bursal-sided fraying and tendinopathy of the distal supraspinatus tendon are seen, with punctate T2 hyperintensity at its insertion but no discrete tear. Mild tendinopathy of the subscapularis tendon is also noted. The remainder of the rotator cuff appears unremarkable. The intra-articular biceps tendon demonstrates minimal tendinopathy, while the extra-articular biceps tendon appears normal in location and appearance. A small paralabral cyst is adjacent to the anterosuperior labrum, measuring 5 x 3 x 2 mm, with associated tearing and partial detachment of the anterior and anteroinferior labrum. Mild degeneration of the posterior labrum is present as well. Mild subchondral cystic changes are seen in the anteroinferior glenoid, and minimal cystic change of the humeral head insertion of the interest in this tendon is observed. Linear signal subjacent to the superior humeral head cartilage, measuring 13 x 8 mm, is consistent with cartilage delamination. Cartilage thinning is also noted over the anteroinferior glenoid. No pathologically enlarged lymph nodes are identified, and muscle bulk and signal intensity appear within normal limits. IMPRESSION: Tearing and partial detachment of the anterior and inferior labrum with an adjacent small paralabral cyst. Cartilage delamination over the superior humeral head. Moderate glenohumeral joint effusion with synovitis.

@kbressem
Copy link
Owner

kbressem commented Jun 7, 2023

Do you use GPT-4 API or 3.5? 3.5 is much harder to instruct correctly and will not provide good results. I think you still need to apply for GPT-4 API access. See also #4

Just re-read the title. Sorry. I will look into this soon.

@amitjc
Copy link

amitjc commented Aug 8, 2024

Hello @kbressem ,

I read with great interest your manuscript: Leveraging GPT-4 for Post Hoc Transformation of Free-text Radiology Reports into Structured Reporting: A Multilingual Feasibility Study.

Wondering if the test implementation would be operational any time soon.

The testing only generates a blank json.

Look forward to hearing from you soon.

Thanks and Regards,
Amit.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants