Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add out of domain test datasets for benchmarking finetuned models #719

Closed
anwai98 opened this issue Oct 2, 2024 · 1 comment · Fixed by #728
Closed

Add out of domain test datasets for benchmarking finetuned models #719

anwai98 opened this issue Oct 2, 2024 · 1 comment · Fixed by #728
Assignees

Comments

@anwai98
Copy link
Contributor

anwai98 commented Oct 2, 2024

The idea for this would be to have scripts unified in one place for evaluating automatic and interactive segmentation capabilities of micro-sam on a diverse set of open-source datasets (i.e. download them, preprocess them, run inference with new finetuned models and generate relevant metric scores) (ideally, we would like to support inference in both 2d and 3d - wherever relevant).

@anwai98
Copy link
Contributor Author

anwai98 commented Oct 14, 2024

This is resolved by #728.

@anwai98 anwai98 closed this as completed Oct 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant