Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support additional segmentation models/parameters (e.g. NMS conf/iou thresholds) #43

Open
abrichr opened this issue Jun 5, 2024 · 1 comment

Comments

@abrichr
Copy link
Contributor

abrichr commented Jun 5, 2024

Segmenting images with many distinct objects results in many objects being missed, e.g.:

image

(Notice not all cells are marked.)

In OpenAdaptAI/OpenAdapt#679 we have good results using Ultralytics FastSAM for segmentation with very small values for non maximum suppression conf and iou:

    # threshold below which boxes will be filtered out
    conf: float = 0,
    # discards all overlapping boxes with IoU > iou_threshold
    iou: float = .05,

image

Incorporating FastSAM with parameterizable NMS would greatly increase the utility of SoM for tasks requiring high sensitivity and with many different objects.

Alternative suggestions for increasing the sensitivity with the current segmentation models would be greatly appreciated! 🙏

@abrichr abrichr changed the title Support additional segmentation parameters (e.g. NMS iou threshold) Support additional segmentation parameters (e.g. NMS conf/iou thresholds) Jun 5, 2024
@abrichr abrichr changed the title Support additional segmentation parameters (e.g. NMS conf/iou thresholds) Support additional segmentation models/parameters (e.g. NMS conf/iou thresholds) Jun 5, 2024
@abrichr
Copy link
Contributor Author

abrichr commented Jun 6, 2024

We were able to get this working offline with FastSAM by just ripping out visualizer.py.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant