Dataset calibration for Custom data on Yolov8 instance segmentation #2752
Replies: 5 comments 11 replies
-
Hello @Priyanshu88, What kind of problem did you face? |
Beta Was this translation helpful? Give feedback.
-
@Priyanshu88, It looks like the problem is not related to NNCF. I would recommend testing your model on your custom dataset without using NNCF. You can find tutorials and documentation on how to do this in the ultralytics documenation |
Beta Was this translation helpful? Give feedback.
-
@Priyanshu88, could you provide the full reproducer with dataset? |
Beta Was this translation helpful? Give feedback.
-
@Priyanshu88, thanks for the provided notebook. I tried to run your notebook and got the following error:
I didn't find |
Beta Was this translation helpful? Give feedback.
-
@Priyanshu88, I managed to run your reproducer and get a quantized model. There weren't any errors. Are you still experiencing the problem you wrote about earlier?
I'm sure before quantization you have the same behavior. Probably, you need mapping from model output to your classes in post-processing step. |
Beta Was this translation helpful? Give feedback.
-
I am want to do the nncf quantization for yolov8 instance segmentation model on custom dataset my dataset is in coco format with .yaml file containing the paths and classes. I am using the below code for my quantization but facing problem with it for my custom dataset. I am using the above reference. Please help me correcting this. Thanks!
Beta Was this translation helpful? Give feedback.
All reactions