-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Does evaluation API support OBB #1295
Comments
Hi @lfurtadoh 👋 Looking at the code, If you're willing, feel free to help us out! |
I looked into it deeper. In my opinion, the cleanest solution uses @SkalskiP, let's speak about that next time we meet. |
Hi @SkalskiP, is the team considering this issue? I have started to think about where can the changes possibly be. |
Hi @LinasKo, any updates on this? |
@Bhavay-2001 Linas is in vacation so It would be best to ask either Piotr or wait for them to response :) |
@onuralpszr, thanks a lot for keeping the hand on the pulse 🙏🏻 as for OBB support, I'm happy to expand support but preferably without However, before we mAP, we need to calculate IoU for OBBs and solve problems with InferenceSlicer for OBBs. |
Should we then open the issue to calculate IoU for OBBs? I have worked with OBBs so maybe I can help there |
@Bhavay-2001, I think we can work on this here. |
I saw the code which calculates iou for normal boxes[xmin, xmax,...]. The code is here. I think considering this as baseline, we can change this function according to OBB boxes. Is this in the right direction? |
Hi @Bhavay-2001 👋🏻 definitely not change. We should create a new one, |
Yup sorry, I meant adding a new function. Should I try this one then? |
Hi @SkalskiP, I am surprised by the fact that research on OBB models is increasing in top conferences but no library I am aware of consistently provides low-level functions to probe into the results for researchers. We have been using This motivates me to try implementing the IoU function for OBB, followed by helping you with other functionalities to make the OBB evaluation pipeline as smooth as possible. Since you have mentioned without |
Hi @patel-zeel 👋 You're asking the perfect question at the perfect time. Starting from the next release (est. tomorrow), we shall begin an initiative to build up a suite of metrics in supervision. As part of this, we'd love to make OBBs first-class-citizens, just like masks and xyxy boxes are. We'll definitely need Is there no more common way to compute OBB IoU? If needed, we could model them as convex polygons. |
Thanks for the updates @LinasKo. I am happy to know about I was proposing
I am all ears for your feedback, thoughts and plans for this and would happily contribute to make this happen. |
Hi @patel-zeel, 👋 Let's do it in 2 steps. First, let's implement an approximation by viewing the obb as a polygon. In the file Let's implement that in the first PR, and then refine as needed. Do you have a but of time to work on this, @patel-zeel? |
Sound good, @LinasKo. Sure, I'd like to work on this. |
Assigned it to you. Let me know if you need any help! |
Search before asking
Question
Hello! I am working with YOLOv8 for an object detection issue. I need to evaluate my model on a testset with a custom filtering method, and would like to be able to use supervision to do things like calculate mAP50 and create a confusion matrix, with the MeanAveragePrecision and ConfusionMatrix classes. I saw in issue #1227 that support for Yolo OBB dataset format is getting added.
If i do this:
Will it work properly, considering the dataset and detections are OBB's? Or is it still something to be added?
Additional
No response
The text was updated successfully, but these errors were encountered: