Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why the max IOU in the proposals are used to evaluate the performance? #22

Open
Orbis36 opened this issue Mar 27, 2022 · 0 comments
Open

Comments

@Orbis36
Copy link

Orbis36 commented Mar 27, 2022

My question is basically about the codes in 581 lines of detector3d_template.py
rcnn_recalled = (iou3d_rcnn.max(dim=0)[0] > cur_thresh).sum().item()
recall_dict['rcnn_%s' % str(cur_thresh)] += rcnn_recalled
Here the max value in iou3d are used to count the how many predict box can pass the corresponding iou thresholds.
However, for evaluation, the final_box was selected by the cls_score, instead of the IOU between the ground truth and itself.
So this will actually lead to a miss-match for the output, we use the IOU of the best-match proposal to calculate the performance instead of the box selected by cls_score.

I want to know where I went wrong, thanks for any help!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant