Getting Object Labels

[goyalsaransh97]

Is there a way for getting the object labels for bounding boxes, given by the (fine-tuned) Detectron model?

[apsdehal]

Currently, we don't have this data present in our object features. You can check Colab demo to understand how to extract object features and every other information at your end. You can also look into maskrcnn-benchmark for extracting object features.

For TextVQA, we have some information including bounding boxes coordinates and other stuff in info files but it still doesn't contain object labels. We probably won't be supporting this in near future.

[goyalsaransh97]

Precisely which model(and version) are you using for object detection?

[apsdehal]

You can use the script here and follow the instructions to install. Comment out the lines to get all the relevant data other than features:
https://github.com/facebookresearch/pythia/blob/master/tools/extract_features.py#L190-L198