EK100 Train Metadata videoMAE

[AmirSh15]

Hi, thanks for sharing the nice work!

I'm planning to run the 'AVION/scripts/main_videomae_pretrain.py' and it needs the '--train-metadata' argument. I checked the rest of the code and it seems it expects something different than the 'EPIC_100_train.csv' file in the original EK100 annotation repo here.
I can guess how the data format is and I can create the expected file for the original videos, but I'm wondering how it would be with your resized and chunked dataset version.
Could you please help me with this?

[zhaoyue-zephyrus]

Hi @AmirSh15

We did not implement the VideoMAE on Epic-Kitchens. The experiments were done on Kinetics. You can follow https://github.com/zhaoyue-zephyrus/AVION/tree/main/datasets#kinetics to make EPIC-Kitchens videos compatible with the classification dataset for Epic-Kitchens. One simple solution is to trim the raw videos into small clips based on the annotation. The length of clips is typically short enough so you don't need to further chunk them.