This repository contains the code for Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning. We build AGoT on top of the awesome toolbox of Dassl.pytorch.
Install dassl
based on https://github.com/KaiyangZhou/CoOp?tab=readme-ov-file#how-to-install
Run AGoT on imagenet
sh scripts/AGoT/train.sh
The full citation is
@article{yang2024soft,
title={Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning},
author={Yang, Juncheng and Li, Zuchao and Xie, Shuai and Yu, Wei and Li, Shijun and Du, Bo},
journal={arXiv preprint arXiv:2404.04538},
year={2024}
}