Awesome-Long-Context

A curated list of resources about long-context in large-language models and video understanding.

Contents

• Large-Language Models
• Long-Form Video Understanding

Large-Language Models

• Recurrent Memory Transformer
• LongNet: Scaling Transformers to 1,000,000,000 Tokens
• Focused transformer
• Augmenting Language Models with Long-Term Memory
• Memorizing Transformers

Open-source models

• LongChat
• How Long Can Open-Source LLMs Truly Promise on Context Length?
• LongLLaMA

Long-Form Video Understanding

Papers

• EgoVLP
• UniVTG

Datasets

• Ego4D
• Towards Long-Form Video Understanding

Projects

• VLog
• MovieChat

Others

• LOVEU workshop

Contribute

This is a work in progress. Contributions welcome!