Vision-Language Models

Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction

VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

AutoPresent: Designing Structured Visuals from Scratch

2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining

VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM

Are Vision-Language Models Truly Understanding Multi-vision Sensor?

OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis

From Elements to Design: A Layered Approach for Automatic Graphic Design Composition

Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment

Video-Panda: Parameter-efficient Alignment for Encoder-free Video-Language Models

Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search

Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation

MMFactory: A Universal Solution Search Engine for Vision-Language Tasks

MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval

Flowing from Words to Pixels: A Framework for Cross-Modality Evolution

LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer

Descriptive Caption Enhancement with Visual Specialists for Multimodal Perception

GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-training

Efficient Generative Modeling with Residual Vector Quantization-Based Tokens

Apollo: An Exploration of Video Understanding in Large Multimodal Models