Gemini Robotics: Bringing AI into the Physical World
Paper
•
2503.20020
•
Published
•
29
Multimodal Agent
-
-
Magma: A Foundation Model for Multimodal AI Agents
Paper • 2502.13130 • Published • 58 -
LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents
Paper • 2311.05437 • Published • 51 -
OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
Paper • 2410.23218 • Published • 49 -
ShowUI: One Vision-Language-Action Model for GUI Visual Agent
Paper • 2411.17465 • Published • 88 -
Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks
Paper • 2501.11733 • Published • 28 -
Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skills
Paper • 2503.12533 • Published • 68 -
Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Tasks
Paper • 2503.21696 • Published • 23 -
UI-R1: Enhancing Action Prediction of GUI Agents by Reinforcement Learning
Paper • 2503.21620 • Published • 62 -
OmniParser for Pure Vision Based GUI Agent
Paper • 2408.00203 • Published • 25 -
UniVLA: Learning to Act Anywhere with Task-centric Latent Actions
Paper • 2505.06111 • Published • 25 -
Visual Agentic Reinforcement Fine-Tuning
Paper • 2505.14246 • Published • 32 -
Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets
Paper • 2505.15517 • Published • 4 -
Interactive Post-Training for Vision-Language-Action Models
Paper • 2505.17016 • Published • 6 -
InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer Interaction
Paper • 2505.10887 • Published • 10 -
Paper2Poster: Towards Multimodal Poster Automation from Scientific Papers
Paper • 2505.21497 • Published • 107 -
VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selection
Paper • 2505.20289 • Published • 10 -
Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence
Paper • 2505.23747 • Published • 68 -
Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM Agents
Paper • 2505.24878 • Published • 22 -
SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
Paper • 2506.01844 • Published • 140 -
LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks
Paper • 2506.00411 • Published • 31 -
VS-Bench: Evaluating VLMs for Strategic Reasoning and Decision-Making in Multi-Agent Environments
Paper • 2506.02387 • Published • 58 -
GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
Paper • 2506.03143 • Published • 52 -
Multimodal DeepResearcher: Generating Text-Chart Interleaved Reports From Scratch with Agentic Framework
Paper • 2506.02454 • Published • 7 -
SAFE: Multitask Failure Detection for Vision-Language-Action Models
Paper • 2506.09937 • Published • 8 -
Optimus-3: Towards Generalist Multimodal Minecraft Agents with Scalable Task Experts
Paper • 2506.10357 • Published • 21 -
VideoDeepResearch: Long Video Understanding With Agentic Tool Using
Paper • 2506.10821 • Published • 19 -
BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models
Paper • 2506.07961 • Published • 11 -
EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models
Paper • 2506.10100 • Published • 9 -
From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
Paper • 2506.09930 • Published • 8 -
Unified Vision-Language-Action Model
Paper • 2506.19850 • Published • 27 -
WorldVLA: Towards Autoregressive Action World Model
Paper • 2506.21539 • Published • 39 -
A Survey on Vision-Language-Action Models: An Action Tokenization Perspective
Paper • 2507.01925 • Published • 38 -
RoboBrain 2.0 Technical Report
Paper • 2507.02029 • Published • 32 -
PresentAgent: Multimodal Agent for Presentation Video Generation
Paper • 2507.04036 • Published • 10 -
A Survey on Vision-Language-Action Models for Autonomous Driving
Paper • 2506.24044 • Published • 14 -
PyVision: Agentic Vision with Dynamic Tooling
Paper • 2507.07998 • Published • 31 -
ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning
Paper • 2507.16815 • Published • 39 -
ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
Paper • 2507.22827 • Published • 98 -
villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models
Paper • 2507.23682 • Published • 23 -
Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning
Paper • 2503.15558 • Published • 50 -
InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulation
Paper • 2507.17520 • Published • 14 -
RoboMemory: A Brain-inspired Multi-memory Agentic Framework for Lifelong Learning in Physical Embodied Systems
Paper • 2508.01415 • Published • 7 -
OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use
Paper • 2508.04482 • Published • 9 -
MolmoAct: Action Reasoning Models that can Reason in Space
Paper • 2508.07917 • Published • 43 -
MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents
Paper • 2508.13186 • Published • 18 -
UI-Venus Technical Report: Building High-performance UI Agents with RFT
Paper • 2508.10833 • Published • 43 -
Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory
Paper • 2508.09736 • Published • 56 -
WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent
Paper • 2508.05748 • Published • 137 -
Mobile-Agent-v3: Foundamental Agents for GUI Automation
Paper • 2508.15144 • Published • 64 -
Do What? Teaching Vision-Language-Action Models to Reject the Impossible
Paper • 2508.16292 • Published • 9 -
CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification
Paper • 2508.21046 • Published • 9 -
Mind the Third Eye! Benchmarking Privacy Awareness in MLLM-powered Smartphone Agents
Paper • 2508.19493 • Published • 11 -
EmbodiedOneVision: Interleaved Vision-Text-Action Pretraining for General Robot Control
Paper • 2508.21112 • Published • 75 -
UItron: Foundational GUI Agent with Advanced Perception and Planning
Paper • 2508.21767 • Published • 12 -
Robix: A Unified Model for Robot Interaction, Reasoning and Planning
Paper • 2509.01106 • Published • 48 -
UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning
Paper • 2509.02544 • Published • 122 -
VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
Paper • 2509.09372 • Published • 233 -
SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning
Paper • 2509.09674 • Published • 78 -
F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actions
Paper • 2509.06951 • Published • 31 -
UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learning
Paper • 2509.11543 • Published • 47 -
Nav-R1: Reasoning and Navigation in Embodied Scenes
Paper • 2509.10884 • Published • 6 -
BTL-UI: Blink-Think-Link Reasoning Model for GUI Agent
Paper • 2509.15566 • Published • 14 -
Video2Roleplay: A Multimodal Dataset and Framework for Video-Guided Role-playing Agents
Paper • 2509.15233 • Published • 2 -
A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learning
Paper • 2509.15937 • Published • 20 -
RynnVLA-001: Using Human Demonstrations to Improve Robot Manipulation
Paper • 2509.15212 • Published • 21 -
D-Artemis: A Deliberative Cognitive Framework for Mobile GUI Multi-Agents
Paper • 2509.21799 • Published • 8 -
Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation
Paper • 2509.23866 • Published • 12 -
PixelCraft: A Multi-Agent System for High-Fidelity Visual Reasoning on Structured Images
Paper • 2509.25185 • Published • 4 -
UniMIC: Token-Based Multimodal Interactive Coding for Human-AI Collaboration
Paper • 2509.22570 • Published • 3 -
VLA-R1: Enhancing Reasoning in Vision-Language-Action Models
Paper • 2510.01623 • Published • 7 -
VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators
Paper • 2510.00406 • Published • 63 -
Expertise need not monopolize: Action-Specialized Mixture of Experts for Vision-Language-Action Learning
Paper • 2510.14300 • Published • 8 -
VLA^2: Empowering Vision-Language-Action Models with an Agentic Framework for Unseen Concept Manipulation
Paper • 2510.14902 • Published • 13 -
InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy
Paper • 2510.13778 • Published • 16 -
X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model
Paper • 2510.10274 • Published • 13 -
DeepMMSearch-R1: Empowering Multimodal LLMs in Multimodal Web Search
Paper • 2510.12801 • Published • 12 -
Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoning
Paper • 2510.11027 • Published • 19 -
ReLook: Vision-Grounded RL with a Multimodal LLM Critic for Agentic Web Coding
Paper • 2510.11498 • Published • 10 -
GigaBrain-0: A World Model-Powered Vision-Language-Action Model
Paper • 2510.19430 • Published • 42 -
DaMo: Data Mixing Optimizer in Fine-tuning Multimodal LLMs for Mobile Phone Agents
Paper • 2510.19336 • Published • 16 -
PhysVLM-AVR: Active Visual Reasoning for Multimodal Large Language Models in Physical Environments
Paper • 2510.21111 • Published • 1