arXiv Computer Vision
In-Context Robot Learning with VLM Agents
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Sep 30
In-Context Learning for Robots: Methods and Applications
arXiv:2609.36012v1 Announce Type: cross Abstract: General-purpose robots must infer what a new task requires and translate that understanding into appropriate physical action. In-context learning (IC...
arXiv Computer Vision
Sep 10
Show-Harness: Just a VLM Agent Can Play Robots
arXiv:2609.10522v1 Announce Type: cross Abstract: Foundation vision-language models (VLMs) exhibit broad intelligence about the world, yet translating this intelligence into robot control remains cha...
arXiv AI
Sep 21
KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos
KnowDemo is a framework that generates diverse robot demonstrations from human videos by leveraging structured manipulation knowledge. It uses a vision‑language model to extract task requirements and permissible execution variations, then resolves these against target‑scene entities to guide candidate generation and screening before motion planning. The resulting demonstrations feature multimodal behavior, alternative contact strategies, and valid subtask orders, and have been shown to improve planning success and enable sim‑to‑real policy transfer across three tasks.
arXiv AI
Aug 19
Teach and Grow: An Agent-Centered Architecture for General Robot Learning
Teach-and-Grow Learning (TGL) is an agent-centered architecture that transforms a few successful demonstrations into reusable Skill Blocks, enabling a robot to compose, execute, and revise behaviors in new scenes without task-specific policy retraining. The system maintains a Skill Library and structured Experience Memory to capture successes, failures, and repairs, allowing persistent reuse and agent-directed adaptation. Evaluation on the LIBERO benchmark shows state-of-the-art performance, and the authors propose a scaling-law hypothesis suggesting that accumulated reusable experience reduces future-task error and teaching demand following a power-law trend.
arXiv AI
Jun 30
Demonstration-Free Robotic Control via LLM Agents
arXiv:2601. 20334v2 Announce Type: replace-cross Abstract: Robotic manipulation has increasingly adopted vision-language-action (VLA) models, which achieve strong performance but typically require task-specific demonstrations and fine-tuning, and often generalize poorly under domain shift.
arXiv Computer Vision
Sep 15
V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environments
arXiv:2609.15683v1 Announce Type: new Abstract: While In-Context Learning (ICL) enables models to adapt from exemplars without parameter updates, multimodal ICL remains largely underexplored, particu...