OpenAI Blog

Third-person imitation learning

arXiv Machine Learning
Aug 3

Mirror Learning

arXiv:2607. 28737v1 Announce Type: new Abstract: We investigate imitation learning through the lens of third-person observation and propose a framework for mirror learning: acquiring actionable policies from passive observation.

By Yunpeng Liu, Matthew Niedoba, Oluwanifemi A. Adekanye, Jason Yoo, Yingchen He, Berend Zwartsenberg, Frank Wood
arXiv Computer Vision
Sep 1

RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotion

arXiv:2512.23649v5 Announce Type: replace-cross Abstract: Humans learn locomotion through visual observation, interpreting visual content first before imitating actions. However, state-of-the-art hum...

By Zhe Li, Boan Zhu, Yangyang Wei, Shuanghao Bai, Yuheng Ji, Yibo Peng, Tao Huang, Pengwei Wang, Zhongyuan Wang, S. -H. Gary Chan, Chang Xu, Cheng Chi, Jianfei Yang, Shanghang Zhang
arXiv AI
Aug 25

Triplet2Track: A Hierarchical System with Object-Centric Representations for Reliable Long-Horizon Manipulation

Triplet2Track (TTS) is a closed‑loop long‑horizon imitation learning system that uses human videos to reduce robot‑collected data. It represents high‑level subgoals as instance‑grounded triplets, converts them into continuous track priors for execution, and monitors task progress from observations for online replanning. In diverse real‑world long‑horizon tasks, TTS achieves a 74.8% average success rate and supports object‑level and compositional generalization.

By Jianxiang Liu, Gaojing Zhang, Chuan Wen, Qipeng Liu, Yuxuan Zhao, Ning Guo, Wenzhao Lian