arXiv AI By Mingyang Li, Haofan Xu, Haowen Sun, Xinzhe Chen, Sihua Ren, Liqi Huang, Xinyang Sui, Chenyang Miao, Jiawei Ye, Qiongjie Cui, Xingyu Chen, Zeyang Liu, Xuguang Lan

AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation

Read the original on arXiv AI →

AffordSim is a scalable data generator and benchmark that integrates open‑vocabulary 3D affordance prediction into simulation‑based trajectory generation for robotic manipulation. Given a natural‑language task description, it synthesizes task‑relevant scenes, queries affordances, grounds them on object surfaces, samples region‑conditioned grasps, and selects executable candidates with motion planning, while randomizing pose, texture, lighting, noise, and backgrounds for sim‑to‑real transfer. The benchmark includes 50 tasks, five robot embodiments, and over 500 objects, achieving 93% of the success rate of manual contact annotations on affordance‑critical tasks and 89% on hard composite tasks, with policies trained on AffordSim transferring zero‑shot to a real Franka FR3 with 24% average success.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Sep 22

AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation

arXiv:2609.22332v1 Announce Type: cross Abstract: Generalizable robot manipulation requires predicting how a scene will evolve, identifying where interactions are feasible, and determining how to act...

By Jiadi You, Qize Yu, Yue Chen, Minghong Cai, Zhide Zhong, Yuran Wang, Bowen Ping, Jiaqi Liang, Zhenhao Shen, Haodong Yan, Yinchuan Li, Ruihai Wu, Xiaojuan Qi, Yingcong Chen
arXiv AI
Sep 10

RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation

RoboCousin is an extensible simulation platform that transforms user-provided observations into reusable assets, scenes, and expert trajectories for bimanual robotic manipulation. It converts object images into simulation-ready models with visual, collision, semantic, and physical metadata, automatically generates grasp candidates, and builds digital cousins that vary objects, backgrounds, layouts, and language instructions while preserving task-relevant affordances. The platform supports both tabletop and room-level scene construction, and the authors release RoboCousin-OBD with over 3,000 annotated objects and 50 backgrounds, generating more than one million expert trajectories across 50 tasks, with simulation and real-robot experiments demonstrating comparable annotation quality and effective sim-to-real transfer.

By Jingxuan Zhu, Jingyi Li, LiangLiang Chen, Zhiyuan Jing, Jidong Zhang, Hongming Li
arXiv Computer Vision
Sep 1

AnnotateAnything: Automatic Annotation of 3D Assets for Robot Manipulation

arXiv:2606.17446v2 Announce Type: replace-cross Abstract: Simulation enables scalable robot data collection, but raw 3D assets provide only geometry, lacking the semantic, interactive, and physical k...

By Haoran Lu, Mutian Shen, Shuyang Yu, Yu Xiao, Songling Liu, Jianshu Zhang, Shang Wu, Yue Chen, Guo Ye, Jiayi Wang, Zhaoran Wang, Han Liu
arXiv Computer Vision
Oct 12

ForeAct3D: Policy-Grounded Future World Modeling for VLA Policies

ForeAct3D is a framework that grounds future world modeling in Vision‑Language‑Action policies by decoding depth, semantic segmentation, and camera pose from policy representations into current and future 3D scene states. The future queries are conditioned on the policy‑generated action chunk, and a physical‑consistency closure enforces background staticity, instance‑level rigidity, and wrist‑camera pose alignment with end‑effector kinematics. This approach eliminates the need for future prediction at inference and achieves high success rates on LIBERO and CALVIN, outperforming the base policy across all suites.

By Zhe Tao, Feiran Wang, Gaowen Liu, Ramana Rao Kompella, Yan Yan