arXiv:2606. 13578v1 Announce Type: cross Abstract: Scientific laboratories increasingly rely on AI systems to reason about experiments, but the physical act of doing science remains largely outside their reach.
Ego2Act is a new benchmark that tests video generation models on goal‑directed, egocentric manipulation tasks. It contains 2,640 videos from 110 real‑world tasks, each requiring multiple steps of object manipulation to achieve a high‑level goal. The benchmark includes Ego2ActJudge, a reference‑free evaluation pipeline that better aligns with human judgments of task completion and physics plausibility.
arXiv:2606. 12936v1 Announce Type: cross Abstract: Wet-lab robots can improve the reproducibility, throughput, and safety of biomedical experiments, but scaling their learning requires customizable simulators for safe and reproducible task generation, open editable laboratory assets, and efficient pipelines that turn limited demonstrations into usable training data.
BEAKER is a new benchmark for evaluating embodied actionability, knowledge, experimentation, and reasoning in self‑driving chemical laboratories. It contains 1,000 expert‑curated question‑answer pairs across 11 image and video task types, covering affordance grounding, trajectory planning, equipment and state recognition, safety, apparatus setup, operation, step reasoning, and temporal procedure reasoning. The benchmark is manually created and reviewed by chemistry and embodied AI experts, and it tests 28 different multimodal large language models in an offline, single‑turn setting.
arXiv:2609.37089v1 Announce Type: new Abstract: Real-world videos provide rich demonstrations of manipulation, but turning them into reusable robot skills requires visually aligned environments, exec...
LabWorld is a Real2Sim framework that reconstructs interactive 4D laboratory worlds from monocular RGB video, producing reusable 3D assets, metric scenes, time‑varying object states, and procedure events. By leveraging multi‑frame observations and motion reconstruction that combines visual, geometric, and event constraints, LabWorld outperforms existing baselines on real pipetting and vortexing tasks, achieving higher Mask IoU and PCK‑AUC scores. The framework enables explicit, editable state representation for replay, inspection, and future embodied scientific systems.
arXiv:2606. 12936v2 Announce Type: replace-cross Abstract: Wet-lab robots can improve the reproducibility, throughput, and safety of biomedical experiments, but scaling their learning requires customizable simulators for safe and reproducible task generation, open editable laboratory assets, and efficient pipelines that turn limited demonstrations into usable training data.
KnowDemo is a framework that generates diverse robot demonstrations from human videos by leveraging structured manipulation knowledge. It uses a vision‑language model to extract task requirements and permissible execution variations, then resolves these against target‑scene entities to guide candidate generation and screening before motion planning. The resulting demonstrations feature multimodal behavior, alternative contact strategies, and valid subtask orders, and have been shown to improve planning success and enable sim‑to‑real policy transfer across three tasks.
arXiv:2602.20119v2 Announce Type: replace-cross Abstract: Solving complex long-horizon robotic tasks requires joint reasoning over abstract task structure and low-level physical interaction. While co...
arXiv:2605. 07306v2 Announce Type: replace-cross Abstract: Biological laboratory automation can reduce repetitive manual work and improve reproducibility, but reliable embodied execution in wet-lab environments remains challenging.
arXiv:2606. 00054v1 Announce Type: cross Abstract: Recent progress in generalizable embodied control has been driven by large-scale pretraining of Vision-Language-Action (VLA) models.
arXiv:2606. 28385v1 Announce Type: cross Abstract: Recent advances in robot world models enable synthetic video generation for embodied prediction and planning.