How Should a Camera-First AI Agent Work?
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
EgoMemReason is a new benchmark for week‑long egocentric video understanding that focuses on memory‑driven reasoning rather than simple perception tasks. It tests three memory types—entity, event, and behavior—across 500 questions, each requiring evidence from an average of 5.1 video segments and 25.9 hours of backtracking. Evaluation of 17 models shows that even the best achieves only 39.6% accuracy, highlighting the difficulty of long‑horizon memory in multimodal systems.
arXiv:2610.17540v1 Announce Type: new Abstract: Textual reasoning before acting has improved vision-language-action (VLA) models, but at the cost of latency: every action conditioned on the reasoning...
arXiv:2606. 17924v1 Announce Type: cross Abstract: Current Vision-Language-Action (VLA) models face a trade-off between efficient action generation and explicit deliberation.
The paper introduces 4DMemory, a benchmark for long‑horizon spatiotemporal memory that includes the LongVideo dataset—about 900 hours of video with over 5,000 manually reviewed questions—and the 4DMemoryBench. It also presents the 4DMemory Harness, a system that combines four complementary skills, more than 22 specialized tool models, and a retrieval‑augmented generation component. Evaluation of 13 leading models shows that standalone foundation models perform poorly on long‑horizon tasks, while the 4DMemory Harness boosts performance by over 50% and reveals a performance drop of more than 10% compared to previous benchmarks.
arXiv:2606. 07512v1 Announce Type: cross Abstract: Current Vision-Language Models struggle with hours-long videos because processing full-length visual sequences induces prohibitive token explosion and attention dilution.
ARGOS is a new benchmark and agent framework for multi‑camera person search that transforms the task from one‑shot retrieval into interactive reasoning using partial witness clues. The framework requires agents to plan questions, use spatial or temporal tools, and interpret ambiguous natural‑language responses within a limited turn budget, leveraging a Spatio‑Temporal Topology Graph that encodes camera connectivity and transition times. The benchmark includes 2,691 tasks across 14 real‑world scenarios, divided into semantic, spatial, and temporal tracks, and introduces Turn‑Weighted Success (TWS) as a metric that jointly measures correctness and turn efficiency, with current best agents achieving TWS scores of 0.383 and 0.590 on the spatial and temporal tracks respectively.