arXiv AI By Ming Ma, Yi Zhu, Yiran Zhong, Feida Zhu, Weigao Sun, Junhan Shi, Lingrui Mei, Tianming Yang, Steven Hoi

Omni-Decision: A Progressive Evidence-State Agent System for Omni-Modal QA

Read the original on arXiv AI →

arXiv:2607. 11433v1 Announce Type: new Abstract: Omni-modal evidence-seeking QA requires agents to answer questions whose evidence is sparsely distributed across videos, audio, images, web pages, and computation results.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 24

Omni-Decision: Evidence-Ledger Planning for Omni-Modal Agents

Omni-Decision is an omni-modal agent that uses evidence-ledger planning to manage noisy multimodal observations. It replaces the growing dialogue history with a compact evidence ledger that tracks missing, confirmed, and conflicting evidence, allowing the planner to operate on a streamlined context. The system achieves state‑of‑the‑art accuracy on OmniGAIA and WorldSense while operating at a fraction of the cost of larger models.

By Ming Ma, Yi Zhu, Yiran Zhong, Feida Zhu, Yuhao Wang, Junhan Shi, Lingrui Mei, Tianming Yang, Steven Hoi
arXiv Machine Learning
Sep 15

Omni-Streaming Thinking

arXiv:2609.15128v1 Announce Type: new Abstract: Streaming omni-modal models must decide what and when to answer from the video chunks and synchronized audio observed so far. Visual cues often support...

By Enjun Du, Siyi Liu, Ziyu Zheng, Jingyu Li, Yiwen Guo, Yongqi Zhang, Difan Zou
arXiv Machine Learning
Aug 28

Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos

The paper introduces PACE, a factor-guided, progressive framework for acquiring evidence in long-video question answering. PACE first indexes clip-level descriptions using question-derived factors, then refines evidence retrieval with contrastive cues derived from candidate answers. On the MMR‑V dataset, PACE achieves 42.6% accuracy and recovers 66.9% of annotated cues, outperforming direct inference and prior agentic baselines, and shows consistent improvements across several long-video benchmarks.

By Baixuan Xu, Yinyui Xu, Tianshi Zheng, Zhaowei Wang, Weiqi Wang, Haochen Shi, Jiayu Liu, Qing Zong, Xiyu Ren, Xinyu Geng, Zhitao He, Yangqiu Song
arXiv AI
Jul 3

OmniGAIA: Towards Native Omni-Modal AI Agents

arXiv:2602. 22897v3 Announce Type: replace Abstract: Human intelligence naturally intertwines omni-modal perception -- spanning vision, audio, and language -- with complex reasoning and tool usage to interact with the world.

By Xiaoxi Li, Wenxiang Jiao, Jiarui Jin, Haoxuan Li, Hao Wang, Shijian Wang, Guanting Dong, Jiajie Jin, Yinuo Wang, Yuan Lu, Ji-Rong Wen, Zhicheng Dou, Zhouchen Lin