Ambient @ EgoLongQA 2026: Distilling Long-Video perception into a Sub-2B Model

The paper reports an entry to the EgoLongQA track of the Wearable‑AI Challenge at ECCV 2026 that achieved first place in the ≤2 B parameter division with a score of 0.8279 on the held‑out test set. The system is a single 2 B vision‑language model that answers multiple‑choice questions about ten‑minute egocentric videos in one greedy forward pass, obtained by distilling the junior perception module of a tool‑using agentic pipeline into a small student using teacher traces that answered correctly. By pruning the multilingual embedding table from 248,320 to 143,469 rows, the authors reduce the model to 1.9985 B parameters while maintaining identical logits on retained rows, enabling the model to reach 89 % of the accuracy of the large agentic pipeline with only 1.1 % of its parameters. whyItMatters":"The work demonstrates that a highly efficient, sub‑2 B parameter vision‑language model can match the performance of a much larger agentic pipeline on long‑video perception tasks, showing the feasibility of deploying such models in resource‑constrained settings."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

• llms
• rag
• agents
• multimodal