arXiv Computer Vision

Tetris: Tile-level Sampling for Efficient and High-Fidelity Video Object Tracking

Tetris is a video object tracking system that uses tile-level sampling to efficiently extract high‑fidelity tracks. It partitions videos into tile‑based polyominoes, classifies relevant tiles, prunes redundant ones with an ILP under a user‑defined accuracy constraint, and packs the remaining polyominoes to minimize detector calls. On seven stationary‑video datasets, Tetris maintains less than a 5% loss in tracking accuracy while achieving up to 17.4× higher throughput than prior systems and up to 68.8× higher than a full‑frame reference pipeline.

arXiv AI
Aug 5

Adaptive Two-Stage Visual Token Pruning for Efficient Inference in Video-Language Models

arXiv:2608. 03112v1 Announce Type: cross Abstract: Vision-language models excel at image and video understanding but suffer from high inference latency due to the need to process thousands of tokens per image, limiting their deployment on resource-constrained edge devices and in real-time surveillance applications.

By Paribesh Regmi, Qingshuang Chen, Chi Zhang, Heba Aly, Yelin Kim, Hongda Mao
arXiv AI
1d ago

LeVJEPA: Efficient & Scalable Video Pretraining without the Heuristics

LeVJEPA is a video encoder that eliminates the need for architectural asymmetries, exponential-moving-average target encoders, stop-gradients, and capacity-limited predictors used in prior self‑supervised methods. It trains a single encoder with an invariance loss over global and local views, regularized by SIGReg to prevent collapse, and achieves strong performance with far less pretraining compute. The approach also allows block‑causal attention, making temporal ordering a property of the encoder itself, and matches or surpasses state‑of‑the‑art baselines on both appearance‑centric and motion‑centric benchmarks.

By Lukas Kuhn, Lucas Maes, Giuseppe Serra, Quentin Le Lidec, Yann LeCun, Randall Balestriero, Florian Buettner