RetroThinker is a multi-stage post‑training framework that enhances SpeechLLMs by enabling them to self‑verify and forward‑correct Chain‑of‑Thought reasoning steps during inference. It combines supervised fine‑tuning on curated retrospective thinking data with length‑based direct preference optimization to improve reasoning while the user speaks. On the GSM8K benchmark, RetroThinker achieves an 11% absolute accuracy gain over non‑retrospective baselines while maintaining comparable latency.
By Yi-Jen Shih, Puyuan Peng, Abdelrahman Mohamed, David Harwath
The paper explores using a large language model (LLM) to generate background context for social media posts and tests four ways to integrate this context into a Sentence-BERT (SBERT) hate‑speech detection classifier. The methods include text concatenation, embedding concatenation, hierarchical transformer fusion, and LLM‑driven text enhancement. Experiments on the Latent Hatred dataset of implicitly hateful tweets and the MAMI dataset of misogynous memes show that adding generated context can raise F1 scores by up to 3 points in textual and 6 points in multimodal settings compared to a zero‑context baseline, with embedding concatenation yielding the best results.
By Joshua Wolfe Brook, Ilia Markov
The paper evaluates a multilingual ASR model (MMS‑1B‑all) on a Garrusi Kurdish dataset using a common‑reference staged normalization approach. By normalizing both reference and hypothesis, the authors show that raw Arabic‑script hypotheses yield a 111.70 % WER, which drops to 97.85 % after folding into a reduced orthography, highlighting the impact of orthographic differences on error measurement. A Southern Kurdish fine‑tuned system performs worse, and residual errors are partly due to scoring‑pipeline limitations rather than recognition failures.
By Hiwa Asadpour
The paper introduces a multimodal in‑context learning framework that uses contrastive demonstration modeling to align large language models’ responses with the required reasoning paths. By contrasting suboptimal and better responses and incorporating a response‑conditioned retrieval mechanism, the method explicitly guides models beyond surface imitation. Experiments on various multimodal tasks, especially visual question answering, show consistent performance gains.
By Mingbo Yang, Wenqiang Wang, Zhaolu Kang, Peng Chen, Yannan Chen, Sunshang Wang, Yan Xiao
The paper introduces MOCO, a diffusion-based framework that generates 3D avatar motions from concurrent multimodal inputs such as speech audio, text descriptions, and trajectory data. MOCO decouples motion generation by independently producing modality-specific motions at each denoising step and then assembling them according to spatial rules, iteratively refining the combined motion. This approach yields coherent, lifelike, and synchronized movements, outperforming existing baselines on a multimodal benchmark.
By Yifei Liu, Qiong Cao, Hongwei Yi, Huaiguang Jiang, Changxing Ding
HiPerViT is a compact vision-only architecture that injects an explicit second-order statistical prior into a transformer-based pipeline for texture recognition. It combines global and local image views with a compact bilinear descriptor encoded as a statistical token, and integrates this token with first-order spatial representations through Perceiver-style latent distillation. Across six texture recognition benchmarks, HiPerViT consistently outperforms strong vision-only baselines, achieving notable gains on DTD, GTOS-Mobile, and 1200Tex, and the improvements are largely independent of backbone depth or fusion topology.
By Jo\~ao Pedro C. A. de S\'a, Odemir Martinez Bruno
The paper presents M2Heat, a physics-inspired framework for fusing hyperspectral and LiDAR data in land‑cover classification. It introduces a visual heat conduction module (vHeat) and Frequency Value Embeddings (FVEs) to model anisotropic information flow, capturing global dependencies with sub‑quadratic complexity. Combined with a Cross‑Frequency Fusion (CFF) module, M2Heat delivers discriminative, robust features and achieves competitive performance on Trento, Houston2013, and Augsburg benchmarks while offering an interpretable heat‑conduction perspective.
By Kan Wei, Jiahui Cui, Jing Yao, Xinyu Zhao, Lei Wang, Pedram Ghamisi
The paper introduces VWG-Bench, a benchmark covering nine reasoning dimensions and 38 tasks to evaluate video generative models on symbolic reasoning, physical laws, and goal pursuit. It also presents Vid-PRE, a prompt-rewriting framework that offloads reasoning to a VLM, improving logical performance without changing the generator architecture. Experiments show that current models excel at visual quality but struggle with logic-heavy tasks, while Vid-PRE significantly boosts reasoning across multiple generators.
By Meng Luo, Yicheng Liu, Jiahao Wang, Yuanxing Zhang, Xin Tao, Pengfei Wan, Kun Gai, Hao Fei
The paper investigates using Vision Language Models (VLMs) to accelerate verification and validation (V&V) of classification models by automatically detecting systematic errors. It introduces a VLM-based error slice detection (ESD) method that groups and labels errors, demonstrating its ability to identify perturbations in a non-military dataset and to cluster images by surroundings in a military context. The study highlights challenges such as underrepresentation of defence data in VLM training and limited contextual diversity, and suggests that while fully automated V&V is not yet feasible, VLMs could speed up the process in the future.
By Dieuwertje Alblas, Alma M. Liezenga, Jan Erik van Woerden, Fedor Taggenbrock, Dalia Aljawaheri, Klamer Schutte
Xiaomi-CocktailASR-1 is an LLM-based end‑to‑end target‑speaker ASR architecture that uses reference speech as voiceprint prompts to transcribe a target speaker directly from mixed audio, eliminating the need for speech separation. It retains competitive single‑speaker performance comparable to mainstream ASR models and introduces a negative sample rejection capability, outputting empty text when the target speaker is absent. The system also supports a Chain‑of‑Thought reasoning mode and achieves state‑of‑the‑art performance on synthetic and real‑world multispeaker benchmarks, effectively addressing the cocktail party problem with a unified architecture.
By Yiru Zhang, Hang Su, Lichun Fan, Ying Zeng, Chang Liu, Yifeng Wang, Yuquan Liang, Tao Li, Lian Li, Wenhao Yang, Jian Luan, Cong Zou, Heng Qu
RelayS2S is a hybrid real‑time dialogue system that runs a fast duplex speech‑to‑speech path and a slow ASR‑to‑LLM path in parallel. The fast path speculatively drafts a short response prefix and streams it to TTS, while the slow path generates a higher‑quality continuation conditioned on that prefix. A lightweight verifier decides whether to commit the prefix or fall back to the cascaded pipeline, achieving much lower latency (81 ms P90 first‑chunk) while preserving 99% of the cascaded pipeline’s textual quality.
By Long Mai, Junli Liang
The paper announces VectraYX‑Vision‑1B, a Spanish/LATAM cybersecurity vision‑language model that uses a natively‑trained visual tower (Qwen2‑VL) and a frozen decoder. The authors report that transplanting the visual tower improves the failing 8‑nibble address field from 0.00 to 0.81 exact, using a coarser token budget than 2×2 tiling, and that a second pre‑registered field shows 63% contamination and is demoted. The model’s B6/B7 tool‑id remains at floor, and code/checkpoints are available on Hugging Face.
By Juan S. Santillana
The paper presents a lightweight vision‑language encoder paired with a compact multi‑layer perceptron to estimate flare combustion efficiency from low‑cost thermal video. The trained model is deployed via a user‑friendly GUI that overlays efficiency values on each frame, tracks real‑time trends, visualizes distribution across the video, and exports CSV reports. In a six‑month trial, the system maintained 99% uptime with under 15 minutes of weekly maintenance.
By Afeefa Azam, Iyyakutti Iyappan Ganapathi, Fares Ossama Abdelhafez, Divya Velayudhan, Maregu Assefa Habtie, Hamad Karki, Khalid Yousef Al Awadhi, Naoufel Werghi
The paper introduces SurgicalRoomAgent, a voice‑interactive multi‑agent system for smart operating rooms that leverages large language models to understand natural language, control devices, record intraoperative events, and generate surgical reports. Its layered architecture includes a voice interaction pipeline (wake, ASR, turn detection, agent reasoning, TTS) and an agent core (skill registry, task planner, device manager). Three key technologies—KV Cache prefix warming, streaming partial JSON parsing with early parallel task execution, and progressive skill prompt disclosure—reduce latency and maximize context efficiency, enabling real‑time operation within a 16,384‑token limit.
By Tianxiang Zhou
TeleOCR is a unified framework for document parsing that tackles challenges in both decoupled and end-to-end Vision‑Language Models. It introduces deformation‑aware learning to handle geometric distortions, an adaptive sampling mechanism for complex layouts, and a content‑structure decoupled strategy to model formula grammars and table structures. The approach achieves state‑of‑the‑art results on multiple benchmarks, including top placement in the ICDAR 2026 Sci‑ImageMiner Challenge.
By Peng Cai, Zhaofan Zou, Shifa Liu, Yikun Wang, Jiawei Tang, Kaicheng Yang, Meng Tong, MingKun Jiang, Zhongjiang He, Hao Sun
The paper introduces HuRo, a dataset of 630K robotized episodes derived from diverse human videos, created via a pipeline that aligns observations and actions for robotic use. Experiments on four real‑world manipulation tasks show that scaling robotized pretraining boosts task completion from 51.5% to 80.3% and improves out‑of‑distribution performance under spatial and visual shifts. Ablation studies reveal that visual robotization enhances robustness and that end‑to‑end pretraining with retargeted actions outperforms visual‑only transfer.
By Jinho Jeong, Se June Joo, Jaehyun Kang, Dongyun Kim, Yena Kim, Hanjung Kim, Seon Joo Kim
The paper introduces SolCloudLLM, a large language model–based framework that fuses sky‑image patches with time‑series data through bidirectional multimodal fusion for short‑term solar forecasting. Experiments on the SIRTA and SKIPP'D datasets show that SolCloudLLM outperforms existing baselines, achieving up to a 25.4% reduction in mean squared error, especially under cloudy conditions and in few‑shot scenarios.
By Ken Chen, Maneesha Perera, Wei Wang, Sachith Seneviratne, Hansani Weeratunge, Saman Halgamuge
CS-Guard is a new benchmark that systematically evaluates guardrails for code generation security, covering 1,000 malware-generation prompts, 7 jailbreak attacks, and a novel fictional scenario attack (FSA) for text-to-code generation, as well as 331 code prompts for code-to-code generation. The study empirically tests nine guardrails across seven large language models, finding that many guardrails fail to prevent malicious code generation, with attack success rates reaching about 50% for text-to-code and up to nearly 100% for code-to-code and FSA scenarios. CS-Guard introduces a modular three-layer guardrail taxonomy and releases its benchmark and data to support future research.
By Jinyang Li, Mingyu Guo, Hung X. Nguyen
The paper reports an entry to the EgoLongQA track of the Wearable‑AI Challenge at ECCV 2026 that achieved first place in the ≤2 B parameter division with a score of 0.8279 on the held‑out test set. The system is a single 2 B vision‑language model that answers multiple‑choice questions about ten‑minute egocentric videos in one greedy forward pass, obtained by distilling the junior perception module of a tool‑using agentic pipeline into a small student using teacher traces that answered correctly. By pruning the multilingual embedding table from 248,320 to 143,469 rows, the authors reduce the model to 1.9985 B parameters while maintaining identical logits on retained rows, enabling the model to reach 89 % of the accuracy of the large agentic pipeline with only 1.1 % of its parameters.
whyItMatters":"The work demonstrates that a highly efficient, sub‑2 B parameter vision‑language model can match the performance of a much larger agentic pipeline on long‑video perception tasks, showing the feasibility of deploying such models in resource‑constrained settings."
By Logesh Kumar Umapathi
The paper introduces EMMI, a framework that enables communication‑efficient inference of multimodal large language models (MLLMs) on edge devices. EMMI encodes each sensor modality separately, fuses the representations, and compresses them into a compact latent vector that is transmitted to a server for high‑capacity reasoning. Experiments on a multimodal benchmark show that EMMI can cut the communication payload by 32× while keeping accuracy comparable, achieving up to a 3.4× reduction in end‑to‑end inference latency under bandwidth‑constrained conditions.
By Motahare Mounesan, Irfan Khan