arXiv Machine Learning

Did the Grid Erase the Event? EndoClock for Auditing Medical World-Model Pipelines

arXiv:2608. 09266v1 Announce Type: cross Abstract: Medical world models commonly learn from multimodal recordings synchronized onto a fixed-rate grid.

arXiv AI
6d ago

Audit Before You Update: Recording Artifacts and the Limits of Bounded Model Updates in MIMIC-IV ICU Prediction

The paper investigates how to evaluate bounded model updates for ICU prediction models using the MIMIC‑IV database. After auditing the data for recording artifacts and cleaning it, the authors compare a bounded update that retrains only treatment‑context and fusion parameters with full fine‑tuning across two model families and two targets, finding that bounded updates are non‑inferior or superior in most cases but depend on target, model family, and learning‑rate tuning. The study also shows that audits should precede update evaluation and that the update boundary should be chosen per target.

By Fatema Ferdous Tamanna, K. M. Merajul Arefin, Md. Abdul Masud
arXiv AI
Sep 4

Instruction Duplication as an Inference-Time Control Primitive

The paper introduces instruction duplication, a simple inference‑time control that repeats the procedural instruction without retraining or decoding changes. Across seven instruction‑tuned models and 16,800 scheduled generations, duplicating the instruction improves deterministic All‑8 diagnostic‑response success from 90.22% to 93.17% and reduces failures by 30.2%. In downstream Answer Engineering scenarios, duplication further boosts success rates, demonstrating its practical impact on systems that rely on the generated trajectory.

By Victor Lavrenko (PeaceTech VC, Israel)
Hugging Face Trending Papers
Sep 3

Clean Engineering, Unstable Measurement: A Preregistered Reliability Failure of Black-Box LLM Observers on Shared Endpoints

The paper investigates the reliability of language‑model judges used as measurement instruments on shared endpoints. Through two preregistered audits of 52,988 requests, the authors found that repeat rankings and byte‑identical replays fell far short of required thresholds, revealing significant instability. They identify three mechanisms—label‑to‑meaning bias, candidate gaps below the noise floor, and input permutation noise—that explain the gap, and propose a snapshot‑identity ladder, design rules, and a reporting checklist to mitigate such failures.

arXiv Machine Learning
Aug 4

Rethinking PPG-based Sleep Staging: Datasets, Metrics, and Benchmarks

arXiv:2608. 00943v1 Announce Type: cross Abstract: Automated sleep staging assigns discrete stage labels to successive time epochs throughout an overnight recording; conventionally each window spans at least 30 seconds, reflecting the minimum temporal resolution of the clinical scoring standard.

By Shuntian Zheng, Jiawei Wang, Cong Fu, Huan Yu, Chen Chen, Yu Guan, Sai Gu
arXiv Computer Vision
Sep 18

PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos

PROVIA is a system for online mistake detection in egocentric videos that tracks procedure state by maintaining a factual state and a learned summary of performed steps, including mistakes. It uses Bayesian state merging to create an automaton from correct demonstrations and applies a sequential test to convert per‑frame mistake probabilities into alarms. Evaluated on datasets such as CaptainCook4D, IndustReal, HoloAssist, and IMPACT‑ego, PROVIA outperforms baseline methods while operating at 58–70 fps.

By Di Wen, Kailun Yang, Jimmy Weissert, Luc Maria Scherrer, Cedric Z\"ollner, Ruiping Liu, Yufan Chen, Jiale Wei, Junwei Zheng, Kunyu Peng
arXiv Computation and Language
Sep 28

TRACE: Temporal Audit and Condition-aware Evaluation of Streaming Video Understanding

TRACE (Temporal Audit and Condition-aware Evaluation) is a new benchmark and evaluation framework for streaming video understanding that explicitly records when evidence becomes valid, how visual history is maintained, and how responses are triggered. It combines temporally audited visual tasks, evidence timing, instruction-dependent trigger annotations, a unified causal Core–Adapter protocol, and multidimensional reporting of answer quality, timeliness, response-selection behavior, workload, completion, and reliability. Using 1,240 records from 517 videos, TRACE evaluated eight publicly available models in eight configurations, revealing that similar QA accuracy can hide significant differences in completion, answer validity, generation workload, and proactive performance metrics such as response delay, false alarms, and missed target windows.

By Yibo Ma, Qianqian Zhang, Peng Liu, Tiancheng Zhao
Hugging Face Trending Papers
Sep 3

Instruction Duplication as an Inference-Time Control Primitive

Instruction duplication is a simple, inference‑time control that repeats the procedural instruction in a language‑model output without retraining or decoding changes. In experiments across seven instruction‑tuned models on 300 medical multiple‑choice questions, duplicating the instruction increased the proportion of deterministic All‑8 diagnostic‑responses from 90.22 % to 93.17 % and reduced failures by 30.2 %. The technique also improved pre‑provisional TF‑IDF recall and, in downstream Answer Engineering scenarios, significantly raised success rates for specific endpoints.