arXiv Statistics ML

Accountable and uncertainty-aware evaluation of sensor-based AI under distribution shift: devices, subjects, and nearly three years underground

arXiv Machine Learning
Jul 20

Label-Free Concept Drift Assessment for Reliable AI in Emerging Wireless Applications

arXiv:2508. 00042v2 Announce Type: replace-cross Abstract: Machine learning models deployed in non-stationary environments degrade silently, since as the input distribution drifts their accuracy decays without an error signal and without labels to reveal it.

By Athanasios Tziouvaras, Carolina Fortuna, George Floros, Kostas Kolomvatsos, Panagiotis Sarigiannidis, Marko Grobelnik, Bla\v{z} Bertalani\v{c}
arXiv Machine Learning
Jul 9

Prior-matched evaluation of operational Earth-observation classifiers: a three-number reporting method demonstrated on Sentinel-1 internal-wave detection

arXiv:2607. 07146v1 Announce Type: new Abstract: The Internal Waves Service screens the Sentinel-1 Wave-mode archive for internal solitary waves, routing detections to experts whose adjudication time is the resource the effort exists to conserve.

By Joao Pinelo, Joao Goncalves, Arun Shukla, Adriana Santos-Ferreira
arXiv Machine Learning
Jul 22

RAPT: Model-Predictive Out-of-Distribution Detection and Failure Diagnosis for Sim-to-Real Humanoid Deployment

arXiv:2602. 01515v2 Announce Type: replace-cross Abstract: Deploying learned control policies is risky because policies that appear robust in simulation can confidently enter out-of-distribution (OOD) states after Sim-to-Real transfer, causing silent failures and potential hardware damage.

By Humphrey Munn, Brendan Tidd, Peter Bohm, Marcus Gallagher, David Howard
arXiv AI
3d ago

TERRA: Task-Oriented Edge AI for Regional Fire Detection with Identity-Free Reporting

TERRA is an edge-AI framework for regional fire detection that performs task-oriented local inference and identity-free region-tagged reporting. It offers two reporting modes: TERRA-Score, which sends a quantized fire probability, and TERRA-Feature, which sends a compact learned representation for aggregation via a permutation-invariant DeepSets model. In tests on the EN54 indoor fire-alarm dataset, TERRA-Feature achieved a mean AUPRC of 0.990 with a 24‑bit payload, while TERRA-Score reached 0.987 with only 6 bits, both maintaining a low missed-detection rate of 1.81% at a false‑alarm rate of 1%.

By Mohammad Kazemi, Julie A. McCann
arXiv Machine Learning
1d ago

INLA for Adaptive UAV Sampling of Radio Environment Maps in IoT Networks: Prior Width Governs Accuracy and Calibration

The paper investigates adaptive UAV sampling for constructing radio environment maps (REMs) from non‑Gaussian IoT observations using Integrated Nested Laplace Approximation (INLA) to update a Matérn Gaussian Markov random field posterior. Waypoints are chosen via entropy pre‑screening and a Sherman–Morrison lookahead, and the study finds that widening the prior shadowing standard deviation consistently improves NMSE and credible‑interval coverage across multiple ray‑traced windows, while online width estimation from UAV counts does not recover this gain. Comparative analyses show that posterior‑informed sampling outperforms random and lawnmower strategies, but differences among informative acquisition rules remain unresolved.

By Changhao He, Kaichuang Yang, Xiaojuan Zhang
arXiv Machine Learning
Aug 4

Real-Time Detection and Repair of LLM Agent Failures

arXiv:2608. 02464v1 Announce Type: cross Abstract: LLM agents fail mid-episode -- they loop, cascade tool errors, drift off goal, fabricate results, or silently absorb corrupted content -- and the standard remedy, judging every step with a second LLM, costs more than the agent itself.

By Sunny Dubey