arXiv AI By Jianing Long, Xiaobin Li, Wuming Lei, Weiguang Wang

Joint upper-bound coverage and route-choice utility: an empirical evaluation on two urban proxy tasks

Read the original on arXiv AI →

The paper investigates whether improving traffic forecast accuracy or increasing uncertainty coverage benefits route choice decisions. Using a frozen protocol on Beijing and Chengdu road speed data, the authors compare raw 90th‑percentile path time bounds with jointly calibrated upper bounds, finding that joint coverage improves from roughly 83% to 92% in Beijing and from 75% to 88% in Chengdu, yet this comes with higher lateness and travel time. A separate predictor comparison shows that reducing speed mean absolute error by 14.91% also reduces lateness by 1.46 percentage points, indicating that joint coverage alone is not a reliable proxy for downstream route utility in these offline tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 7

When better traffic forecasts fail to improve signal control: a layered diagnostic study of forecast-to-decision value

The study examines why improved traffic forecasts do not always lead to better signal‑control outcomes. Using 29 days of reconstructed traffic data from Xuancheng, China, the authors evaluate various forecasting methods—including point forecasts, conformal intervals, and dependence‑aware scenarios—within a closed‑loop control framework. While entry‑level and movement‑level forecasts reduce mean absolute error by about 4%, the resulting signal‑control decisions sometimes worsen queue vehicle‑seconds and spillback exposure, highlighting gaps between forecast accuracy and operational benefit.

By Jianing Long, Xiaobin Li, Wuming Lei, Weiguang Wang
arXiv Machine Learning
Oct 16

Selection-Safe Conformal Early Exit: Distribution-Free Coverage under Adaptive Depth

The paper introduces a selection‑safe conformal early‑exit method that calibrates a single split‑conformal quantile using a terminal‑path score derived from prefix maxima. This approach guarantees coverage for any data‑dependent stopping policy that preserves terminal‑set containment, without requiring an α/L correction. Empirical results on eight encoder backbones and CIFAR‑100 show that pathwise selection achieves higher macro coverage (0.901 vs. 0.814) with smaller set sizes and lower latency fractions compared to naive layer‑wise selection, and remains robust to deployment‑time budget changes.

By Adria Binte Habib, Ibne Farabi Shihab
arXiv AI
Sep 3

UTP-Bench: Uncertainty-aware Travel Planning Benchmark

UTP-Bench is a new benchmark for uncertainty-aware travel planning that evaluates large language models on their ability to generate robust itineraries under real-world stochastic conditions. The dataset covers 504 Indian cities, incorporating attractions, restaurants, accommodations, and multi-modal transportation networks, and includes empirical delay distributions and crowd-density patterns to simulate realistic disruptions. Three new metrics—Buffer Adequacy Score, Crowd-Aware Timing Score, and Transport Delay Absorption Score—measure how well generated plans maintain robustness against transit delays and crowd variability, revealing significant gaps between state-of-the-art LLMs and human-authored itineraries.

By Etcharla Revanth Rao, Priyanshu Karmakar, Shubhojit Mallick, Manish Gupta, Shreya Ghosh, Abhik Jana
arXiv Machine Learning
Aug 11

Opportunity Is Not Realizability: Selection-Valid Diagnostics for Multi-LLM Routing

arXiv:2608. 08265v1 Announce Type: new Abstract: Oracle routing measures how much a pool of language models could gain from per-query selection, but the diagnostic has two flaws: testing against a best fixed model selected on the same examples invalidates paired inference, and a full-information oracle sees outcomes no deployable router observes.

By Ibne Farabi Shihab, Abu Sa-Adat Mohamed Moon-Im Al Ahsan, Md Najmus Swaqeeb
Hugging Face Trending Papers
Sep 2

UTP-Bench: Uncertainty-aware Travel Planning Benchmark

UTP‑Bench is a new benchmark that evaluates large language models on uncertainty‑aware travel planning, incorporating real‑world data from 504 Indian cities and empirical delay and crowd patterns. It introduces three metrics—Buffer Adequacy Score, Crowd‑Aware Timing Score, and Transport Delay Absorption Score—to measure how well generated itineraries remain robust under stochastic conditions. Experiments show that current LLMs lag behind human planners in buffering, delay‑aware scheduling, and crowd sensitivity.