arXiv AI

Joint upper-bound coverage and route-choice utility: an empirical evaluation on two urban proxy tasks

The paper investigates whether improving traffic forecast accuracy or increasing uncertainty coverage benefits route choice decisions. Using a frozen protocol on Beijing and Chengdu road speed data, the authors compare raw 90th‑percentile path time bounds with jointly calibrated upper bounds, finding that joint coverage improves from roughly 83% to 92% in Beijing and from 75% to 88% in Chengdu, yet this comes with higher lateness and travel time. A separate predictor comparison shows that reducing speed mean absolute error by 14.91% also reduces lateness by 1.46 percentage points, indicating that joint coverage alone is not a reliable proxy for downstream route utility in these offline tasks.

arXiv AI
Oct 7

When better traffic forecasts fail to improve signal control: a layered diagnostic study of forecast-to-decision value

The study examines why improved traffic forecasts do not always lead to better signal‑control outcomes. Using 29 days of reconstructed traffic data from Xuancheng, China, the authors evaluate various forecasting methods—including point forecasts, conformal intervals, and dependence‑aware scenarios—within a closed‑loop control framework. While entry‑level and movement‑level forecasts reduce mean absolute error by about 4%, the resulting signal‑control decisions sometimes worsen queue vehicle‑seconds and spillback exposure, highlighting gaps between forecast accuracy and operational benefit.

By Jianing Long, Xiaobin Li, Wuming Lei, Weiguang Wang
arXiv Machine Learning
Oct 16

Selection-Safe Conformal Early Exit: Distribution-Free Coverage under Adaptive Depth

The paper introduces a selection‑safe conformal early‑exit method that calibrates a single split‑conformal quantile using a terminal‑path score derived from prefix maxima. This approach guarantees coverage for any data‑dependent stopping policy that preserves terminal‑set containment, without requiring an α/L correction. Empirical results on eight encoder backbones and CIFAR‑100 show that pathwise selection achieves higher macro coverage (0.901 vs. 0.814) with smaller set sizes and lower latency fractions compared to naive layer‑wise selection, and remains robust to deployment‑time budget changes.

By Adria Binte Habib, Ibne Farabi Shihab
arXiv AI
Sep 3

UTP-Bench: Uncertainty-aware Travel Planning Benchmark

UTP-Bench is a new benchmark for uncertainty-aware travel planning that evaluates large language models on their ability to generate robust itineraries under real-world stochastic conditions. The dataset covers 504 Indian cities, incorporating attractions, restaurants, accommodations, and multi-modal transportation networks, and includes empirical delay distributions and crowd-density patterns to simulate realistic disruptions. Three new metrics—Buffer Adequacy Score, Crowd-Aware Timing Score, and Transport Delay Absorption Score—measure how well generated plans maintain robustness against transit delays and crowd variability, revealing significant gaps between state-of-the-art LLMs and human-authored itineraries.

By Etcharla Revanth Rao, Priyanshu Karmakar, Shubhojit Mallick, Manish Gupta, Shreya Ghosh, Abhik Jana
arXiv Machine Learning
Aug 11

Opportunity Is Not Realizability: Selection-Valid Diagnostics for Multi-LLM Routing

arXiv:2608. 08265v1 Announce Type: new Abstract: Oracle routing measures how much a pool of language models could gain from per-query selection, but the diagnostic has two flaws: testing against a best fixed model selected on the same examples invalidates paired inference, and a full-information oracle sees outcomes no deployable router observes.

By Ibne Farabi Shihab, Abu Sa-Adat Mohamed Moon-Im Al Ahsan, Md Najmus Swaqeeb
Hugging Face Trending Papers
Sep 2

UTP-Bench: Uncertainty-aware Travel Planning Benchmark

UTP‑Bench is a new benchmark that evaluates large language models on uncertainty‑aware travel planning, incorporating real‑world data from 504 Indian cities and empirical delay and crowd patterns. It introduces three metrics—Buffer Adequacy Score, Crowd‑Aware Timing Score, and Transport Delay Absorption Score—to measure how well generated itineraries remain robust under stochastic conditions. Experiments show that current LLMs lag behind human planners in buffering, delay‑aware scheduling, and crowd sensitivity.

arXiv AI
Aug 19

HLSR: Hybrid Live Forecast Selective Dynamic Vehicle Rerouting for Real-Time Congestion Avoidance

HLSR is a selective hybrid live‑forecast vehicle rerouting framework designed to reduce urban traffic congestion. It combines live edge speeds with short‑horizon forecasts, using dual‑threshold congestion detection, calibrated upstream selection, and driver‑tailored travel‑time prediction. The method introduces approaching‑vehicle expansion, travel‑time‑weighted k‑shortest‑path generation, and a horizon‑dependent hybrid live‑forecast segment speed for multi‑cost route allocation.

By Xiao Wang, Shun Ren Yang, Hui Nien Hung
arXiv AI
Sep 30

You Cannot Pick a Provider From the Price List: Market-Aware Routing for Open-Weight LLM Inference

The paper demonstrates that in open‑weight LLM inference markets, selecting a model is insufficient; clients must also choose a provider, as the same model can differ markedly in quality, latency, availability, and price across providers. The authors propose a market‑aware routing approach, including a measured‑map policy and an online router called FACET, which certifies provider feasibility for each task and safely falls back to a reliable anchor. Experiments show that this strategy yields cost savings while maintaining quality and avoiding degraded endpoints.

By Liang He, Jingbo Wen, Yixiong Chen, Yue Yang, Qizhen Lan, Kangning Cui, Xilu Wang