arXiv Machine Learning

Explaining spatial information flow in short-term traffic forecasting models using a gated graph attention network

The paper introduces a gated graph attention network (GAT) to better explain spatial information flow in short‑term traffic forecasting models. By adding a gate that learns how much of a sensor’s updated state comes from its neighbors versus itself, the authors can progressively withdraw neighbor information and observe its impact on accuracy. Applied to the ST‑MetaNet architecture on data from 498 loop detectors in England, the gated GAT shows that neighbor influence is higher for busy sensors, improves accuracy slightly with mild regularisation, and reveals that the two GAT layers are largely redundant.

arXiv AI
Jul 15

Do We Really Need Transformers for Global Spatial Information Extraction in Traffic Forecasting?

arXiv:2607. 12462v1 Announce Type: new Abstract: Existing traffic forecasting models commonly focus on extracting spatial dependencies, particularly global spatial information, which characterizes the representations obtained through interactions between each individual node and all nodes across the traffic network.

By Qihang Zhang, Siyao Zhang, Letao Kang, Wenzhe Liang, Miao Zhang, Zhao Zhang
arXiv Machine Learning
Jun 9

Efficient Traffic Prediction at Scale: A Systematic Study of STGCN Architectural Depth

arXiv:2606. 09539v1 Announce Type: new Abstract: Spatio-temporal graph neural networks (STGNNs) have become the dominant approach for traffic prediction, yet their computational requirements pose challenges for practical deployment in intelligent transportation systems (ITS).

By Soban Nasir Lone, Mohamed Abouelela, Taeyoung Yu, Jiwon Kim, Constantinos Antoniou
arXiv AI
Sep 18

FedeRICo: Federated Region-Influenced Coupling for Traffic Flow Prediction

FedeRICo is a federated traffic forecasting framework that addresses heterogeneity across client sensor subgraphs by combining gradient-level collaboration with boundary-aware residual communication. It uses a dual-branch architecture: a globally guided branch for transferable forecasting structure and a private residual branch that preserves client-specific corrections and incorporates boundary residual signals. Experiments on four real-world traffic benchmarks show that FedeRICo outperforms state‑of‑the‑art federated spatial‑temporal baselines while keeping training runtime competitive.

By Fermin Orozco, Man Luo, Johan Wahlstr\"om
arXiv AI
Sep 21

Attention-Aware Routing: Coupling Routing and Attention in MoEs

Attention-Aware Routing (AAR) augments the router in Mixture-of-Experts language models with temporal and spectral features derived from a sliding window of attention weights, thereby separating contextual information from the token’s hidden state. By keeping the base transformer frozen and training only routing parameters, AAR achieves a +3.37‑point improvement on GSM8K over a routing‑only baseline and demonstrates that routing changes propagate through the residual stream to reshape attention without directly updating the attention mechanism. The method also reduces long diverging generations, shows depth‑sensitivity affecting retrieval versus reasoning, and offers a controlled probe of routing‑relevant information across layers.

By Despoina Kosmopoulou, Anastasios Tsetsilas, Efthymios Georgiou, Giannis Karamanolakis, Swastik Roy, Alexandros Potamianos
arXiv AI
Jul 31

Do We Really Need Adaptive Global Spatial Attention for Traffic Forecasting?

arXiv:2607. 12462v2 Announce Type: replace Abstract: Existing traffic forecasting models commonly focus on extracting spatial dependencies, particularly global spatial information, which characterizes the representations obtained through interactions between each node and all nodes across the traffic network.

By Qihang Zhang, Siyao Zhang, Letao Kang, Wenzhe Liang, Miao Zhang, Zhao Zhang
arXiv AI
Jun 12

Lightweight and Interpretable Transformer via Mixed Graph Algorithm Unrolling for Traffic Forecast

arXiv:2505. 13102v4 Announce Type: replace-cross Abstract: Unlike conventional "black-box" transformers with classical self-attention mechanism, we build a lightweight and interpretable transformer-like neural net by unrolling a mixed-graph-based optimization algorithm to forecast traffic with spatial and temporal dimensions.

By Ji Qi, Tam Thuc Do, Mingxiao Liu, Zhuoshi Pan, Yuzhe Li, Gene Cheung, H. Vicky Zhao
arXiv AI
Jun 29

hia-gat: A Heterogeneous Interaction-Aware Graph Attention Network For Frame-Level Traffic Conflict Risk Prediction On Freeways

arXiv:2606. 27577v1 Announce Type: cross Abstract: This paper formulates frame-level freeway risk assessment as a multi-agent scene graph-level binary classification problem, where each video or trajectory frame is labeled risky if any TTC- or PET-based conflict violates a specified severity threshold.

By Mahshid Malazizi, Seyedmehdi Khaleghian, Mina Sartipi, Toru Hirano, Yunfei Xu, Hoang H. Nguyen