← Back to all news
arXiv AI By Yiming Xu, Junfeng Jiao

Benchmarking Retrieval-Augmented Generation Strategies for Large Language Model-Based Travel Mode Choice Prediction

Read the original on arXiv AI →

The paper evaluates how Retrieval-Augmented Generation (RAG) can improve Large Language Model (LLM) predictions of travel mode choice. Four retrieval strategies—basic RAG, balanced retrieval, cross‑encoder re‑ranking, and a combination of balanced retrieval with cross‑encoder—are tested on three LLMs (GPT‑4o, o4‑mini, o3) using 2023 Puget Sound travel survey data. Results show that RAG boosts accuracy across models, with GPT‑4o plus balanced retrieval and cross‑encoder achieving 80.8% accuracy, surpassing traditional statistical and machine learning baselines and demonstrating strong zero‑shot transfer.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Jun 2

TravelEval: A Comprehensive Benchmarking Framework for Evaluating LLM-Powered Travel Planning Agents

arXiv:2606. 01046v1 Announce Type: new Abstract: The development of Large Language Models (LLMs) has significantly improved travel planning applications, yet evaluating such models is limited by existing benchmarks' limitations: 1) overemphasis on constraint compliance, neglecting multi-dimensional qualities like spatio-temporal cost; 2) datasets lacking real-world authenticity and coverage in key areas (e.

By Weiyi Chen, Shuaixiong Wang, Ziyun Gao, Kaichun Hu, Wangze Ni, Shimin Di, Chen Jason Zhang, Lei Chen
llmsagentsbenchmarks
More like this →
arXiv AI
Oct 5

How To Train Your World Model: Fine-tuning vs RAG for LM-based World Modeling

The paper evaluates two strategies for training language‑model‑based world models—fine‑tuning and Retrieval Augmented Generation (RAG)—across five diverse environments. Fine‑tuning generally yields higher rewards, while RAG is more data‑efficient. The authors propose a counterfactual error estimation for RAG, improve retrieval with a hierarchical query reformulation, and combine both approaches into a hybrid system that outperforms each method alone.

By Dhananjay Ashok, Shantanu Agarwal, Vivek Datla, Jonathan May, Alfy Samuel
llmsragagentsroboticsfine-tuning
More like this →
arXiv AI
Aug 21

An Agentic Approach for Active Data Collection, Travel Behavior Modeling, and Weather-Sensitive Demand Prediction

arXiv:2608. 20320v1 Announce Type: new Abstract: Travel behavior research increasingly combines digital data collection with predictive modeling, yet these stages are often developed and evaluated separately.

By Narges Ahmadi (McGill University), Yubo Jiao (McGill University), J\^onatas Augusto Manzolli (McGill University), Jiangbo Yu (McGill University), Luis Miranda-Moreno (McGill University)
llmsagentsmultimodalbenchmarks
More like this →
arXiv Machine Learning
Aug 24

Fine-tuning LLMs for Tourist Trajectory Prediction using Field Experiment Data

The paper demonstrates that fine‑tuning large language models (LLMs) on local tourist trajectory data can predict visitor movements under varying conditions. Using 566 trajectories from Wakayama Castle Park, Japan, the authors fine‑tuned Llama‑3.1‑8B, achieving 49.1% accuracy for next point‑of‑interest predictions and maintaining strong performance even on undersampled scenarios such as rainy days. This shows that LLMs can serve as high‑fidelity, context‑aware behavior models for tourist prediction and enable counterfactual analysis of mobility interventions.

By Tatsuya Amano, Hirozumi Yamaguchi
llmsfine-tuning
More like this →