arXiv AI

AI Search as an Information Intermediary: Clickstream Evidence on Web Traffic

AI search retrieves web information to ground generated answers. Using U.S. desktop clickstream data, the study observes that referrals accompany 5.4% of ChatGPT sessions versus 31.1% of Google queries, with ad‑supported sites receiving a smaller share of ChatGPT referrals and reference/technical sites receiving larger shares. Conventional searches (Google, Bing, Yahoo) decline after ChatGPT adoption, especially among households with lower prior search activity, while ChatGPT use rises among existing users.

arXiv AI
Sep 18

Characterizing Web Search by Conversational LLM Agents: From Search Decisions and Strategies to Results and Responses

The study examines how conversational LLM agents—specifically ChatGPT, Claude, Grok, and DeepSeek—use Web search, combining real user interactions with controlled API experiments. It finds that agents differ in when they decide to search, how they craft queries, and which domains they favor, and that more frequent searching does not always improve answer quality. While most responses are grounded in search results, some claims are unsupported, raising attribution concerns.

By Mahsa Amani, Seungeon Lee, Abhisek Dash, Asmaa El Fraihi, Yunah Jang, Elisabeth Kirsten, Qinyuan Wu, Krishna P. Gummadi, Manish Gupta, Abhilasha Ravichander, Muhammad Bilal Zafar, Soumi Das
arXiv Computation and Language
Sep 17

"If I Had to Buy Just ONE: Galaxy S26 Ultra": Auditing AI-Generated Product Recommendations

arXiv:2609.18729v1 Announce Type: cross Abstract: Consumers increasingly use AI chatbots for advice on what to buy. With companies like OpenAI and Google monetising their AI through advertising, this...

By Lucas G. Uberti-Bona Marin, Thales Bertaglia, Giovanni Astante, Bram Rijsbosch, Gijs van Dijck, Anik\'o Hann\'ak, Gerasimos Spanakis, Konrad Kollnig
arXiv AI
Oct 5

Measuring Google AI Overviews: Activation, Source Quality, Claim Fidelity, and Publisher Impact

The study measures Google AI Overviews (AIOs), noting they activate for 13.7% of queries overall and 64.7% of question-form queries, with lower rates for politically sensitive topics. AIOs cite more credible domains than typical search results, yet 30% of cited pages are not shown in the first-page results, indicating a distinct source selection process. Among 98,020 atomic claims, 11.0% lack support from cited pages, mainly due to omissions, and over half of cited pages contain display ads, reducing publisher revenue while Google’s ads remain.

By Haofei Xu, Umar Iqbal, Jacob M. Montgomery
arXiv AI
Oct 16

Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence

The paper investigates why large language models (LLMs) sometimes give outdated answers even when recent evidence is available through web search. By creating temporal facts that changed after the models’ training cutoffs, the authors evaluate a proprietary model with deployed search and six open-weight models with controlled retrieval. They find that models often rely on search snippets without opening source pages, leading to more outdated answers and unfaithful citations, and that even when retrieved evidence influences internal predictions, the final answer may still favor outdated information.

By Owen Walters, Lihu Chen, Francesca Toni
arXiv AI
Oct 28

The uneven rise of AI-generated web content

The study examines how generative AI has reshaped the public web in under five years, using over 5 million crawlable pages. It finds that AI-generated text has risen sharply but unevenly, with higher prevalence on English-language and .com sites, lower on .gov and .edu, and varying by a page’s centrality in the web graph. The authors employ multiple detection tools and a Bayesian hierarchical model to estimate prevalence while accounting for detector errors.

By Adam Visokay, Soumyakanti Pan, Molly Griston, Polina Iasakova, Mark Nepf, Denis Peskoff, Riya Sinha, Jikai Sun, Isabelle Thiara, Letao Wang, Yiwei Wu, Lauren Yan, Tyler H. McCormick
arXiv AI
Jun 2

Characterizing Web Search in The Age of Generative AI

arXiv:2510. 11560v2 Announce Type: replace-cross Abstract: The advent of LLMs has given rise to generative search, a new search paradigm in which LLMs retrieve information from the web related to a query and synthesize it into a single, coherent response.

By Elisabeth Kirsten, Jost Grosse Perdekamp, Qinyuan Wu, Mihir Upadhyay, Krishna P. Gummadi, Muhammad Bilal Zafar