arXiv AI

Sophistication in GenAI Use: Field Evidence from a Large Firm

The study examines how back‑office employees at a large firm use generative AI (genAI) and finds that senior staff use it more sophisticatedly, likely because of their domain expertise. Sophistication differs across functions, peaking in Strategy, Digital Innovation, and Project Management—areas focused on firm‑wide strategic initiatives. The research also shows that sophistication does not improve over time or as a result of formal AI training, indicating that advanced use is hard to change.

arXiv AI
Aug 3

Unanticipated Effects of Generative AI on Expertise Pathways and Performance Perception in System Administration

arXiv:2607. 28650v1 Announce Type: cross Abstract: While industry discourse often emphasizes immediate productivity gains and frames GenAI primarily as a tool for automation, the integration of GenAI into system administration may involve deeper shifts in professional practice that are not yet fully understood.

By Rana Abou Khamis, Hala Assal, Ashraf Matrawy
arXiv AI
Aug 13

How Organizations Use AI: Evidence from ChatGPT

arXiv:2608. 12236v1 Announce Type: cross Abstract: We study how organizations use frontier generative AI by linking ChatGPT Enterprise account records to usage, worker roles, task classifications, and public-company financial data through March 2026.

By Aaron Chatterji, David Holtz, Neel Rakholia, Prasanna Tambe, Gawesha Weeratunga
arXiv AI
Sep 1

The Landscape of Generative AI in Information Systems: A Synthesis of Secondary Reviews and Research Agendas

The paper reviews secondary studies and research agendas on generative AI (GenAI) in information systems, synthesizing evidence from 28 selected papers. It identifies GenAI’s transformative benefits—productivity, innovation, personalization, and democratized expertise—while highlighting challenges such as technical unreliability, ethical risks, and governance gaps. The authors propose a research agenda that shifts IS scholarship toward shaping the co‑evolution of AI capabilities with organizational routines, societal values, and regulatory institutions, emphasizing hybrid human‑AI ensembles, situated validation, design principles for probabilistic systems, and adaptive governance.

By Aleksander Jarz\k{e}bowicz, Adam Przyby{\l}ek, Jacinto Estima, Yen Ying Ng, Jakub Swacha, Beata Zielosko, Lech Madeyski, Noel Carroll, Kai-Kristian Kemell, Bartosz Marcinkowski, Alberto Rodrigues da Silva, Viktoria Stray, Netta Iivari, Anh Nguyen-Duc, Jorge Melegati, Boris Deliba\v{s}i\'c, Emilio Insfran
arXiv AI
Sep 18

What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks

The paper "What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks" analyzes 14,767 arXiv submissions from 2022 to 2026 that introduce or update evaluation resources for large language models. It systematically maps changes in target systems, domains, evaluation materials, conditions, and scoring mechanisms, revealing a growing emphasis on action, interaction, and professional applications. The study also notes uneven development in model participation, with LLM-based scoring increasing in both agent and non-agent groups, while model-generated materials do not show a comparable rise.

By Chao Wang (Independent Researcher)