arXiv AI

Responsible Institutional Analytics: Interpreting Bias with AI Support

arXiv AI
Jul 15

A Comparative Analysis of Institutional and Course Generative AI Policies within Higher Education: Implications for Instruction in Computing Education

arXiv:2607. 12296v1 Announce Type: cross Abstract: With the increased use of generative AI (GenAI) applications such as ChatGPT, higher education institutions (HEIs) have released a range of guidelines and policies to direct adoption within their institutions.

By Amrita Ganguly, Aditya Johri, Nora McDonald, Areej Ali, Umama Dewan, Aayushi Hingle Collier
arXiv AI
Sep 28

Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews

The study examines how practitioners in AI-driven systems define, assess, and manage data quality, revealing six key themes. It highlights shifts in traceability, the use of models as quality assessors, and the emergence of new data objects such as agent context and synthetic data. The research proposes a lifecycle assurance framework to provide evidence that data supports specific AI claims throughout model behavior, judgments, and agent actions.

By Hariharan Gopinath, Jan Bosch, Helena Holmstr\"om Olsson
arXiv AI
Sep 12

How AI Coders Discuss, Disagree, and Reach Consensus: Challenges and Opportunities for LLM-Based Qualitative Coding

The paper investigates how large language models (LLMs) can perform multi-coder qualitative coding by independently coding, debating, and reconciling disagreements. It quantifies the effectiveness of this approach across diverse datasets, identifying key factors—such as codebook length, data similarity, and agent disagreement—that influence coding accuracy. The study finds that intense, unresolved debates improve accuracy but that LLMs still lack adaptive responsiveness to context, leading to design recommendations for automated coding systems.

By Jeongyeon Kim, John Mitchell
arXiv AI
Aug 3

Unanticipated Effects of Generative AI on Expertise Pathways and Performance Perception in System Administration

arXiv:2607. 28650v1 Announce Type: cross Abstract: While industry discourse often emphasizes immediate productivity gains and frames GenAI primarily as a tool for automation, the integration of GenAI into system administration may involve deeper shifts in professional practice that are not yet fully understood.

By Rana Abou Khamis, Hala Assal, Ashraf Matrawy