arXiv AI

Designing an Auditable LLM-Supported Workflow for Qualitative Thematic Analysis

arXiv AI
3d ago

Agent-as-Peer-Debriefer: A Multi-Agent Framework with Perspective-Based Refinement for Qualitative Analysis

The paper introduces Agent-as-Peer-Debriefing, a multi‑agent framework that incorporates peer debriefing into qualitative data analysis with large language models. A Hierarchical Coding Agent generates codes and reflections, which are then refined by three Peer‑Debriefing Agents applying Theory‑Driven, Data‑Driven, or Applied perspectives. Experiments on three datasets show that perspective‑based refinement aligns more closely with human codes than a single‑LLM baseline, and that the choice of perspective offers meaningful trade‑offs.

By Zhimin Lin, Kun Cheng, Zhiyao Shu, Junhua Fang, Juntao Li, Fan Bai, Jie Gao
arXiv AI
Jul 3

AIriskEval-edu: New Dataset for Risk Assessment in AI-mediated K-12 Educational Explanations

arXiv:2607. 01934v1 Announce Type: cross Abstract: This work introduces AIriskEval-edu-db2, a new dataset designed to train and evaluate auditors based on LLMs for an explainable pedagogical risk assessment in instructional content for grades K-12.

By Javier Irigoyen, Roberto Daza, Francisco Jurado, Julian Fierrez, Ruben Tolosana, Alvaro Ortigosa, Enrique Blas, Aythami Morales
arXiv AI
Aug 12

Workflow Cards: Structured Summaries of Workflow Executions Using Provenance Data

arXiv:2608. 11022v1 Announce Type: cross Abstract: Model Cards and Data Cards have demonstrated the value of structured, human-readable documentation for machine learning artifacts, capturing their context, parameters, limitations, and intended use.

By Nicola Giuseppe Marchioro, Gabriele Padovani, Amal Gueroudji, Rafael Ferreira da Silva, Wesley Brewer, Valentine Anantharaj, Sandro Fiore, Renan Souza