arXiv AI

FixItFlow: Automated Troubleshooting Guide Generation from Cloud Incidents

arXiv:2607. 13035v1 Announce Type: cross Abstract: Cloud services experience frequent incidents that require rapid diagnosis and resolution.

arXiv AI
Aug 25

Procedural Knowledge Extraction from Industrial Troubleshooting Guides Using Vision Language Models

The paper examines how Vision Language Models (VLMs) can automatically extract structured procedural knowledge from industrial troubleshooting guides, which are typically flowchart-like diagrams combining spatial layout and technical language. It evaluates two VLMs using two prompting strategies—standard instruction-guided and an augmented approach that highlights layout patterns—and finds that each model shows different trade-offs between sensitivity to layout and robustness to semantic content. These insights help determine which VLM and prompting method is most suitable for integrating such guides into operator support systems.

By Guillermo Gil de Avalle, Laura Maruster, Christos Emmanouilidis
arXiv AI
Jul 1

FLARE-AI: Flaw Reporting for AI

arXiv:2606. 31567v1 Announce Type: cross Abstract: Flaw reporting for deployed AI systems is fundamental to identifying system failures and improving AI safety.

By Shayne Longpre, Elaine Zhu, Carson Ezell, Avijit Ghosh, Sean McGregor, Kevin Paeth, Kevin Klyman, Sayash Kapoor, Rishi Bommasani, Ruth Appel, Gregory Strom, Lauren McIlvenny, Mark M. Jaycox, Peter Slattery, Nathan Butters, Arvind Narayanan, Percy Liang, Alex Pentland
arXiv AI
Sep 17

SAGE: Governed Artifact Generation from Enterprise Guidelines

SAGE is a governed multi‑stage LLM pipeline that transforms enterprise guideline documents—containing narrative text, tables, and images—into structured artifacts. It uses a shared versioned rule store, schema‑validated contracts, and provenance tracking to validate, score, and reconcile extracted rules, automatically approving high‑confidence outputs while flagging uncertain items for human review. In a test on 120 documents, SAGE reduced processing time from days to 20–100 minutes and achieved a 96% success rate with only 3.2% hallucination.

By Mohammadreza Sediqin, Shivali Dalmia, Sumukha Thoppanahalli, Srinivasa Karthikeya Reddy Kovvuri, Abhishek Mukherji
arXiv AI
Sep 1

Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study

The paper presents a systematic analysis of five state‑of‑the‑art automated program repair agents, tracing their decision‑making across 500 real‑world repair tasks. It finds that while the agents perform well on simple fixes, they struggle with logic‑intensive bugs, often producing verbose, overfitted patches that pass tests without addressing root causes. Key bottlenecks identified include poor test generation, limited regression test selection, and reliance on primitive tooling without access to debuggers or advanced program analysis tools.

By Ira Ceka, Hailie Mitchell, Saurabh Pujar, Luca Buratti, Shyam Ramji, Junfeng Yang, Gail Kaiser, Baishakhi Ray