arXiv AI

From Hype to ROI: An Economic Model for LLM Adoption in Information Systems and Security Operations

arXiv AI
Oct 15

From Chasing Ghosts to Missed Attacks: Perspectives and Perceptions of SOC Practitioners on LLM Integration, Risks, and Readiness

The paper investigates how Security Operations Center (SOC) analysts perceive the integration of Large Language Models (LLMs) into their workflows. Through 25 interviews and interactive scenarios, the authors identify 15 LLM use cases across six functional categories, noting that while LLMs are useful for automating repetitive tasks, they are not yet suitable for high‑impact incident analysis due to limitations in technical depth, context awareness, and organization‑specific knowledge. Despite these concerns, practitioners show a strong willingness to adopt LLMs, driven by competitive pressure and a desire for operational efficiency.

By Jonas Thurner, Nadine Jost, Stefan Albert Horstmann, Fabian Ising, Lea Groeber, Alena Naiakshina, Sebastian Schinzel
arXiv AI
Jun 17

Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Reddit

arXiv:2604. 09998v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have recently emerged as promising tools for augmenting Security Operations Center (SOC) workflows, with vendors increasingly marketing autonomous AI solutions for SOCs.

By Souradip Nath, Chih-Yi Huang, Aditi Ganapathi, Kashyap Thimmaraju, Jaron Mink, Gail-Joon Ahn
arXiv AI
1d ago

Create Your Own Work Stack: Deploying Self-hosted AI and Tooling in a Tech Startup

The paper reports on Grayhat Developers’ experience deploying a hybrid AI stack that combines local open‑source models with commercial agents. After finding local models too slow for complex coding tasks, the team kept commercial agents for those tasks while using local models for lower‑complexity work, documentation sync, and tool coordination, reducing commercial AI usage by 27–36%. The initial self‑hosted deployment suffered from UX friction, but a centrally configured deployment improved adoption.

By Saad Ahmed Bazaz, Talha Amjad, Abdurrehman Subhani, Sohaib Ahmed Bazaz, Abdullah Aamir
arXiv AI
Sep 7

Beyond Code Generation: Reliability, Verification, and Cost Economics in the Agentic Software Development Lifecycle

The paper examines how AI coding agents are evolving beyond simple autocomplete to perform complex tasks such as repository inspection, multi-file editing, tool execution, test writing, pull request creation, and long-duration work with minimal supervision. It highlights that while these agents boost coding activity, significant bottlenecks remain in review, integration, testing, security, deployment, and production operations, and that the economics of software development are shifting toward variable token, tool, sandbox, CI, and rework costs. The authors synthesize recent research and industry data to propose four engineering concepts—Agentic SDLC Throughput Paradox, Production-Qualified Change, Verification Tax, and an Agentic SDLC Control Plane—to guide the allocation of autonomy within cost, reliability, and human-attention constraints, ultimately reframing the research focus to production-qualified value per dollar, reviewer-hour, and operational risk.

By Happy Bhati
arXiv AI
Jun 2

Business Utility of Large Language Models as Exploratory Data Analysis Agents

arXiv:2606. 00051v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly used in analytical workflows, but their suitability as exploratory data analysis (EDA) agents in business settings remains uncertain.

By Rafa{\l} {\L}ab\k{e}dzki, Patryk Miziu{\l}a, Hubert Rutkowski, Szymon Betlewski, Cezary Depta, Szymon Janowski, Jaros{\l}aw Kochanowicz, Jan Kanty Milczek
arXiv AI
Jun 9

Closing the Sim-to-Real Gap: An Evaluation Framework for Autonomous Cyber Defense Configuration of Commercial EDR

arXiv:2606. 08168v1 Announce Type: cross Abstract: Leading commercial endpoint detection and response (EDR) products have shifted from operator-configured rule sets to multi-component systems where autonomous AI components operate alongside, and increasingly in place of, operator-deployed policies.

By Kerri Prinos, Lilianne Brush
arXiv AI
Aug 5

A Security-Oriented Lifecycle Model for Large Language Model Systems

arXiv:2608. 03626v1 Announce Type: cross Abstract: Large language models are being integrated into critical infrastructure and enterprise workflows at unprecedented scale,yet the lifecycle frameworks governing their development and operations were designed for operational efficiency rather than security analysis.

By Eleftherios Batzolis, George Drosatos, Vassilis Katsouros, Konstantinos Rantos