arXiv AI

For Coding Agents, the Repository Matters

Hugging Face Trending Papers
Jun 23

Detecting AI Coding Agents in Open Source: A Validated Multi-Method Census of 180 Million Repositories

Generative AI coding agents are entering the open-source supply chain, yet their diverse and often invisible traces leave their prevalence poorly understood. We introduce a multi-layered detection framework that integrates configuration-file scanning, commit-message analysis, author-identity matching, and bot-signature lookup across World of Code (180M+ Git repositories), classifying agent traces into four behavioral types.

arXiv AI
Oct 12

Co-Modifying Application Code and Deployment Infrastructure: A Causal Study of AI Agent Pull Requests

The study evaluates 26,999 pull requests that modify both application code and deployment infrastructure, using two large datasets and six AI agent architectures. It finds that such dual‑scope changes occur in only about 4.5% of agent‑generated PRs but lead to two distinct integration outcomes: either significant delays due to CI/CD and provisioning checks, or a high rate of silent merges with reduced human review. The results highlight that current AI agents lack deployment awareness, causing unverified dependencies to slip into production pipelines.

By Mohammad Wathiq Soualhi, Basem Suleiman
Hugging Face Trending Papers
Jul 15

Early Adoption of Agentic Coding Tools by GitHub Projects

Agentic coding tools are increasingly capable of generating and submitting pull requests (PRs) to software projects, introducing new forms of human-agent collaboration in software development. While prior studies have examined PR-level outcomes of agent-generated contributions, less is known about how agentic coding tools are adopted and managed at the project level.

arXiv Computation and Language
Oct 22

VeeReview: Measuring Build-Verify Pairs in Agent-Authored Pull Requests from a V-Model Perspective

The paper introduces VeeReview, a tool that classifies build‑and‑verify pairs in pull requests using repository signals and a language‑model judge. Evaluated on 1,454 agent‑ and human‑authored pull requests, VeeReview found lower build‑only rates for agent‑authored changes but failed to meet calibration and agreement thresholds. The study concludes that a mechanically decided component and validated human reference are essential for reliable verification‑practice comparisons.

By Gabriel Dautovi, Jie JW Wu