Microsoft Research By Alex Lavaee, Matthai Philipose

Formally verifying agent-written full-stack web apps with PDD Kit

Read the original on Microsoft Research →

Microsoft Research introduces PDD Kit, a tool that formally verifies code generated by AI agents for full‑stack web applications. By translating developer intent into Verus specifications, PDD Kit proves that the AI‑written code satisfies these specifications for all inputs, supplementing proofs with tests when necessary. This approach allows developers to review high‑level intent rather than inspecting every line of code.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Microsoft Research.

Simon Willison
Aug 22

More than just code review

The article discusses the essential skill of effectively instructing coding agents and verifying their changes. It highlights that while line‑by‑line code review is one method, it is not the most efficient way to validate software changes. The focus is on confidently guiding agents and confirming correct implementation without exhaustive inspection.

arXiv AI
Jun 26

Autoformalization of Agent Instructions into Policy-as-Code

arXiv:2606. 26649v1 Announce Type: new Abstract: Agent safety in high-stakes domains requires formal policy enforcement, but most existing approaches either rely on probabilistic guardrails (fine-tuned classifiers, prompt-based steering) that offer no formal guarantees, or on hand-coded symbolic enforcement that does not scale to the breadth of real policy specifications.

By Adam Mondl, Matthew Maisel, John H. Brock
arXiv AI
Sep 17

A Study of the Reliability of Agentic AI-Generated Programs

The paper investigates the reliability of software produced by agentic AI by comparing AI-generated versions of ten well-known Linux utilities to their human-written counterparts. Using fuzz testing (both black-box and coverage-guided AFL++), the authors find that AI-generated code is often as reliable or more reliable than the latest human versions, with fewer memory errors but a higher incidence of hangs. The study emphasizes that robust AI-generated software requires careful prompting, skilled human oversight, and that the AI workflow can serve as a cost-effective specification for sustainable code.

By Ayesha Shafique, Barton P. MIller, Elisa R. Heymann