Certifying Repeatable Entry-Replay Witnesses for COBOL-to-Java Migration
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
Migration of legacy COBOL programs to Java requires extensive testing to ensure correct functionality. This effort is often complicated by the lack of test data and the difficulty of validating all corner cases.
AgentTrustCI is a Java/JUnit 5 framework that turns application‑layer expectations—such as tool selection, grounding of answers, and adherence to workflows—into policy, grounding, and trajectory checks over recorded traces. It provides deterministic replay for repeatable build‑time tests and a judge interface for optional semantic evaluation. In tests across 55 synthetic cases from seven enterprise domains, the full pipeline correctly classified all injected faults and passing controls, while single‑layer configurations handled 35 cases, demonstrating the framework’s coverage and repeatability.
arXiv:2607. 02469v1 Announce Type: cross Abstract: Software tests and code evolve together: a code change should be followed by new or updated tests that record the new software behavior.
arXiv:2609.36635v1 Announce Type: cross Abstract: Bug validation asks a coding agent to produce an executable witness for a reported bug. The witness combines a concrete input with a testing harness...
arXiv:2604.22046v2 Announce Type: replace-cross Abstract: Large language models (LLMs) have recently shown strong potential for generating project-level unit tests. However, existing state-of-the-art...
The paper introduces SWE Refactor Bench, a benchmark of 20 whole‑repository migrations aimed at testing whether coding agents can autonomously perform long‑horizon stack migrations. It employs a three‑stage evaluation—Migration Audit, Behavioural Tests, and Agentic Verification—to assess both migration completeness and behavioural correctness, revealing that only 5.4 % of runs succeed across all stages. The study shows that agents struggle with migration tasks, especially language rewrites, and highlights the need for more robust coding‑agent capabilities.