arXiv AI By Yeui-Lung Lei, Wen-Bo Chen, Pan Zhang

MarkovSim: an LLM Agent Harness with Bounded Context for Long-Horizon Computational Simulation

Read the original on arXiv AI →

MarkovSim is an LLM agent harness designed for long‑horizon computational simulation workflows, featuring a built‑in context management scheme that keeps the agent’s context bounded. The system records workflow steps in a memory system with a predefined schema and, at finite‑state machine state transitions, constructs a compact representation of solution progress to use as context. Evaluated on finite element analysis benchmarks, MarkovSim successfully completed 16 of 18 runs, self‑correcting faults in solver operations and model physics while requiring engineer input only for judgment calls.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 30

Context Language Models

The paper introduces Context Language Models (CLMs), which treat context as a mutable file that the model can update freely, enabling the model to learn what information to retain. CLMs built zero‑shot from existing models outperform state‑of‑the‑art context‑management methods on several benchmarks, achieving higher accuracy with fewer FLOPs. The authors also demonstrate that CLMs can be steered via natural‑language instructions and online reinforcement learning, and they propose a suffix‑cache reuse strategy that further reduces server‑side compute.

By Rulin Shao, Shannon Zejiang Shen, Junjie Oscar Yin, Yuetai Li, Minheng Wang, Hamish Ivison, Radha Poovendran, Nathan Lambert, Teng Xiao, Mike Lewis, Wen-tau Yih, Luke Zettlemoyer, Pang Wei Koh