arXiv Machine Learning

Speculate with Memory: Lossless Acceleration for LLM Agents

arXiv:2607. 12236v1 Announce Type: new Abstract: Speculative execution accelerates LLM agents by using a smaller, cheaper model to predict and pre-launch the next step while the environment is idle.