The paper "Intelligence Under Time Constraints: Rethinking Test-Time Compute" examines how to decide not only how much computation to perform but also when to start it in streaming interactions where evidence arrives incrementally and may change. It introduces the information‑slack dilemma, describing the trade‑off between early computation that has more time to finish but relies on incomplete evidence, and waiting for more information that reduces computational slack. The authors propose a research agenda focused on selective recovery under controlled evidence revisions, and suggest evaluation metrics that separate early‑execution effects, deployment value versus full‑input alternatives, and the added value of predictive policies while accounting for shared‑resource costs, aiming for trustworthy, on‑time responses within a declared resource envelope.
By Xiaotian Zhang (Trooly.AI)
arXiv:2606. 04402v1 Announce Type: new Abstract: Modern reasoning models can allocate different amounts of test-time computation, such as thinking tokens, model calls, or compute budget, to different tasks.
By Jingbo Wen, Liang He, Ziqi He
arXiv:2609.16302v1 Announce Type: cross
Abstract: When a coding agent returns to existing software, it inherits evidence from earlier engineering work: tests, type checks, proofs, static analyses, an...
By Anjan Goswami
arXiv:2608. 04001v1 Announce Type: cross Abstract: Large language models can solve substantially harder reasoning problems with more inference-time compute.
By Mohsen Hariri, Weicong Chen, Nahal Shahini, Vikash Singh, Kai Ye, Amirhossein Samandar, Debargha Ganguly, Sreehari Sankar, Yanyan Zhang, Shouren Wang, Jerry Peng, Biyao Zhang, Michael Hinczewski, Vipin Chaudhary
arXiv:2607. 13034v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly automate multi-step engineering and informatics workflows, yet they rarely ask how much effort a task actually requires.
By Junjie Yin, Xinyu Feng
arXiv:2609.17943v1 Announce Type: new
Abstract: Long-context LLM inference is bottlenecked by attention, whose repeated KV-cache reads make decoding memory-bound. Self-speculative decoding alleviates...
By Amir Ziashahabi, Hossein Entezari Zarch, Lei Gao, Murali Annavaram, Salman Avestimehr