arXiv Machine Learning By Jiaxun Li, Vinod Raman, Ambuj Tewari

No-Regret Language Generation

Read the original on arXiv Machine Learning →

The paper introduces the concept of no‑regret language generation, requiring a generator to make a sublinear number of mistakes across all demonstration sequences and compatible target languages. It presents both a realizable and an agnostic variant, using tree‑based mistake‑forcing dimensions to characterize finite‑horizon minimax complexity and establish necessary and sufficient conditions for no‑regret generation. The authors also connect generation complexity to online prediction, providing optimal mistake bounds for language classes with finite Littlestone dimension.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jun 25

Space-Efficient Language Generation in the Limit

arXiv:2606. 25777v1 Announce Type: cross Abstract: We initiate a resource-aware theory of \textit{language generation in the limit} under the minimal constraint of space efficiency.

By Nicolas Flammarion, Chirag Pabbaraju, Hristo Papazov, Miltiadis Stouras, Ola Svensson
arXiv Machine Learning
Oct 7

On the Computational Tractability of Robust Bandits

The paper studies robust bandits, a framework for learning when the true environment lies outside the learner’s hypothesis class. It presents a polynomial‑time algorithm achieving ≠O(√T) regret for a specific tractable case, while showing that slight extensions of this case are NP‑hard. The work highlights the computational limits of robust bandits and suggests their relevance to AI alignment.

By Vanessa Kosoy, Vinayak Pathak