arXiv Machine Learning

Deep R Programming

arXiv:2301. 01188v5 Announce Type: replace-cross Abstract: Deep R Programming is a comprehensive and in-depth introductory course on one of the most popular languages for data science.

arXiv Machine Learning
Jun 25

RN-D: Discretized Categorical Actors for On-Policy Reinforcement Learning

arXiv:2601. 23075v2 Announce Type: replace Abstract: On-policy Reinforcement Learning (RL) remains a dominant paradigm for continuous control, yet standard implementations rely on Gaussian actors and relatively shallow MLP policies, often leading to brittle optimization when gradients are noisy, and policy updates must be conservative.

By Yuexin Bian, Jie Feng, Tao Wang, Yijiang Li, Sicun Gao, Yuanyuan Shi
arXiv AI
2d ago

AutoOR: Scalably Post-training LLMs to Autoformalize Operations Research Problems

AutoOR is a scalable synthetic data generation and reinforcement learning pipeline that trains large language models to autoformalize operations research problems expressed in natural language across linear, mixed‑integer, and non‑linear categories. By generating verified training data from standard optimization forms and using solver execution feedback as a reward signal, AutoOR enables post‑training of an 8B model to achieve state‑of‑the‑art or competitive results on six established OR benchmarks, matching significantly larger frontier models. For non‑linear problems involving physical dynamics, a curriculum RL strategy bootstraps from limited initial data, making this class tractable for post‑training.

By Sumeet Ramesh Motwani, Chuan Du, Aleksander Petrov, Christopher Davis, Philip Torr, Antonio Papania-Davis, Weishi Yan
arXiv Machine Learning
Jun 9

ReTabSyn: Realistic Tabular Data Synthesis via Reinforcement Learning

arXiv:2603. 10823v2 Announce Type: replace-cross Abstract: Deep generative models can help with data scarcity and privacy by producing synthetic training data, but they struggle in low-data, imbalanced tabular settings to fully learn the complex data distribution.

By Xiaofeng Lin, Seungbae Kim, Zhuoya Li, Zachary DeSoto, Charles Fleming, Guang Cheng
arXiv Machine Learning
4d ago

ODTlearn: A Package for Learning Optimal Decision Trees for Prediction and Prescription

arXiv:2307. 15691v4 Announce Type: replace-cross Abstract: ODTlearn is an open source Python package that provides methods for learning optimal decision trees for high-stakes predictive and prescriptive tasks based on the state-of-the-art mixed-integer optimization (MIO) framework proposed in Aghaei et al.

By Patrick Vossler, Nathan Justin, Sina Aghaei, Nathanael Jo, Andr\'es G\'omez, Phebe Vayanos
arXiv AI
Jun 30

DiscoGen: Procedural Generation of Algorithm Discovery Tasks in Machine Learning

arXiv:2603. 17863v2 Announce Type: replace-cross Abstract: Automating the development of machine learning algorithms has the potential to unlock new breakthroughs.

By Alexander D. Goldie, Zilin Wang, Adrian Hayler, Deepak Nathani, Edan Toledo, Ken Thampiratwong, Aleksandra Kalisz, Michael Beukman, Hannah Erlebach, Alistair Letcher, Shashank Reddy, Clarisse Wibault, Theo Wolf, Charles O'Neill, Uljad Berdica, Nicholas Roberts, Saeed Rahmani, Roberta Raileanu, Shimon Whiteson, Jakob N. Foerster