arXiv Machine Learning July 30, 2026 By Ezinne Nwankwo, Lauri Goldkind, Angela Zhou

Optimal Causal Annotations: An Application to Casenotes in Social Services

Read the original on arXiv Machine Learning →

arXiv:2502. 10605v4 Announce Type: replace-cross Abstract: Problem definition: Estimating causal effects of interventions is central to policy and operations, but outcome data are often missing or costly to obtain.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Sep 23

Optimal Sequential Annotations for Off-Policy Evaluation

The paper proposes a method for allocating a limited budget of expert annotations to optimize the accuracy of off-policy evaluation in settings where rewards are missing or noisy. By deriving variance‑optimal annotation probabilities for sequential, forward‑monotone protocols, the authors provide a batch‑adaptive implementation that can be applied to real data. Experiments on casenotes from a homelessness services nonprofit and on human‑preference votes from LMArena demonstrate substantial reductions in RMSE—up to 65% for housing placement and 68% for progress toward a housing application—when using only 40% or more of the full annotation budget.

By Woojin Chae, Ezinne Nwankwo, Haitong Qin, Angela Zhou

llms reinforcement-learning safety

Hugging Face Trending Papers

Sep 22

Optimal Sequential Annotations for Off-Policy Evaluation

Offline reinforcement learning and off-policy evaluation evaluates dynamic treatment rules based on retrospectively collected data prior to deployment. In recent AI applications, state and reward info...

llms reinforcement-learning safety

arXiv AI

Jul 23

Generative Augmented Inference of LLM-generated Data for Market Research: Theory and Empirical Evidence

arXiv:2604. 14575v3 Announce Type: replace-cross Abstract: Marketing research often relies on parameters estimated from costly human-generated data, such as conjoint survey responses, purchase decisions, and field experiment outcomes.

By Cheng Lu, Mengxin Wang, Dennis J. Zhang, Heng Zhang

llms benchmarks

arXiv AI

Jul 21

"Not in My Backyard": LLMs Uncover Online and Offline Social Biases Against Homelessness

arXiv:2508. 13187v4 Announce Type: replace-cross Abstract: Homelessness is a persistent social challenge, impacting millions worldwide.

By Jonathan A. Karr Jr., Benjamin F. Herbst, Matthew L. Sisk, Xueyun Li, Ting Hua, Matthew Hauenstein, Georgina Curto, Nitesh V. Chawla

llms benchmarks safety

arXiv AI

Jun 17

Statistical Foundations of LLM-based A/B Testing: A Surrogacy Framework for Human Causal Inference

arXiv:2606. 17165v1 Announce Type: cross Abstract: Organizations and researchers show increasing interest in using large language models (LLMs) in place of human participants in A/B tests, in the hope of experimenting faster and at lower cost.

By Joel Persson, M{\aa}rten Schultzberg, Sebastian Ankargren

llms safety

arXiv Machine Learning

Sep 10

Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes

arXiv:2609.06294v1 Announce Type: new Abstract: Estimating conditional average treatment effects (CATE) enables efficient targeting of interventions, but many applications have limited experimental s...

By Maitreyi Swaroop, Shikha Bhat, Samantha Rodriguez, Tamar Krishnamurti, Bryan Wilder

safety

One email a morning, machine-written

Related stories

Optimal Sequential Annotations for Off-Policy Evaluation

Optimal Sequential Annotations for Off-Policy Evaluation

Generative Augmented Inference of LLM-generated Data for Market Research: Theory and Empirical Evidence

"Not in My Backyard": LLMs Uncover Online and Offline Social Biases Against Homelessness

Statistical Foundations of LLM-based A/B Testing: A Surrogacy Framework for Human Causal Inference

Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes