arXiv Machine Learning

Black-Box Knowledge Transfer across Distinct Feature Sets

arXiv:2608. 12403v1 Announce Type: cross Abstract: Pre-trained black-box predictive functions encode knowledge distilled from massive datasets and extensive computation.

arXiv Machine Learning
Aug 11

Coupled Training with Privileged Information and Unlabeled Data

arXiv:2605. 23268v2 Announce Type: replace-cross Abstract: In many prediction problems, we have extra information during training (for example, measurements that are expensive or slow to collect) that will not be available when the model is deployed.

By Jiahao Shi, Omar Hagrass, Jason M. Klusowski
arXiv Statistics ML
6d ago

Econometrics with Pre-Trained Embeddings for Unstructured Data

The paper examines the use of pre‑trained deep‑learning embeddings as covariates in economic analyses of unstructured data. It identifies two main challenges: the mismatch between training data/tasks of pre‑trained models and the target economic task, and the identification problem of the embedding function. The authors propose sufficient conditions—particularly a transferability criterion—to guarantee convergence, introduce a bootstrap test to assess transferability without re‑estimating embeddings, and apply the framework to various double‑machine‑learning settings, including an empirical study of labor‑supply elasticity on Amazon Mechanical Turk using job‑description embeddings.

By Yuya Shimizu
arXiv Machine Learning
Sep 14

Guided Adversarial Robust Transfer Learning with Source Mixing

Guided Adversarial Robust Transfer (GART) learning is a new transfer learning method that relaxes the requirement for source data to closely resemble the target population. By optimizing an adversarial loss over a mixture of source distributions, GART achieves faster convergence and improved prediction performance when target data are scarce. Experiments on simulated data and on multi‑institutional biobank‑linked electronic health records for high‑density lipoprotein cholesterol demonstrate higher robustness and accuracy compared to existing transfer learning approaches.

By Xin Xiong, Zijian Guo, Tianxi Cai