arXiv Machine Learning

Transfer Learning in High-dimensional Ising Models

arXiv:2607. 03005v1 Announce Type: new Abstract: In high-dimensional Ising model estimation, target sample sizes are often limited, and effectively using auxiliary binary datasets of unknown relevance remains challenging.

arXiv Machine Learning
Sep 22

Transfer Learning for Matrix Completion

arXiv:2507.02248v2 Announce Type: replace-cross Abstract: In this paper, we explore the knowledge transfer under the setting of matrix completion, which aims to enhance the estimation of a low-rank t...

By Dali Liu, Yuying Xie, Haolei Weng
arXiv AI
Sep 17

Limits of Transfer Learning

The paper investigates the theoretical limits of transfer learning, demonstrating that careful selection of transferable information and its dependence on target problems is crucial. It establishes that the degree of probabilistic change in a transfer-learning algorithm imposes an upper bound on achievable improvement. These findings extend the algorithmic search framework to a broad class of learning tasks involving transfer.

By Jake Williams, Abel Tadesse, Tyler Sam, Huey Sun, George D. Montanez
arXiv Machine Learning
Jun 18

BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training

arXiv:2606. 18650v1 Announce Type: new Abstract: As Large Language Model (LLM) datasets scale to trillions of tokens, data selection has emerged as a critical frontier to filter out uninformative noise and construct adaptive learning trajectories.

By Jiaxing Wang, Deping Xiang, Jin Xu, Zirui Liu, Zicheng Zhang, Guoqiang Gong, Jun Fang, Chao Liu, Pengzhang Liu, Tongxuan Liu, Ke Zhang, Qixia Jiang
arXiv Machine Learning
Jun 9

Transfer learning for causal forest

arXiv:2606. 07693v1 Announce Type: cross Abstract: Transfer learning addresses the challenge of transfering knowledge from one domain to another.

By B\'er\'enice-Alexia Jocteur (ICJ, PSPM), V\'eronique Maume-Deschamps (ICJ, PSPM), Pierre Ribereau (PSPM, ICJ)
arXiv Machine Learning
Aug 4

Transfer Learning of CATE with Kernel Ridge Regression

arXiv:2502. 11331v4 Announce Type: replace-cross Abstract: The proliferation of data has sparked significant interest in leveraging findings from one study to estimate treatment effects in a different target population without direct outcome observations.

By Seok-Jin Kim, Hongjie Liu, Molei Liu, Kaizheng Wang
arXiv Machine Learning
Jun 18

Bridging Data Gaps in Structural Fragility Modeling through Transfer Learning: Methodology and Case Studies

arXiv:2606. 18567v1 Announce Type: cross Abstract: This paper presents a methodology-centered transfer learning framework for fragility adaptation under domain shift, class imbalance, and scarce target labels while preserving engineering interpretability and supporting decision-making under uncertainty.

By Narges Saeednejad, Jamie Ellen Padgett
arXiv Machine Learning
Sep 10

Low-Rank Plus Sparse Matrix Transfer Learning under Growing Representations and Ambient Dimensions

The paper introduces a transfer learning framework for structured matrix estimation when both the ambient dimension and the intrinsic representation grow over time. It models the target parameter as an embedded source component plus low‑rank innovations and sparse edits, and proposes an anchored alternating projection estimator that preserves the transferred subspace while estimating only the new components. Deterministic error bounds are derived that separate target noise, representation growth, and source estimation error, showing improved rates when rank and sparsity increments are small, and the framework is applied to Markov transition matrix estimation and structured covariance estimation with theoretical guarantees and empirical validation.

By Jinhang Chai, Xuyuan Liu, Elynn Chen, Yujun Yan