arXiv AI

Disentangled Skill Representations for Predictive Human Modeling

The paper introduces Skill Abstraction with Interpretable Latents (SAIL), a method that models human skill as a persistent, multi‑dimensional construct inferred from naturalistic behavior over time. SAIL produces a robust skill embedding that blends expert and novice bases, learns transferable subskills through counterfactual subskill swaps, and supports skill‑informed behavior prediction across various in‑domain contexts. Experiments on racing and baseball demonstrate that SAIL achieves strong predictive performance, improves behaviorally grounded disentanglement compared to baselines, and enhances downstream AI coaching outcomes.

arXiv AI
Jun 16

LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structure

arXiv:2606. 15306v1 Announce Type: cross Abstract: We envision continually learning agentic systems that become more useful over time: as they encounter sequences of related tasks, they should infer the hidden structure shared across those tasks and use it to improve future decisions.

By Daksh Mittal, Tommaso Castellani, Thomson Yen, Naimeng Ye, Fangyu Wu, Minghui Chen, Tiffany Cai, Emmanouil Koukoumidis, William Zeng, Hongseok Namkoong
Hugging Face Trending Papers
Jun 3

RePercENT: Scaling Disentangled Representation Learning Beyond Two Modalities

To leverage the full potential of multimodal data, we need representations that go beyond the state-of-the-art alignment and fusion approaches and exploit all cross-modal interactions without sacrificing modality-specific information. Learning disentangled representations is a principled way to identify these underlying shared and unique factors that are hidden in observational data.