arXiv Computer Vision

Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements

Measured Sliders introduces a framework that defines continuous image controls via closed‑form differentiable measurements, enabling a unified measurement space for training and calibration. An observability test pre‑identifies usable supervision, while a measurement‑guided objective learns target movements and suppresses unwanted changes. The resulting controls, tested on SDXL and FLUX.1‑dev, are ordered, selective, and composable, achieving high monotonicity and selectivity across multiple attributes.

Hugging Face Trending Papers
Sep 4

Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements

Measured Sliders introduces a framework that defines continuous image controls via closed‑form differentiable image measurements, enabling predictable and comparable slider behavior. An observability test pre‑filters usable supervision, while a measurement‑guided objective learns target movements and suppresses unwanted changes during training. After training, decoded calibration expresses controls in consistent units, and multiple LoRA branches can be composed without joint training, achieving high selectivity and composability across SDXL and FLUX.1‑dev models.

arXiv Machine Learning
Oct 23

Bridging the Data Gap: Source-Informed Task-Space Transport for Few-Shot Diffusion

The paper introduces Meta‑Diff, a method that learns a reusable source‑to‑target relation in a compact task space, enabling rapid adaptation of a diffusion model to new targets with minimal or no target data. By encoding each distribution into a low‑dimensional coordinate and transporting a source coordinate to its predicted target, the approach avoids costly fine‑tuning and achieves significant performance gains on CIFAR‑100 and Office‑Home benchmarks. Experiments show that when task identity is preserved, the relation generalizes across tasks, and the source‑target shift is manageable, Meta‑Diff can outperform target‑only modeling and full fine‑tuning. whyItMatters:"The method offers a practical solution for few‑shot adaptation in data‑scarce settings, such as healthcare, by reducing computational cost and improving reliability compared to traditional retraining approaches."

By Jinjian Jiang, Jing Peng, Rehan Deen, Yu Cao, Ziquan Liu, Muhammad Salman Haleem, David Mguni
arXiv AI
Sep 15

Freeze, Share, Shrink: Rethinking the Action Backbone in Diffusion Policies

The paper argues that diffusion-based action policies can use a frozen, observation‑free backbone as a reusable trajectory prior, with task adaptation handled entirely by the conditioning pathway. By pretraining a general action head on forward‑kinematics data and then freezing it, the authors show that a single backbone can match or outperform normally trained models on MimicGen and LIBERO. Their experiments reveal that a small 5 M‑parameter MLP backbone can rival large U‑Net and transformer backbones, indicating that action backbones are often over‑parameterized and that image‑style architectures may not be the best fit for low‑dimensional action generation.

By Jian Zhou, Sihao Lin, Shuai Fu, Zerui Li, Gengze Zhou, Qi WU
arXiv Computer Vision
Aug 26

On-Policy Self-Distillation in Diffusion Models

The paper introduces DiffusionOPSD, an on‑policy self‑distillation framework that transforms image‑level reinforcement learning rewards into explicit targets for intermediate denoising predictions in diffusion models. By generating trajectories with a frozen behavior policy and constructing bounded positive and negative targets around query states, the method trains a policy to fit these targets before updating the behavior policy via an exponential moving average. Experiments on SD 3.5‑M and Z‑Image‑Turbo show that DiffusionOPSD achieves the best held‑out scores in 19 of 20 reward‑matched settings, outperforms the strongest competitor by up to 44 % and cuts GPU‑hour usage by 40–63 % compared to DiffusionNFT.

By Wei Zhou, Xiongwei Zhu, Lingdong Kong, Bo Chen, Lei Zhang, Yongyuan Liang, Xiaoxia Hou, Ye Tian, Xian Sun, Yingshuo Wang, Linfeng Li, Shengqiong Wu, Leigang Qu, Feng Li, Wei Liu, Julian McAuley, Tat-Seng Chua
arXiv Computer Vision
Oct 27

GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation

arXiv:2609.05588v3 Announce Type: replace-cross Abstract: World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled inte...

By Renhang Liu, Wenzhi Zhao, Zhuo Yang, Liliang Chen, Pengfei Zhou, Shengcong Chen, Guanghui Ren, Youlun Peng, Rongjun Jin, Nan Wang, Sukai Wang, Xindong He, Jinyuan Feng, Ziyu Xiong, Linqing Zhong, Yifei Wei, Feng Han, Long Zhang, Da Huang, Nanshu Zhao, Chenghao Yin, Mo Wu, Zhaodong Yan, Kongtao Hu, Yuxiang Yan, Aogelijiang Niyazi, Yu Fang, Jia Zeng, Lizhu Meng, Daizhen Lv, Haoyu Cao, Zhiwen Hou, Lianjin Ye, Yuehan Niu, Zhikai Cai, Xuan Hu, Hui Min, Xiongfeng Cai, Yue Liao, Jing Wu, Soujanya Poria, Ye Li, Sanping Zhou, Maoqing Yao, AgiBot Research Team
arXiv Machine Learning
Sep 10

LM-X: Explainable Vision--Language--Action Modeling via Progress, Event, and Uncertainty Prediction

arXiv:2608.25757v4 Announce Type: replace-cross Abstract: Large-scale vision--language--action (VLA) policies have advanced generalist robot control, yet most remain stimulus-to-action black boxes: a...

By Jin Lou, Zhiyuan Jing, Xupeng Wang, Andong Chen, Xingdong Zhu, Yuexuan Li, Yuan Xu, Zhijie Zhu, Yingwei Ji, Wenpeng Nie, Renxing Feng, Liangliang Chen, Ying Chu, Jingyi Li, Jinyan Liu, Zhiqi Song, Jingxuan Zhu, Jidong Zhang, Yufei Liu, Boyang Xing, Lei Jiang, Yan Cui, Hongming Li, Yuchen Zhu
arXiv AI
Jun 15

Learning What to Predict: Downstream-Guided Task Design for Continued Pretraining

arXiv:2601. 22108v2 Announce Type: replace-cross Abstract: Continued pretraining is optimized with fixed self-supervised tasks but selected by downstream performance, creating a coarse feedback loop in which practitioners evaluate checkpoints, change data mixtures or objectives, and restart runs, while individual updates remain blind to target capabilities.

By Shuqi Ke, Giulia Fanti