arXiv Machine Learning

Don't Retrain, Remix: Adaptation of Web Agents using Mixture Hypernetworks

The paper introduces WebMix, a mixture hypernetwork that enables web agents to adapt to unseen interfaces without retraining. WebMix uses a bank of pre‑trained low‑rank adapters and a scout agent that explores a new interface, summarizing observations into a manual. A lightweight router then predicts mixing coefficients to combine the adapters into a new one, achieving performance that matches or surpasses in‑context learning and LoRA baselines on domain and version transfer tasks.

arXiv Computer Vision
Oct 27

WebUniverse: Scaling Verified Training Data for Agentic Web Development

arXiv:2610.33149v1 Announce Type: cross Abstract: Training agents for front-end web development requires demonstrations of code editing, execution, browser inspection and revision, yet public traject...

By Yaorui Ding, Fengqing Jiang, Yichen Feng, Yuetai Li, Zhangchen Xu, Kaiyuan Zheng, Xuanyu Lu, Bhaskar Ramasubramanian, Basel Alomair, Luyao Niu, Radha Poovendran
arXiv Computation and Language
4d ago

HyperRepair: Recovering Forgotten General Capabilities of Fine-Tuned Language Models

HyperRepair is a framework that restores the general capabilities of fine‑tuned language models while keeping their domain specialization, using only inference time. It learns a hypernetwork from repairs on source models, which generates a Repairing Side Net (RSN) that selectively corrects the model based on activation fingerprints. Evaluated on two model families, 12 LoRA adaptation datasets, and 15 general benchmarks, HyperRepair retains 99.5% of fine‑tuned domain performance and 93.4% of the base model’s general performance.

By Junrong Tang, Jianghui Wang, Hao Kong, Yang Lin, Yibo Yang
arXiv AI
Sep 10

SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction

SCAFFOLD is a self‑improving framework for visual web agents that automatically induces parametric, executable skills from successful trajectories and organizes them into a recursively composed hierarchy. It compresses the skill library using a minimum‑description‑length criterion and behavioral equivalence checks, and periodically distills these skills back into model weights to internalize the abstractions. Experiments on WebArena, VisualWebArena, and Online‑Mind2Web show that SCAFFOLD raises success rates by 11.1–17.2 absolute points over the best skill‑augmented baseline and continues to improve across five self‑improvement iterations without collapsing the library.

By Bowei He, Xiaokun Zhang, Meng Ding, Xue Liu
arXiv AI
Sep 1

WebXSkill: Skill Learning for Autonomous Web Agents

arXiv:2604.13318v2 Announce Type: replace Abstract: Autonomous web agents powered by large language models (LLMs) remain brittle on long-horizon browser workflows. A key bottleneck is a grounding gap...

By Zhaoyang Wang, Qianhui Wu, Xuchao Zhang, Chaoyun Zhang, Wenlin Yao, Fazle Elahi Faisal, Baolin Peng, Si Qin, Suman Nath, Qingwei Lin, Chetan Bansal, Dongmei Zhang, Saravan Rajmohan, Jianfeng Gao, Huaxiu Yao
arXiv Machine Learning
Sep 14

Amortized Low-Rank Adaptation for Model-Based Reinforcement Learning

The paper introduces CLAW, a method that uses a hypernetwork to generate low‑rank adapters for world models during test time, enabling efficient adaptation to new environments with only a few episodes of interaction. By jointly pretraining the hypernetwork and base model on simulated adaptations, CLAW balances computational efficiency and expressivity, outperforming both in‑context learning and gradient‑based adaptation in locomotion and manipulation tasks. The approach also mitigates overfitting in data‑scarce regimes and demonstrates that the benefit stems from expressive adapters rather than context conditioning.

By Fernando Palafox, David Fridovich-Keil
arXiv AI
6d ago

WebAnything: From the Wild Web to Scalable Agent Environments

WebAnything is a fully automated framework that reconstructs source‑grounded, reusable web environments from real URLs without per‑site manual engineering. It uses an Explorer‑Builder to collect browser‑observable structures and an independent verifier to ensure fidelity, producing 244 website artifacts across 14 domains and 53 categories with 12,984 executed tasks. Compared to human‑assisted WebHarbor, WebAnything scores higher on three fidelity metrics and, when fine‑tuned with Qwen3.5‑9B, improves success rates across multiple benchmarks.

By Tianci Xie, Zikun Cai, Chaoyun Zhang, Pinxue Guo, Bingxuan Li, Rui Zheng, Hang Yan