Work2Skill is a framework that captures human GUI experience to induce reusable agent skills. It introduces WorkRecorder, an infrastructure that aligns screen recordings, mouse and keyboard events, and accessibility-tree data, and uses it to build WorkDemo-350, the first synchronized multimodal dataset of 350 human desktop GUI demonstrations. The proposed skill‑induction method extracts workflow rules, step dependencies, and completion checks, achieving higher scores and success rates than baseline methods on MyPCBench and OSWorld benchmarks.
By Yuqi Huang, Hui Li, Yifei Cao, Zikun Cai, Tianci Xie, Yangfan Gao, Pinxue Guo, Chaoyun Zhang, Bingxuan Li, Rui Zheng, Hang Yan, Ning Liao
arXiv:2606. 14654v1 Announce Type: new Abstract: Sequential or time-stamped interaction logs provide objective records of digital application usage, yet their granularity and noise often obscure meaningful insights into people's work.
By Gaurav Verma, Scott Counts
arXiv:2606. 18191v1 Announce Type: new Abstract: Deep research (DR) systems are increasingly used for complex information-seeking tasks, but existing works mainly focus on generating reports and summaries.
By Md Tawkat Islam Khondaker, Raymond Li, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Issam H. Laradji
arXiv:2606. 16988v1 Announce Type: cross Abstract: Benchmark scores tell you what an agent got right; they do not tell you how it got there.
By Hamidah Oderinwale
arXiv:2610.14966v1 Announce Type: new
Abstract: Long-horizon agents must complete workflows in which later activities depend on earlier outputs and changes to shared state. A key challenge for evalua...
By Yuxuan Liu, Zhaochen Su, Hangyu Guo, Shijue Huang, Zhixiong Zhang, Kawai Chung, Zhongwei Xie, Tianshi Zheng, Wei Fan, Qing Zong, Haochen Shi, Baixuan Xu, Haoran Li, Yangqiu Song
arXiv:2606. 06893v1 Announce Type: new Abstract: Large language model agents increasingly rely on Skills to encode procedural knowledge, yet high-quality Skills remain costly to hand-write.
By Yuyang Zhang, Xinyuan Han, Xudong Jiang, Run Wang