arXiv AI By Hongchen Wei, Daohong Ying, Zhi Hong, Aidan Wu, Bei Liu, Ruichun Ma, Yifan Yang, Qi Dai, Kai Qiu, Rui Xu, Dongdong Chen, Zhenzhong Chen, Chong Luo

OfficeTown: Generative Organizations for Evolving Agent Intelligence

Read the original on arXiv AI →

OfficeTown is a generative simulation framework that models professional organizations, where tasks and context evolve from ongoing work. Starting from a natural‑language description of an organization’s purpose, the system initializes members who coordinate, delegate assignments to assistant agents, and review deliverables, while artifacts and decisions persist to influence future tasks. The authors built OfficeTown Bench with 406 tasks and 4,836 evaluation criteria across 23 simulated organizations in eight domains, and show that fine‑tuning and on‑policy distillation on this data improves Qwen3.5‑9B on external professional‑work benchmarks, with a principal–assistant setup outperforming single‑ and multi‑agent baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 28

WorkFactory: Turning Professional Intents into Executable Work for Scalable Agent Training

WorkFactory is a scalable framework that transforms professional intents into executable tasks by building an information support graph and using probe executions to detect and repair support failures. The authors generated 112,686 tasks across 612 occupations and fine‑tuned Qwen models (4B, 27B, 35B-A3B) to create the WorkPilot family, which outperforms base models on four professional‑work benchmarks. The study shows that planning and repair reduce task environment defects and improve downstream performance, with diminishing returns observed as model size increases.

By Ziyang Zeng, Tingyang Chen, Jia Deng, Qiyao Wang, Shuo Tang, Yike Yang, Tao Ren, Wayne Xin Zhao, Feng Chang, Jujie He, Chuan Hao, Ran Tao, Bryan Dai
arXiv AI
Jun 17

A Framework for Evaluating Agentic Skills at Scale

arXiv:2606. 17819v1 Announce Type: cross Abstract: Agent skills -- structured, reusable knowledge artifacts that augment LLM agent capabilities -- have been rapidly adopted in industry, yet their cross-domain impact and use across commercial and open-source models remain under-studied, and no reusable methodology exists for evaluating an individual skill.

By Maksim Shaposhnikov, Nicolas Fortuin, Simon Stipcich, Maria I. Gorinova, Amy Heineike, Rob Willoughby
arXiv AI
2d ago

Using profiles of cognitive capability to assess AI suitability for workplace tasks

The paper proposes a method for assessing AI suitability for workplace tasks by profiling both AI agents and tasks along shared cognitive capability dimensions. It uses benchmark performance to infer agent capabilities and expert input to weight task requirements, allowing independent updates as models and roles evolve. The authors validate the approach on synthetic agents, six AI systems, and 410 employees across six domains, showing that AI systems vary more by cognitive dimension than by model family, while workplace tasks share a common cognitive core.

By Jonathan Prunty, Marko Te\v{s}i\'c, Patrick Quinn, Jos\'e Hern\'andez-Orallo, Lucy Cheke
arXiv Computation and Language
Oct 12

Scaling Agentic Data for Long-Horizon Terminal Intelligence

The paper introduces TerminalHorizon, an automated engine that synthesizes long‑horizon trajectories for terminal agents by reconstructing environments from real‑world professional work and progressively expanding tasks to require further exploration and improvement. Using this engine, the authors create 1.5K task environments and fine‑tune Qwen3.5‑27B, producing TerminalHorizon‑27B, which shows significant performance gains across 12 benchmarks in coding, agentic production tasks, and reasoning. Case studies demonstrate the model’s ability to experiment beyond initial solutions, refine methods based on feedback, and preserve effective improvements in final deliverables.

By Shun Zou, Ziyu Ma, Yi Zou, Yong Wang, Lin Chen, Zehui Chen, Guanhua Chen, Xiangxiang Chu, Feng Zhao