Towards Data Science By Uri Peled

Why Adding More AI Agents Made Our System Slower

Read the original on Towards Data Science →

The hidden cost of asynchronous systems, how tiny CPU tasks quietly became our biggest bottleneck while scaling hundreds of LLM agents. The post Why Adding More AI Agents Made Our System Slower appeared first on Towards Data Science .

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Towards Data Science.

Towards Data Science
Jul 10

The Big Con of Agentic AI

What our over-dependence on external consulting teaches us about delegating our minds to machines The post The Big Con of Agentic AI appeared first on Towards Data Science .

By Chinmay Kakatkar
Towards Data Science
Aug 27

Agentic AI Is Rewriting The Analytics Stack But There's One Skill It Still Can't Touch

The article discusses how agentic AI is reshaping the analytics stack by taking over more execution tasks. It raises the question of which responsibilities should remain with human analysts versus AI agents and explores the importance of this distinction. The piece highlights the evolving role of AI in analytics and the need to define clear boundaries between human and machine work.

By Rashi Desai
OpenAI Blog
Sep 6

Research acceleration: The view inside OpenAI

The article discusses how coding agents are transforming AI research within OpenAI. It presents early data on agent usage, experiment velocity, task complexity, and the resulting acceleration of research. The piece highlights the growing role of these agents in speeding up development and experimentation.

arXiv AI
Sep 18

Not All AI Agents Are Equal: Characterizing Resource and Performance Dynamics

The paper investigates how large‑language‑model (LLM) based AI agents mix latency, local resource usage, and container bottlenecks when processing user requests that involve remote LLM calls and local tool execution. By measuring three representative tasks—retrieval‑augmented question answering, web search, and software coding—the authors show that agents exhibit diverse resource dynamics, with concurrent requests revealing task‑specific bottlenecks in CPU, disk I/O, and memory. Leveraging these insights, they propose CPU‑aware tool admission and task‑aware CPU allocation, achieving up to a 5.4× speed‑up for CPU‑sensitive tasks and a 32% reduction in average latency across multiple tasks.

By Wonmi Choi, Minuk Park, Zhixiong Niu, Yongqiang Xiong, Chuck Yoo, Gyeongsik Yang