arXiv Machine Learning By Shuxiao Xie, Shuyang Xie, Yuan Cao, Dezhi Ran, Wei Yang, Tao Xie

One QK Channel, Many Sources: Guarding Low-Precision Attention Collapse

Read the original on arXiv Machine Learning →

arXiv:2608. 02091v1 Announce Type: new Abstract: A bfloat16 transformer can train normally for many steps and then collapse abruptly.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 4

Real-Time Detection and Repair of LLM Agent Failures

arXiv:2608. 02464v1 Announce Type: cross Abstract: LLM agents fail mid-episode -- they loop, cascade tool errors, drift off goal, fabricate results, or silently absorb corrupted content -- and the standard remedy, judging every step with a second LLM, costs more than the agent itself.

By Sunny Dubey