PatentAgentBench: Benchmarking LLM Agents with Professional Patent Task Suites

PatentAgentBench is a new benchmark that tests large language model agents on 510 real-world patent tasks across eight suites, including novelty search, freedom‑to‑operate, design FTO, invalidity search, claim charting, patent drafting, office‑action response, and patent translation. The benchmark uses curated patent records and expert‑reviewed annotations to evaluate task‑specific metrics, requiring agents to search patent collections without pre‑supplied candidate pools and to produce high‑quality drafting and response work. Seven LLMs were evaluated on four agent harnesses, revealing that current systems still struggle with novelty identification, risk assessment, and understanding practitioner intent throughout patent workflows.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• agents
• benchmarks