LensDesigner is an autonomous agent framework that emulates expert opticians to tackle the complex, non‑convex problem of optical lens design. It uses a large lens library (LensLib100K) and optics‑aware retrieval to provide valid structural seeds, then iteratively improves through a curriculum agent that learns and reuses design heuristics. The system is evaluated on LensArena, a benchmark of 120 diverse optical tasks, where it outperforms existing baseline algorithms in success rate and optimization efficiency.
arXiv:2604. 01480v2 Announce Type: replace Abstract: Metasurface inverse design can realize complex optical functionality, but turning a target optical response into executable optimization code still requires substantial expertise in computational electromagnetics and solver-specific software engineering.
arXiv:2607. 07189v1 Announce Type: new Abstract: Vision-language models (VLMs) and agentic AI have shown strong performance on semantic visual tasks, but it remains unclear whether they can handle the physics and inverse problems that underlie computational imaging.
TO-Agents is a multi‑agent AI framework that translates natural‑language design intent into iterative topology optimization. It converts a human problem description into solver inputs, runs the optimizer, renders 3D topologies, and employs a judge agent to critique and revise results using multiview vision‑language reasoning. Evaluated on a cantilever beam and a phone‑stand design, the system achieved preference‑aligned designs in 60% of trials, outperforming an ablated pipeline by up to six times and enabling end‑to‑end intent‑to‑prototype design with additive manufacturing.
arXiv:2606.14397v4 Announce Type: replace Abstract: As agentic systems continue to evolve and are widely deployed in real-world scenarios, there is a growing demand to faithfully evaluate their capab...
VortexChat is an agentic framework that autonomously performs end-to-end inverse design of integrated photonic devices from natural language specifications. It combines a large language model decision agent with topology generation, gradient-based refinement, and full-wave electromagnetic simulation in a closed-loop architecture, enabling iterative decomposition of design objectives and minimal human intervention. The system successfully generated devices meeting the Vortex100 Benchmark metrics and fabricated a broadband terahertz perfect vortex beam multiplexer that matched simulation predictions.
arXiv:2606. 19980v1 Announce Type: new Abstract: Achieving dexterous robotic manipulation in the real world heavily relies on human supervision and algorithm engineering, which becomes a central bottleneck in the pursuit of general physical intelligence.
arXiv:2606. 14397v1 Announce Type: new Abstract: As agentic systems continue to evolve and are widely deployed in real-world scenarios, there is a growing demand to faithfully evaluate their capabilities.
arXiv:2503. 22122v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the environment for task decomposition.
arXiv:2608. 14015v1 Announce Type: cross Abstract: Understanding tens-of-minutes surgical videos requires long-horizon temporal reasoning, answering what happens before, after, or across stages of a procedure by grounding the question in visual evidence spread across time.
arXiv:2608. 01791v2 Announce Type: replace-cross Abstract: The rapid development of photonic integrated circuits (PICs) is shifting the design flow from traditional graphical user interface (GUI)-based methods to script-based methods for higher flexibility, portability, and maintainability.
The paper introduces a unified large language model workflow for modeling and inverse-design of metasurfaces across multiple families. By converting geometries, design parameters, and optical responses into a shared instruction‑following text format, the authors fine‑tune Gemma‑2‑9B on eight distinct metasurface families. Compared to single‑family models, the joint model predicts all families’ optical responses simultaneously and reduces mean‑squared error by an average of 56.5%. "whyItMatters":"The approach demonstrates that a shared sequence‑based LLM interface can streamline cross‑family metasurface design, eliminating the need for separate surrogate architectures for each geometry class."
arXiv:2606. 26722v1 Announce Type: new Abstract: The automation of scientific discovery has reached an inflection point.