arXiv AI

UPPAAi: Towards LLM-Assisted Modeling, Verification, Analysis and Synthesis

UPPAAI extends the UPPAAL tool by integrating large language models (LLMs) to assist users in constructing, explaining, debugging, and specifying models through dialogue. The system follows a workflow where the user requests, the LLM proposes and explains, and UPPAAL performs verification, exposing its editor, queries, and verifier via a Tools API. Seven case studies demonstrate UPPAAI’s effectiveness across timed automata, stochastic hybrid automata, and strategy learning, showing that LLMs not only generate solutions but also proactively suggest relevant UPPAAL features.

arXiv AI
Aug 11

How to Ask the AI: A User Perspective Survey for Large Language Model Prompting

arXiv:2608. 07494v1 Announce Type: cross Abstract: AI tools like ChatGPT and DeepSeek, powered by Large Language Models (LLMs), allow users to obtain instant and effective content responses simply by typing requests, such as ``plan a three-day Vienna trip'', ``solve the attached mathematical problem'', ``draft an email to inquire review progress'', etc.

By Yiqun Zhang, Yunfan Zhang, Mingjie Zhao, Sen Feng, Yiu-ming Cheung
arXiv AI
Oct 16

LLMON: An LLM-native Markup Language to Leverage Structure and Semantics at the LLM Interface

The paper introduces LLMON, an LLM-native markup language designed to encode the structure and semantic metadata of textual inputs for large language models. By distinguishing components such as instructions and data within prompts, LLMON aims to reduce model confusion and mitigate security risks like prompt injection. The authors outline design requirements, present the language, and provide preliminary evidence that incorporating LLMON can improve model accuracy, safety, and security during training and inference.

By Michael Hind, Basel Shbita, Bo Wu, Farhan Ahmed, Chad DeLuca, Nathan Fulton, David Cox, Dan Gutfreund
arXiv AI
Jul 7

Exploring Plan Space through Conversation: An Agentic Framework for LLM-Mediated Explanations in Planning

arXiv:2603. 02070v3 Announce Type: replace Abstract: When automating plan generation for a real-world sequential decision problem, the goal is often not to replace the human planner, but to facilitate an iterative reasoning and elicitation process, where the human's role is to guide the AI planner according to their preferences and expertise.

By Guilhem Fouilh\'e, Rebecca Eifler, Antonin Poch\'e, Sylvie Thi\'ebaux, Nicholas Asher
arXiv Computation and Language
Oct 22

Reasoning-Search-Augmented LLMs: An Operational Taxonomy, Benchmark Analysis and Controlled Evidence Synthesis

The paper reviews and categorizes large language models that combine step‑by‑step reasoning with interactive search, treating retrieval as an action within an iterative agentic loop. It analyzes these systems along four architectural axes—retrieval coupling, controller design, knowledge source, and grounding strictness—while also considering the learning signal as a cross‑cutting factor. The authors conduct controlled ablations and benchmark analyses to clarify how design choices affect search, stopping, and grounding behavior, aiming to provide a unified perspective for future research.

By Biswas Poudel, Nilson Chapagain, Amit Kumar, Xianshun Jiang
arXiv AI
Oct 19

From Natural Language Intent to Executable Control: Hierarchical Feedback-Guided LLM Planning for Multi-component Cyber-Physical Systems

The paper introduces a hierarchical feedback framework that guides large language models (LLMs) to produce executable plans for cyber‑physical systems (CPSs) from natural language commands. It prompts LLMs to generate both a structured task plan and signal temporal logic (STL) constraints, then uses a sound algorithm to detect contradictions and provide feedback for plan revision. At execution time, diagnostic information from failed control synthesis—such as violated constraints and conflicting component assignments—is fed back to the LLM to enable task replanning, achieving an 87.9% success rate on seven heterogeneous CPS scenarios.

By Jinglin Dai, Jiawan Wang, Ruiqi Hong, Lei Bu
arXiv AI
Aug 28

From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilities

The paper introduces a new benchmark that evaluates large language models (LLMs) on their agentic mathematical reasoning rather than just final answers. It aligns problem‑solving behaviors with a taxonomy of reusable mathematical atomic capabilities and includes planning, action, and feedback tasks in both textual and multimodal settings. Experiments show that models with similar end‑to‑end accuracy can have very different agentic profiles, highlighting the importance of process‑level evaluation.

By Jiayi Kuang, Yinghui Li, Yunze Song, Keyu Chen, Zhifeng Shen, Yangning Li, Yidong Wang, Di Yin, Ruizhi Qiao, Xing Sun, Kai Jin, Ying Shen, Liang Lin, Philip S. Yu
arXiv AI
Sep 7

AutoLR: Automating the Path from Research to Launch Review in Industrial Recommender Systems

AutoLR is an autonomous harness designed to streamline the iterative research‑and‑engineering cycle for industrial recommender systems, exemplified by NetEase’s gaming‑community app DASHEN. It integrates a multi‑expert council for adversarial review, a deterministic evidence‑weighted selector to allocate trial budgets, and a layered knowledge system that fuses external research with domain‑specific insights and empirical evidence. Large language model agents handle semantic reasoning and code generation, while deterministic controllers maintain control over execution, metrics, guardrails, and state management.

By Qi Zhang, Yanlin Chen, Wenchao Xiao