arXiv:2610.02627v1 Announce Type: new
Abstract: An email assistant should not complete less work simply because a user phrases the same request differently. Yet most benchmarks test each task with on...
By Feng Chen, Ritam Dutt, Atnaz Taheri, Alex Williams
arXiv:2608. 07494v1 Announce Type: cross Abstract: AI tools like ChatGPT and DeepSeek, powered by Large Language Models (LLMs), allow users to obtain instant and effective content responses simply by typing requests, such as ``plan a three-day Vienna trip'', ``solve the attached mathematical problem'', ``draft an email to inquire review progress'', etc.
By Yiqun Zhang, Yunfan Zhang, Mingjie Zhao, Sen Feng, Yiu-ming Cheung
The paper introduces a prompt‑engineering framework that personalizes large language model (LLM) teaching assistants across disciplines by tailoring responses to six learner‑specific dimensions, creating 96 distinct learner profiles. It also analyzes student queries through Bloom’s Taxonomy to gauge cognitive complexity, encoding both learner attributes and cognitive assessments into structured prompts that condition the LLM without retraining. Experiments using NLP metrics and a small human study demonstrate that this approach yields perceptible differences in response style and structure, with statistical evidence linking specific learner attributes to measurable changes.
By Saptarshi Basu, Sandeep Kakar, Ashok Goel
The article surveys evaluation methods for large language model (LLM)-based agents in multi-turn conversations, reviewing nearly 250 scholarly sources through a PRISMA-inspired framework. It introduces two taxonomies: one outlining what to evaluate—task completion, response quality, user experience, memory and context retention, planning, and tool integration—and another detailing how to evaluate, covering annotation-based, automated, hybrid, and self-judging approaches. The framework incorporates both traditional metrics like BLEU and ROUGE and advanced techniques suited to dynamic, interactive dialogues.
By Shengyue Guan, Jindong Wang, Jiang Bian, Bin Zhu, Jian-guang Lou, Haoyi Xiong
arXiv:2607. 05477v1 Announce Type: cross Abstract: Improving the task performance of Large Language Models (LLMs) is essential, yet scaling these models faces significant challenges such as diminishing returns and high costs.
By Lars Benedikt Kaesberg
arXiv:2606. 07909v1 Announce Type: new Abstract: Modern large language model (LLM) agents can use external tools to help users solve complex tasks.
By Suleyman Armagan Er, Danilo Ribeiro, Yogesh Virkar, Surafel Lakew, Adi Kalyanpur, James Gung, Thomas Delteil, Arshit Gupta