Hugging Face Trending Papers

Understanding Tone-Dependent Inference Cost in Large Language Models

Read the original on Hugging Face Trending Papers →

We examine how prompt tone affects both accuracy of the LLM answers and inference cost as reflected in output-token consumption. Experiments were performed to understand the trade-offs between accuracy and inference cost on a 570 Question MMLU dataset for LLM models prompted in seven different tones from sycophantic to threatening.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

Hugging Face Trending Papers
Jul 13

Production and Perception in LLMs: A Token Probability Approach

The asymmetry between language production and perception has been well-documented in psycholinguistics. Whether large language models (LLMs) exhibit a functionally analogous distinction remains an open question, particularly given that LLMs rely on the same underlying mechanism (next-token prediction) for both input and output processing.

arXiv AI
Aug 5

Should We Type or Talk to LLM Agents? A Comprehensive Study of Voice and Keyboard Input Perturbations

arXiv:2608. 03970v1 Announce Type: new Abstract: Human input reaches language models by typing or speaking, and each channel leaves a distinct signature: orthographic noise for keyboards; for voice, disfluency from conventional transcription and restructuring from AI-backed dictation tools.

By Zizhao Hu, Nathan Elijah Segura, Mohammad Rostami, Jesse Thomason