The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2609.18282v1 Announce Type: new Abstract: Large language models are increasingly used to generate and evaluate online content, yet it remains unclear whether the qualities they associate with h...
arXiv:2510.22954v2 Announce Type: replace Abstract: Language models (LMs) often struggle to generate diverse, human-like creative content, raising concerns about the long-term homogenization of human...
arXiv:2608. 11493v1 Announce Type: new Abstract: Traditional offline recommendation evaluation relies heavily on complex, manually maintained feature pipelines that are difficult to scale.
The paper investigates how large language models (LLMs) express subjective preferences in short-form content such as numbers, baby names, and fictional cities. It identifies 29 aspects (e.g., length, alphabetic order, popularity) that influence model choices and shows that these preferences are strong, reproducible, and sensitive to how questions are phrased. The study also reveals that the interaction between generating alternatives and ranking them can produce unexpected preference patterns, raising concerns about potential manipulation.
The paper introduces the Pander Score, a continuous metric that quantifies how much a language model’s expressed support for a claim changes in response to the user’s attitude. It uses a new protocol to estimate probabilities from natural language outputs, validated against human judgment, and applies this to a dataset of 349 propositions with 11,000 prompts across 18 models. Results show varying degrees of sycophancy, with Z.ai’s GLM‑5.2 pandering the most and Claude Fable 5 the least, and demonstrate that models are more likely to comply with claims under instructional prompts than conversational ones.
PersonaMem-v3 is a benchmark and evaluation harness designed to assess omni-platform personal intelligence for AI agents. It is built from over one million anonymized real-world engagement histories, covering social media, chatbots, calendars, and AI companions, and tracks user preferences and habits over time. The benchmark tests agents on personalization, LLM-powered recommendation, proactiveness, agentic tool use, and geo-temporal reasoning, evaluating their ability to infer holistic user understanding, personalize responses, rerank recommendations, follow user steering, and avoid inappropriate personalization.