arXiv AI

Responsible Personalisation: The Double-Edged Sword of Personalisation in Human-Robot Interaction

arXiv:2607. 06344v1 Announce Type: cross Abstract: While personalisation is becoming a defining capability in human-robot interaction (HRI), the existing literature on responsible personalisation remains fragmented, offering isolated accounts of ethical risks without a structured understanding of how they emerge across interaction contexts.

Hugging Face Trending Papers
Jul 7

Responsible Personalisation: The Double-Edged Sword of Personalisation in Human-Robot Interaction

While personalisation is becoming a defining capability in human-robot interaction (HRI), the existing literature on responsible personalisation remains fragmented, offering isolated accounts of ethical risks without a structured understanding of how they emerge across interaction contexts. This gap is particularly critical in HRI, where robots' embodiment and social presence can amplify and reshape such risks or generate new types of risks.

arXiv AI
Aug 28

Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRI

The paper "Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRI" addresses the lack of clear prompt design in human‑robot interaction using large language models. It proposes a framework and a structured prompt template with eight functional components to specify, bound, and adapt robot behavior. The authors base their guidelines on a review of prior work and on survey data from 27 HRI experts, highlighting issues such as unclear robot personality, the need for user adaptation, and ethical concerns around safety, deception, and governance.

By Ashita Ashok, Franziska Babel, Patrick Holthaus, Rucha Khot, Karla Bransky, Fethiye Irmak Dogan, Karsten Berns, Silvia Rossi, Minha Lee, Guy Laban
arXiv AI
Jun 9

Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs

arXiv:2606. 09038v1 Announce Type: new Abstract: Large Language Models (LLMs) have enabled increasingly personalized interactions by adapting to users' preferences, contexts, and long-term histories.

By Yanyan Luo, Xue Han, Ruiqiao Bai, Xin Huang, Yitong Wang, Qian Hu, Qing Wang, Chunxu Zhao, Jie Liu, Cong Geng, Lehao Xing, Pengwei Hu, Junlan Feng
Hugging Face Trending Papers
Aug 3

Human-Centered Reflections on Care Robots: A Comparative Study of Caregiver Perspectives

Care robots are increasingly being introduced into healthcare settings, raising important questions about their acceptance and ethical implementation. To better understand these challenges, this study investigates caregivers' perceptions of four categories of care robots: delivering supplies, helping patients into bed, monitoring vital signs, and assisting with mobility.

arXiv AI
Jun 3

RobotValues: Evaluating Household Robots When Human Values Conflict

arXiv:2606. 03312v1 Announce Type: cross Abstract: While household robots are often evaluated based on task completion, everyday domestic environments involve value-conflicting situations in which robots are expected to choose actions that prioritize other values than task success, such as human autonomy, efficiency, or social appropriateness.

By Jongwook Han, Hyeongjin Kim, Yohan Jo
arXiv AI
Sep 24

Behaviora - A Conceptual Architecture for External and Internal Behavior of Robots and Agents

Behaviora is a preliminary conceptual architecture that represents both external and internal behavior of robots and agents in an addressable form. It defines a Behavior Episode composed of components derived from behavior taxonomies, each assigned a persistent Internet of Behaviors (IoB) Address. The architecture also includes a Style Profile to describe how behavior is expressed, an Experience Profile to capture internal state influencing execution, and a Behavior Compiler to translate these representations into platform‑specific actions.

By Gote Nyman
arXiv AI
Sep 24

Safety Nudges: User-Facing Interventions for Real-Time AI Risk Awareness

The paper introduces Safety Nudges, a browser-based tool that displays lightweight, in situ flags when a conversational AI exhibits risky behavior such as hallucination or overconfidence. In a two‑week field study with 45 frequent chatbot users, participants reported that the nudges were useful, clear, and minimally disruptive, and most felt more aware of potential AI harms. However, increased awareness did not automatically translate into measurable changes in user behavior, underscoring the need for relevance, calibration, and user control in nudge design.

By Varshini Elangovan, James Wedgwood, Chhavi Yadav, William Agnew, Sauvik Das, Virginia Smith
arXiv AI
Aug 11

Autonomy Reshapes How Personalization Affects Privacy Concerns and Trust in LLM Agents

arXiv:2510. 04465v3 Announce Type: replace-cross Abstract: LLM agents require personal information for personalization in order to effectively act on users' behalf, but this raises privacy concerns that can discourage data sharing, limiting both the autonomy levels at which agents can operate and the effectiveness of personalization.

By Zhiping Zhang, Yi Evie Zhang, Freda Shi, Tianshi Li