AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,884 stories · RSS feed

arXiv AI
Sep 1

Motus2: A Self-Evolving General World Model for Dexterous Manipulation

Motus2 is a self‑evolving general world model designed for dexterous manipulation. It integrates a shared‑weight model that offers three control interfaces—a policy, a simulator, and an evaluator—forming a closed decision‑and‑learning loop for policy improvement. The system scales both model size and data, progressing from large‑scale monocular egocentric data to synchronized stereo data and robot‑domain adaptation, while also incorporating tactile feedback and a biomimetic platform with dual arms and hands.

By Hongzhe Bi, Zihao Zhou, Yihang Tang, Jingrui Pang, Shuhe Huang, Haitian Liu, Runqing Wang, Shuai Huang, Yichen Wang, Yiming Cheng, Ruowen Zhao, Zhenghua Li, Hengkai Tan, Xiaolong Liu, Jinhui Wan, Jiabao Liu, Min Zhao, Fan Bao, Jun Zhu
arXiv AI
Sep 1

Redesigning and Auditing Deep Research Writing for Faithful Reports

The paper introduces CLAIMPROBE, a claim-level audit tool that breaks down deep-research reports into individual claims and evaluates them for hallucination, misattribution, citation hygiene, and necessary-fact recall against retrieved evidence. Using CLAIMPROBE, the authors show that even high-scoring deep-research pipelines can omit key evidence and misattribute claims. They also propose CLAIMWRITER, a hierarchical claim-based writer that extracts source facts, maps them to an outline, and drafts sections from a source-linked claim representation, which reduces hallucination by 2.6 to 4.5 times and improves necessary-fact recall by 1.2 to 1.7 times while preserving overall report quality and enabling efficient localized revisions.

By Hiroaki Hayashi, Pranav Narayanan Venkit, Prafulla Kumar Choubey, Chien-Sheng Wu
arXiv AI
Sep 1

No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus

The study examined whether providing full prompt-level context to a large multimodal model would improve speech transcription accuracy on a production oral‑history corpus. Using a preregistered within‑item paired ablation, the authors found that adding context did not produce a detectable change in side‑level word error rate (WER) for either gpt‑4o‑transcribe or gemini‑2.5‑flash. The results suggest that context alone may not be sufficient to enhance aggregate transcription accuracy, and that finer‑grained, sequence‑aligned metrics are needed to evaluate such mechanisms.

By Theodore O. Cochran, Stephanie Dodson, Keith Nore
arXiv AI
Sep 1

The Hallucination Signal Is a Mean Shift: Why Simple Probes Suffice

The study shows that hallucination detection in large language models is largely driven by a single mean‑shift component in hidden states. Across three 7B‑scale models and multiple datasets, removing this direction reduces detection to chance, while a simple L2‑regularized logistic regression achieves high AUROC (0.952) and outperforms more complex probe architectures. The authors introduce LayerMix, a multi‑layer aggregation method that matches oracle‑layer performance without requiring oracle access, demonstrating that apparent probe complexity stems from high‑dimensional covariance estimation rather than non‑linearity.

By Jungseob Lee, Jaehyung Seo, Heuiseok Lim
arXiv AI
Sep 1

Subtraction-Based Tumor Segmentation and Lesion-Centered pCR Prediction for the MAMA-MIA Challenge

Team FME submitted a method for the MAMA-MIA Challenge that tackles primary tumor segmentation and pathological complete response (pCR) prediction using dynamic contrast‑enhanced breast MRI. For segmentation, they employed a five‑fold residual‑encoder nnU‑Net ensemble trained on the first post‑contrast minus pre‑contrast image, augmented with mirroring test‑time augmentation and largest‑connected‑component filtering, achieving a Dice score of 0.713 and a normalized Hausdorff distance of 0.099. For pCR prediction, they ensembled 25 pretrained 3D video classifiers on lesion‑centred crops from the pre‑contrast and first two post‑contrast volumes, reaching a balanced accuracy of 0.541 and an equalized‑odds disparity of 0.212, and ranked second in both tasks.

By Kai Geissler, Raphael Sch\"afer
arXiv AI
Sep 1

Background-Free Objectness Learning for Class-Agnostic Detection

Background-Free Objectness Learning (B-FOR) is a dense, class‑agnostic detection framework that learns objectness without treating unlabeled regions as background. It predicts multi‑scale object‑center and scale fields, using spatially structured soft targets to supervise only reliable annotated areas and introduces displacement‑aware scale fields to model object extent. Experiments on PASCAL VOC, MS‑COCO, and Open Images show B‑FOR improves recall by over +10 AR points compared to prior class‑agnostic baselines, with ablation studies confirming the importance of localized supervision and displacement‑aware scaling.

By Dania Batool, Liliana Lo Presti, Marco La Cascia, Filippo Vella
arXiv AI
Sep 1

QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation

QCell is a query‑based model designed to improve overlapping cell instance segmentation in microscopy images. It introduces an instance recombination module that decomposes and recombines query representations in latent space, allowing the model to reason about entire cell structures even when they overlap. Additionally, a contrastive query alignment objective is used to learn distinctive instance features and separate overlapping cell queries. The authors also present a new Organoid dataset benchmark and demonstrate that QCell surpasses state‑of‑the‑art methods, achieving +2.2 AP and +2.7 AJI on the ISBI2014 benchmark.

By Yaroslav Prytula, Anton Popov, Dmytro Fishman