AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,808 stories · RSS feed

Hugging Face Trending Papers
Sep 8

NOAH: Learning the Full Patient Journey. A Longitudinal Multimodal Time-Aware Model for Representation and Forecasting

NOAH is a generative transformer that models the entire multimodal patient journey by integrating bidirectional time and a variational latent space to capture continuous, stochastic clinical trajectories. Trained on over 559 million events from 431,000 hospital visits, it processes medical images, time‑series, numeric signals, categorical events, and both structured and unstructured records. The model supports autoregressive forecasting, zero‑shot classification, and counterfactual simulations, yielding strong predictive performance across 15 ICD chapters, 29 comorbidities, and time‑to‑event outcomes.

Hugging Face Trending Papers
Sep 8

Everything in Moderation: Per-Domain Coverage Optima and Alignment-Resistant Domain Gaps in Multi-Domain Mid-Training

The paper investigates how per-domain data composition during the mid‑training phase (between pre‑training and alignment) affects model performance. Experiments with Qwen3‑8B‑Base across five KOR‑Bench domains show that a moderate coverage band (10%‑40%) yields the best performance for each domain, and that alignment passes cannot fully close the gaps created by suboptimal mid‑training allocations. Additionally, zero coverage during mid‑training severely degrades accuracy, while a carefully tuned allocation can provide the largest overall pipeline improvement.

Hugging Face Trending Papers
Sep 8

DXPR: Depth-Based Vision-LiDAR Cross-Modal Place Recognition Using Vision Foundation Models

DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.

Hugging Face Trending Papers
Sep 8

GraphFAS: A Distributed System for Automated Graph Feature Generation and Selection in Industrial Transaction Networks

GraphFAS is a distributed system that automates graph feature generation and selection for industrial transaction networks. It uses a non‑parametric graph feature generator that creates explicit, interpretable structural features through multi‑hop subgraph extraction and multi‑scale aggregation, and an extended Boruta algorithm that aggregates feature importance across partitions to robustly identify informative features at scale. By decoupling feature aggregation from model training, GraphFAS can be directly integrated with tabular models and TreeSHAP‑based explanations, and it has been deployed in Alipay, achieving significant engineering efficiency gains and strong performance against expert‑driven and graph‑learning baselines on large‑scale graphs.

Hugging Face Trending Papers
Sep 8

API Benchmark Scores Do Not Reliably Transfer to Chatbot Interfaces

The paper examines whether benchmark scores obtained via APIs accurately reflect the performance of AI chatbots when accessed through user interfaces. By auditing ChatGPT, Claude, and Gemini across seven systems and nine benchmarks, the authors find that API evaluations consistently overestimate accuracy and consistency compared to interface evaluations, with differences comparable to downgrading a full model generation. Attempts to align API behavior with interface behavior through prompt and parameter adjustments only partially close the gap.