arXiv Machine Learning

Assessing Reliability of Symbol Detection in Concept Bottleneck Models

arXiv:2606. 16535v1 Announce Type: new Abstract: Concept Bottleneck Models (CBMs) are a relevant tool for explainable Artificial Intelligence because they make their predictions through human-interpretable symbols.

arXiv AI
Sep 24

Parameter-Efficient Construction of the Rashomon Slice for Concept Bottleneck Models

The paper introduces a method for efficiently exploring the Rashomon set of Concept Bottleneck Models (CBMs) by using a parallel parameter‑efficient adaptation module, checkpointing, and a concept diversity objective. This approach generates multiple equally accurate CBMs from a single training process, achieving greater diversity than baseline methods while consuming less memory. The resulting diverse models enable trustworthy selection, reduce inter‑class confusion, and support reliable abstention in decision‑making.

By Shihan Feng, Cheng Zhang, Michael Xi, Ethan Hsu, Lesia Semenova, Chudi Zhong
arXiv AI
Sep 10

Limits of Reliability and Scaling in Language Models

The paper argues that large language models cannot achieve perfect reliability for any task, even with unlimited scale. It establishes that each generative task has an inherent reliability ceiling set by how much output uncertainty can be resolved from observable context, with a resolvable part that can be improved by more context and a subjective part tied to task ambiguity. The authors derive a scaling law showing that performance is limited by the scarcer resource—either training data or model capacity—and explain how this law explains phenomena such as retrieval augmentation and catastrophic forgetting.

By Subhabrata Majumdar