arXiv AI

D3O: Dynamic Distribution Distillation for Ordinal Regression

arXiv:2607. 23575v1 Announce Type: cross Abstract: Ordinal regression is widely used in scenarios where labels are discrete yet inherently ordered.

arXiv AI
Jun 9

DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression

arXiv:2606. 07599v1 Announce Type: cross Abstract: Ordinal Regression (OR) aims to predict target values with inherent order, underpinning critical applications across diverse domains, from recommender systems to computer vision.

By Hongxu Ma, Lin Wang, Chenghou Jin, Han Zhou, Jie Zhang, Xiaoyu Yang, Chunjie Chen, Jihong Guan, Shuigeng Zhou
arXiv Computation and Language
Sep 10

Are LLMs Positionally Consistent Ordinal Classifiers? A Systematic Evaluation

Large language models (LLMs) used for ordinal classification exhibit positional bias, where changes in label order, demonstration order, and demonstration placement affect predictions. Systematic experiments across ten frontier LLMs, eight prompt/task/model factors, and five datasets reveal that all models are sensitive to these positional sources, and that accuracy and stability often diverge. Various correction methods, including pointwise, pairwise, and listwise inference, do not reliably mitigate the bias, though a comparison-based listwise approach shows the best overall balance yet varies across models and bias types.

By Yu Wang, Zhe Zhou, Menglin Liu, Ge Shi
arXiv Computation and Language
Sep 23

Differentiable Fuzzy Inference Layer: A Monotone, Compositional Ordinal Reasoning Head for Large Language Models

The paper introduces the Differentiable Fuzzy Inference Layer (DFIL), a dual‑path prediction head that pairs a standard classifier with a scalar‑bottlenecked branch using ordered membership functions. DFIL enforces monotonicity in the underlying quantity and enables compositional reasoning via t‑norm operations, addressing failures of standard classifier heads that treat ordinal categories as independent labels. The scalar branch also offers an interpretable interface for analyzing residual errors, and the authors demonstrate DFIL’s effectiveness on ordinal natural‑language tasks across various large language model families.

By Zhen Zhang, Amr Alanwar
arXiv Machine Learning
Sep 25

MORE-PLR: multi-output regression employed for partial label ranking

The paper introduces MORE-PLR, a method that tackles the partial label ranking problem by employing multi-output regression. It uses an encoder to transform incomplete rankings with ties into regression targets during training, and applies post‑hoc layers during inference to convert regression outputs into bucket orders. Experiments show that this framework competes with state‑of‑the‑art partial label ranking methods.

By Santo M. A. R. Thies, Juan C. Alfaro, Viktor Bengs