arXiv AI

An Interactive Evolutionary Multiobjective Optimization Algorithm Based on Interpretable Active Preference Learning

The paper introduces an interpretable interactive evolutionary multi-objective optimization algorithm that learns a tree-based preference model through active learning from pairwise comparisons. It extends the survival operator of NSGA-II and NSGA-III to guide the search toward the decision-maker’s preferred region. Experiments show the method outperforms both black-box and other interpretable models in locating the most preferred solution, and a real-life engineering case study demonstrates how the learned model reveals the objectives influencing preferences.

Hugging Face Trending Papers
Jul 30

SCOPE: Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization

Black-box combinatorial optimization requires systematically identifying high-quality solutions under a limited evaluation budget, yet the unknown objective function provides little guidance for deciding where the search should explore next. We introduce SCOPE, a general framework for Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization.

arXiv AI
Sep 23

Artificial Neural Networks as Surrogate Models in Black Box Optimization

arXiv:2609.22329v1 Announce Type: cross Abstract: Black-Box Optimization (BBO) is often applied in several engineering fields and can utilize an advancement of numerical measure- ments and simulation...

By Md Khadimul Islam Zim (Czech Academy of Sciences, Institute of Computer Science, Prague, Czech Republic), Martin Hole\v{n}a (Czech Academy of Sciences, Institute of Computer Science, Prague, Czech Republic)
arXiv AI
Sep 24

Which Objectives Need a Dial? Predicting Objective Conflict and Covering Trade-offs in Steerable Pluralistic Alignment

The paper investigates how to create steerable AI models that can balance multiple, sometimes conflicting objectives, a necessity for pluralistic alignment. Using Multi-Objective Direct Preference Optimization (MODPO), the authors examine when a single model can improve two objectives simultaneously and how to cover many trade‑offs without training separate models. They find that two pre‑training measurements predict objective alignment for human‑annotated data but not for AI‑annotated data, and that selecting the nearest trained model or merging parameters can broaden trade‑off coverage, though neither approach consistently matches direct training.

By David Tsoi, Esra D\"onmez
arXiv AI
2d ago

Objective-Conditioned Active Preference Learning for Multi-Objective Alignment

The paper introduces OGC-DPO, an active preference learning framework for aligning large language models with multiple objectives such as helpfulness, harmlessness, and honesty. OGC-DPO treats each response pair and objective as a separate query, using the model’s implicit gradient to gauge informativeness and selecting queries that expand gradient coverage for each objective. Experiments show that OGC-DPO outperforms existing methods at the same annotation cost and reveals that informative conflicts can serve as valuable training signals.

By Duc Anh Vu, Thong Nguyen, Hoang Pham, Ponhvoan Srey, Luu Anh Tuan