Towards Data Science
Sep 6

Linear Discriminant Analysis (LDA) in Real-Life: Dimensionality Reduction in a Real-Estate Dataset

The article discusses applying Linear Discriminant Analysis (LDA) to reduce dimensionality in a real‑estate dataset for classification tasks. It explains how LDA can transform high‑dimensional data into a lower‑dimensional space while preserving class separability. The post demonstrates the practical use of LDA in a real‑life scenario, specifically within the real‑estate domain.

By Carolina Bento
arXiv Machine Learning
Sep 22

On Generalized Naive Bayes with Continuous Features

The paper extends the Generalized Naive Bayes (GNB) model to handle continuous explanatory variables. It shows that GNB structure learning depends only on pair copulas of bivariate marginals and can be framed as a matroid, enabling greedy algorithms that minimize Kullback–Leibler divergence. Three model variants are explored—joint Gaussian, Gaussian copula with arbitrary marginals, and fully arbitrary copula and marginals—along with a GNB forest-based model reduction method and empirical comparisons to classical glass‑box classifiers.

By \'Abrah\'am Papp, Botond Szil\'agyi, Edith Alice Kov\'acs
arXiv Machine Learning
Aug 21

Exact Algebraic Computation of Learning Coefficients for Two-Dimensional Singular Models

arXiv:2608. 20183v1 Announce Type: new Abstract: Classical information criteria such as the Bayesian Information Criterion (BIC) rely on regularity assumptions that break down for singular models, leading to incorrect model selection in settings such as deep learning.

By Gr\'egoire Sergeant-Perthuis (CQSB, Sorbonne Universit\'e), Elias Tsigaridas (Ouragan Team, INRIA), Jules Tsukahara (Ouragan Team, INRIA)