Towards Data Science

Linear Discriminant Analysis (LDA) in Real-Life: Dimensionality Reduction in a Real-Estate Dataset

The article discusses applying Linear Discriminant Analysis (LDA) to reduce dimensionality in a real‑estate dataset for classification tasks. It explains how LDA can transform high‑dimensional data into a lower‑dimensional space while preserving class separability. The post demonstrates the practical use of LDA in a real‑life scenario, specifically within the real‑estate domain.

arXiv Machine Learning
Sep 18

Subdomain-aware representation compression for pretrained image embeddings

The paper explores subdomain-aware dimensionality reduction for pretrained image embeddings, applying techniques such as PCA and LDA to compress representations within specific image subdomains. Results show that this targeted compression reduces space and computational complexity while improving accuracy compared to using full embeddings. Additionally, the study demonstrates that the compressed representations retain transfer learning capabilities across tasks.

By Poowanut Niamluang, Jittat Fakcharoenphol
arXiv Machine Learning
4d ago

High-Dimensional Partial Least Squares: Spectral Analysis and Fundamental Limitations

The paper investigates Partial Least Squares (PLS) in high-dimensional settings, focusing on a model where two data matrices share a low-rank latent structure plus individual-specific components. By analyzing the singular vectors of the cross‑covariance matrix with random matrix theory, the authors derive asymptotic characterizations of how well the estimated latent directions align with the true ones. They show that the PLS variant based on Singular Value Decomposition (PLS‑SVD) outperforms separate principal component analysis in detecting the common latent subspace, while also identifying regimes where PLS‑SVD behaves counter‑intuitively or reaches fundamental limits.

By Victor L\'eger, Florent Chatelain