arXiv AI By Nikolaos Al. Papadopoulos, Konstantinos E. Psannis

Information-Theoretic Measures in AI: A Practical Decision Framework

Read the original on arXiv AI →

arXiv:2604. 23716v3 Announce Type: replace Abstract: Information-theoretic (IT) measures are ubiquitous in artificial intelligence: entropy drives decision-tree splits and uncertainty quantification, cross-entropy is the default classification loss, mutual information underpins representation learning and feature selection, and transfer entropy reveals directed influence in dynamical systems.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv AI
Jun 18

Information-Theoretic Measures in AI: A Practical Decision Guide

arXiv:2604. 23716v2 Announce Type: replace Abstract: Information-theoretic (IT) measures are ubiquitous in artificial intelligence: entropy drives decision-tree splits and uncertainty quantification, cross-entropy is the default classification loss, mutual information underpins representation learning and feature selection, and transfer entropy reveals directed influence in dynamical systems.

By Nikolaos Al. Papadopoulos, Konstantinos E. Psannis