arXiv Machine Learning By Zhou Lu

An Order-Theoretic Characterization of Consistent Inductive Inference

Read the original on arXiv Machine Learning →

The paper presents an order-theoretic characterization of consistent inductive inference for arbitrary binary hypothesis classes. It shows that consistency—making only finitely many prediction errors on any infinite sequence labeled by an unknown hypothesis—can be captured by a single linear order on finite realizable traces. This order must satisfy two conditions: conflicting traces select different least subtraces, and the order is well‑founded on traces of each fixed target, enabling a learner whose evidence decreases with each mistake. Conversely, any consistent learner induces such an order via canonical mistake transcripts and the Kleene–Brouwer ordering.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 19

Pessimistic Meta-Induction and Its Limits: Lessons from Frequentist Statistics and Machine Learning Theory

The paper titled "Pessimistic Meta-Induction and Its Limits: Lessons from Frequentist Statistics and Machine Learning Theory" critiques the pessimistic meta-inductive argument against scientific realism by attacking its inductive step rather than its historical premise. It introduces a new challenge, drawing on frequentist statistics, machine learning, and formal epistemology to assess induction through convergence to truth. The authors argue that ordinary enumerative induction can achieve convergence everywhere, whereas meta-induction fails to achieve even almost everywhere convergence, and in contexts where meta-induction applies, no inference method can achieve almost everywhere convergence.

By Hanti Lin
Hugging Face Trending Papers
Jun 2

ZX-Calculus:Trace-Indexed Dependent Types and Epistemic Semantics

We propose ZX-Calculus (Knowledge Evolution Calculus), a conservative extension of Martin-Lof Dependent Type Theory (MLTT) integrating trace-indexed types, presheaf non-monotone semantics, and constructive AGM belief revision. A Coq mechanisation accompanies the paper (34 complete proofs; zero admits for the two central results).

arXiv AI
4d ago

Position: Let's Strengthen Verifiability If We Can't Enforce Reproducibility

The paper argues that empirical results in Machine Learning are often difficult to reproduce due to limited availability of code and supporting materials, which hampers research progress. It analyzes and quantifies these challenges and proposes concrete measures to enhance the verifiability of results, even if full reproducibility cannot be guaranteed. The authors provide their code and supporting resources on GitHub for reference.

By Samet Hicsonmez, Nermin Samet, Renaud Marlet
arXiv AI
Aug 12

How to Verify Consistency of Probabilistic Claims

arXiv:2608. 11181v1 Announce Type: cross Abstract: When a probabilistic predictor answers many conditional-probability queries, are its answers self-consistent, and can this be verified in polynomial time?

By Orr Paradise, Oliver Richardson, Yoshua Bengio, Shafi Goldwasser
arXiv AI
Sep 10

How to Verify Probabilistic Consistency of Predictive Models

The paper presents an interactive probabilistically checkable proof (PCP) protocol that allows a polynomial‑time verifier to check the approximate consistency of a probabilistic predictor defined by two circuits, P and Q. By evaluating these circuits at a few points and querying a proof oracle that encodes a witnessing probability distribution, the verifier can confirm that the predictor’s many conditional‑probability claims are self‑consistent. The authors also establish that the problem of verifying l₂‑approximate consistency for explicit probabilistic claims lies in NP, with certificates of size O(mn + log B), and show how to eliminate dependence on the input bit‑precision B through a small additive gap.

By Orr Paradise, Oliver Richardson, Yoshua Bengio, Shafi Goldwasser