arXiv AI

Learning with Boolean threshold functions

arXiv Machine Learning
6d ago

Optimizing Sparse Boolean Rule Networks using Mixed Integer Linear Programming

The paper introduces mixed integer linear programming (MILP) formulations for training sparse disjunctive normal form (DNF) networks, which are small networks with a conjunctive hidden layer and a disjunctive output layer. By fixing the network structure and optimizing weights, the authors achieve globally optimized rule sets that balance misclassification costs against sparsity. Their enhanced formulation reduces integer decision variables and redundant constraints, and a combined initialization and dropout approach breaks weight symmetries to promote diverse, stable rule representations, leading to improved computational efficiency and competitive accuracy on synthetic and UCI datasets.

By Thomas Pammer, Johannes F\"urnkranz, Markus Sinnl
arXiv AI
Sep 15

Certifiably Interpretable Training of ReLU-MLPs for Boolean Tasks with Guaranteed Truth-Table Generalization

The paper introduces MACCHIATO, a training algorithm that builds a ReLU‑MLP from partial truth‑table data while simultaneously constructing an explicit Boolean circuit over AND, OR, and XOR gates that certifies the network’s computation. The method iteratively projects residuals onto low‑dimensional Boolean classes, compiles the resulting circuit into a ReLU‑MLP, and uses logic minimization and influence‑based variable selection to achieve a six‑layer network with provable truth‑table error bounds. Experiments on synthetic random‑junta tasks show that these certified networks outperform Adam‑trained MLPs in data‑sparse or projection‑aligned regimes and complete faster than flat ESPRESSO in certain settings.

By Hrad Ghoukasian, Anastasis Kratsios
arXiv Machine Learning
Sep 23

CAffNet: Hard Constraint-Affine Neural Networks

arXiv:2605.24437v2 Announce Type: replace Abstract: We present a novel framework for embedding hard constraint satisfaction into neural network (NN) architectures, specifically feedforward neural net...

By Yang Zhao, Jungeun Lee, Jeong hwan Jeon, Sze Zheng Yong
arXiv Machine Learning
5d ago

Compiling Multi-Threshold Operators for Quantized Non-Monotonic and Fine-Granular Activations in Custom-Tailored DNN Accelerators

The paper presents a method for compiling multi‑threshold operators that support quantized, non‑monotonic, and fine‑granular activation functions in custom DNN accelerators. It extends the multi‑threshold representation to multi‑dimensional thresholds, integrates algebraic conversion rules into an ONNX‑based compiler, and validates the approach on both monotonic and non‑monotonic functions using the FINN framework. The authors also characterize hardware costs compared to graph‑level decomposition and discuss potential use in quantization‑aware training.

By Christoph Berganski, Felix Jentzsch, Marco Platzner