← Back to all news
arXiv AI By A. Emilie J. Wedenborg, Anders V. N{\o}rskov, Teresa Dorszewski, Kristoffer Wickstr{\o}m, Morten M{\o}rup

The Polytopal Neural Network

Read the original on arXiv AI →

The paper introduces Polytopal Neural Networks (PNNs), a framework that enforces a polytope-based structure on neural network representations to extract distinct layer-wise aspects. By using learned corpus representations and an amortized simplex inference procedure, PNNs preserve meaningful latent structures with minimal performance loss and yield compressed representations comparable to vector‑quantized (VQ) methods. The authors demonstrate that PNNs provide a new, interpretable approach to VQ deep learning training while maintaining competitive performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

Hugging Face Trending Papers
Jul 24

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining. Past research has demonstrated that quantization largely preserves classification accuracy; however, whether it also preserves the model's internal reasoning remains an open question.

efficiencysafety
More like this →
arXiv Machine Learning
Jul 28

Same Predictions, Different Reasons: The Effect of Quantization on Model Explanations

arXiv:2607. 22872v1 Announce Type: new Abstract: Post-training quantization (PTQ) has become a practical solution for deploying deep learning models on resource-constrained edge devices by compressing high-precision floating-point weights into low-precision representations without requiring retraining.

By Kazi Kamruzzaman Rabbi, Md. Zami Al Zunaed Farabe, M. Sohel Rahman
efficiencysafety
More like this →
arXiv AI
2d ago

Predicate Neuron: Differentiable Quantization of Predicate Relations in Gradient-based Learning

The paper introduces the Native Predicate Neuron, a differentiable logic‑reasoning module that can be inserted into standard neural architectures. It learns to alternate between logical operations using a single trainable parameter and employs a dual‑nature gradient mechanism that performs hard logical operations during training while remaining differentiable for backpropagation. Experiments on Fully‑Connected, Convolutional, Recurrent, and Transformer models show that adding Predicate Neurons speeds convergence, improves accuracy, and reduces loss, especially on tasks involving monotonic reasoning or discontinuities.

By Ioannis Konstantoulas, Iliana Loi, Kyriakos Sgarbas
llmsefficiencybenchmarks
More like this →