arXiv Machine Learning

Mathematical Principles and Experimental Discoveries of the Emergence of Symbolic Patterns in Artificial Neural Networks

arXiv:2608. 06839v1 Announce Type: new Abstract: Artificial Neural networks (ANNs) are often treated as black-box models, making explainability a central challenge in deep learning.

arXiv AI
Jul 24

From Noise to Diversity: Random Embedding Injection in LLM Reasoning

arXiv:2605. 11936v2 Announce Type: replace Abstract: Recent soft prompt research has tried to improve reasoning by inserting trained vectors into LLM inputs, yet whether the gain comes from the learned content or from the act of injection itself has not been carefully separated.

By Heejun Kim, Seungpil Lee, Jewon Yeom, Jaewon Sok, Seonghyeon Park, Jeongjae Park, Taesup Kim, Sundong Kim
arXiv AI
Sep 2

Does Reasoning Mitigate Backdoor Attacks? A Neuro-Symbolic Perspective

The paper investigates whether neuro‑symbolic (NeSy) AI models, which combine neural perception with symbolic reasoning, can mitigate backdoor attacks. It presents a systematic evaluation comparing the NeSy framework DeepProbLog to baseline neural networks across eight backdoor settings and four reasoning tasks. Results indicate that NeSy models are generally more robust than pure neural models, but their resilience depends heavily on how strictly the reasoning process is enforced and its alignment with the attack target.

By Marco Antonio Corallo, Andrea Agiollo, Mauro Conti, Alberto Giaretta
arXiv AI
Jun 18

OrthoReg: Orthogonal Regularization for Hybrid Symbolic-Neural Dynamical Systems

arXiv:2606. 19145v1 Announce Type: cross Abstract: Dynamical systems are fundamental to modeling the natural world, yet modeling them involves a persistent trade-off: manually prescribed mechanistic models are interpretable by design but often overly simplistic and misspecified; in contrast, flexible data-driven neural methods lack physical insight.

By Till Richter, Niki Kilbertus