← Back to all news
arXiv Machine Learning

Toward Machine Learning with the Unit as a Primitive: Learning from Unit-Linked Events

The paper proposes treating the ‘unit’—a persistent referent that multiple events may refer to—as an explicit primitive in machine learning tasks. It formalizes supervised learning as learning a pair of a tokenizer that generates a contextual unit token and a shared response law that uses this token, thereby distinguishing homogeneous from heterogeneous worlds. The work also introduces concepts such as unit abduction and trusted resolvers to handle cases where unit identity is unresolved.

Related stories

arXiv AI
Sep 1

Wide Learning: Learning to Reach Evidence

The paper introduces the concept of Wide Learning, which examines how a learner’s internal state can expand its ability to generate informative evidence under fixed resources and primitive affordances. By formalizing effective epistemic reach—defined by learner state, deployment budget, reliability threshold, and evaluation distribution—the authors demonstrate, through a controlled construction, that learning can significantly alter the probability of successfully realizing a diagnostic that was previously unlikely. The study shows that even with identical observable laws, a calibrated learner can achieve perfect diagnostic realization, highlighting the impact of learning on the scope of attainable evidence.

By Junzhou Chen
More like this →
arXiv AI
Aug 24

World models of environment, agent and joint agent-environment systems

The paper introduces a framework that distinguishes world models by the channel they represent—environment, agent, or joint agent‑environment—using computational mechanics to define canonical predictive models as ε-transducers or ε-machines. It shows how closed‑loop coupling induces support‑restricted models whose states factor through the joint causal states, and demonstrates with a POMDP example that such restriction can reduce an otherwise infinite‑state environment model to a finite one.

By Manuel Baltieri, Filippo Torresan, Yivan Zhang, Alexander Boyd, Fernando E. Rosas
agentsreinforcement-learning
More like this →
arXiv Machine Learning
Sep 3

IDEEA: training-free Input-Dependent stEEring via Activation cluster matching

IDEA is a training‑free, input‑dependent steering method for large language models that matches activations to cluster‑specific directions aligned with a target concept. It clusters positive and negative activation supports per attention head, solves an optimal‑matching problem to create a pool of cluster‑conditional directions, and selects the best match for each input at inference time. This approach preserves the input’s original representation while improving the truth × info rate on TruthfulQA by an average of 9.9% (up to 23.5%) over input‑independent baselines.

By Zheng Wang, Muchen Li, Renjie Liao, Yan Leng
llmsreinforcement-learningfine-tuningsafety
More like this →
arXiv AI
Jul 3

Purified OPSD: On-Policy Self-Distillation Without Losing How to Think

arXiv:2607. 02234v1 Announce Type: new Abstract: On-policy self-distillation (OPSD) has emerged as a promising paradigm for improving LLM reasoning, where a privileged teacher with access to reference solutions provides token-level supervision on the student's own generated trajectories.

By Zhanming Shen, Jintao Tong, Shaotian Yan, Chen Shen, Hao Chen, Wentao Ye, Xiaomeng Hu, Rui Miao, Haobo Wang, Junbo Zhao, Gang Chen, Jieping Ye
llmsefficiency
More like this →