The paper introduces Drex, a family of four open-source decision models that output probability distributions over user-supplied options without autoregressive decoding. These models—ranging from 8B to 35B parameters—are trained with supervised fine-tuning, reinforcement learning from adjusted feedback, and vision tuning for the Max variant. Drex achieves state‑of‑the‑art performance on Decision Index and competitive results on Decision Bench, while delivering faster, more consistent responses than larger GPT‑style models.
arXiv:2609.37647v1 Announce Type: cross
Abstract: Jev is a commercial System One model from TypeSafe AI that does not generate text: given a state and typed questions, it returns a choice from fixed...
By Tobias Deu{\ss}er, Lorenz Sparrenberg, Rafet Sifa
Intern-Decision is a family of multimodal decision models (0.8B, 2B, and 4B parameters) that output structured choices and candidate probabilities directly from text and optional images, avoiding the latency of free‑form responses. The models use an autoregressive masked language modeling objective, placing one decision placeholder per field in a complete assistant JSON skeleton, and evaluate all fields in a single causal forward pass. The 4B variant achieves 90.02 % unweighted average accuracy across seven evaluation suites, with a mean latency of 44.16 ms on an RTX 4090 for a 289‑token request, and shows improved calibration and accuracy when combined with temperature scaling and confidence‑based handoff.
By Tong Zhu, Zhe Xu, Zefeng He, Yunkai Chai, Xuyang Hu, Dehong Zheng, Yun Luo, Yafu Li, Qi Zhang, Yu Cheng
EDU-Jev is a family of single‑pass decision models (0.8B, 2B, and 4B parameters) designed for educational tasks that require selecting from a fixed set of options. The models output a probability distribution over predefined choices without generating text, using a pointer head to score each option. In twelve education benchmarks, EDU‑Jev 4B achieved 67.6% accuracy, outperforming five commercial decision APIs by 9.4 percentage points and the best open 4B model by 18.7 points, while the 2B version can process about 150 decisions per second on a single H100 GPU.
By Jiazheng Li, Yulan He
Intern-Decision introduces 0.8B, 2B, and 4B multimodal decision models that output structured choices and probabilities directly from text and optional images, avoiding the latency of free‑form responses. The models use an autoregressive masked language modeling objective, placing decision placeholders in a JSON skeleton and evaluating all fields in a single causal pass. The 4B variant attains 90.02% unweighted accuracy across seven benchmarks, with sub‑45 ms latency on an RTX 4090, and demonstrates improved calibration and handoff performance in pilot studies.
The paper investigates how compact an encoder can be for closed‑set decision tasks in language‑model pipelines, comparing joint versus per‑option scoring. In a 32‑million‑parameter study, per‑option scoring outperforms joint scoring by 5.8 chance‑corrected skill points on a 37‑benchmark suite, and two external benchmarks corroborate this advantage. Across six released joint encoders ranging from 17 million to 1 billion parameters, the 68‑ and 150‑million‑parameter models surpass a 435‑million‑parameter DeBERTa‑v3 zero‑shot classifier on 209 overlapping tasks and match it on 145 unseen tasks, while the smallest model processes a median request in 14 ms versus 728 ms for the classifier.
By Tardelli Ronan Coelho Stekel