The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Intern-Decision is a family of multimodal decision models (0.8B, 2B, and 4B parameters) that output structured choices and candidate probabilities directly from text and optional images, avoiding the latency of free‑form responses. The models use an autoregressive masked language modeling objective, placing one decision placeholder per field in a complete assistant JSON skeleton, and evaluate all fields in a single causal forward pass. The 4B variant achieves 90.02 % unweighted average accuracy across seven evaluation suites, with a mean latency of 44.16 ms on an RTX 4090 for a 289‑token request, and shows improved calibration and accuracy when combined with temperature scaling and confidence‑based handoff.
System1-Arena is a benchmark that evaluates which decisions can be handled by System‑1 models—those that output probabilities in a single forward pass—versus System‑2 models that generate reasoning steps. It contains 92,000 questions across 105 tasks from 268 public sources, grouped into text classification, applied decisions, evaluation and control, and agent/action, and also includes 138 closed‑loop environments such as web shopping, coding control, robotics, games, and driving. The study tests 30 models, showing that large System‑1 models can match or exceed fast closed LLMs in non‑agentic accuracy with better‑calibrated probabilities at lower latency, while reasoning LLMs are most accurate but far more expensive, and large open LLMs perform best in closed‑loop settings.
The paper introduces a perception interface that separates vision from language in vision‑language models. A frozen perception stack detects objects, a deterministic semantic serializer converts the perceived state into text, and a standard text‑only large language model (LLM) answers questions. Experiments on a campus‑robot benchmark show that this serialized interface outperforms a zero‑shot VLM of the same language‑model size, especially as the language model shrinks, and that the advantage persists under paraphrase and different supervision regimes.
The paper evaluates System One decision models—typed models that output probabilities for branching decisions—against supervised classifiers and generative language models on automated decision gate tasks. Eight checkpoints from six families, including the hosted model Jev, were benchmarked on workflow, intent, and social‑science items, showing that small trained classifiers match or slightly outperform decision models on intent and workflow when labels are available, while decision models outperform zero‑shot classifiers when labels are absent. The study also explores calibration, risk thresholds, and cost‑efficiency trade‑offs, providing condition‑dependent design guidelines for automated decision gates.
Jev-LiteMAS is a multi‑agent framework that separates decision‑making from generative execution in large‑language‑model workflows. By using a lightweight decision model (Jev) to dynamically select experts and screen artifacts, it closes the planning and review gaps left by pure generative planners and reviewers. Experiments on four benchmarks show that Jev‑LiteMAS cuts generative‑LLM token usage by 12.7–54.6% while keeping accuracy within 1.34 percentage points and reducing latency in most settings.
arXiv:2608. 11739v1 Announce Type: cross Abstract: The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert.