arXiv Machine Learning By Juan S. Santillana

VX-One: Typed, Calibrated Decision Heads for Real-Time Perimeter Triage - An empirical study of unknown-attack honesty, cascade gray zones, and calibration under drift

Read the original on arXiv Machine Learning →

VX‑One is a small multi‑head neural network that outputs typed, calibrated decision primitives— a calibrated gate, a closed‑set choice with an explicit unknown option, and an ordinal score—trained in a multi‑task, temperature‑calibrated manner. In experiments on UNSW‑NB15, CIC‑IDS2017, and EMBER2024, VX‑One outperforms traditional models on detection metrics and achieves high recall when combined with a signature engine in a two‑phase cascade, though its calibration degrades under temporal drift and it struggles with multi‑class attribution. The study provides a detailed empirical assessment of where such typed, calibrated decisions aid perimeter triage and where they fall short.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 3

Benchmarking System One decision models against trained classifiers and language models for automated decision gates

The paper evaluates System One decision models—typed models that output probabilities for branching decisions—against supervised classifiers and generative language models on automated decision gate tasks. Eight checkpoints from six families, including the hosted model Jev, were benchmarked on workflow, intent, and social‑science items, showing that small trained classifiers match or slightly outperform decision models on intent and workflow when labels are available, while decision models outperform zero‑shot classifiers when labels are absent. The study also explores calibration, risk thresholds, and cost‑efficiency trade‑offs, providing condition‑dependent design guidelines for automated decision gates.

By Amir Rafe, Subasish Das