arXiv Computation and Language By Zheng Chen, Fei Yu, Haohao Huang, Yang Li, Anlong Chen, Lei Chen

SecJev: Bringing Security Expertise to System One Decision Models

Read the original on arXiv Computation and Language →

SecJev is a family of Jev-like decision models specialized for security, ranging from 0.8 B to 9 B parameters. Built on Kev’s single‑pass candidate scorer, it learns Boolean, choice, and ordered decisions from text, telemetry, and observation histories, and is trained on the SecJev‑Corpus that unifies source‑label prediction and explicit‑policy evaluation across 14 tasks and eight sources. The security specialization improves every model, with SecJev‑0.8B outperforming general Kev‑9B by 20.51 percentage points in task‑macro accuracy and matching generative fine‑tuning in accuracy and latency while using less peak inference memory.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 17

MiST: Mid-Training LLMs for Cybersecurity

MiST (Mid-trained Security Transformer) is a suite of 8B and 32B language models tailored for cybersecurity, achieving strong performance on public benchmarks. The approach uses a mid-training stage that adapts general pre-trained models to the domain by curating a compact, expert-vetted seed corpus and generating high-quality synthetic training data, rather than continual pre-training on large raw text. MiST checkpoints improve mean cybersecurity accuracy by +13.1 and +8.6 absolute percentage points over Qwen baselines for 8B and 32B models, respectively, and provide a stronger initialization for downstream task-specific fine-tuning and reinforcement learning.

By Oded Ovadia, Elad Ben Zaken, Elad Guttman, Orly Moreno Kadosh
arXiv Machine Learning
Oct 3

Benchmarking System One decision models against trained classifiers and language models for automated decision gates

The paper evaluates System One decision models—typed models that output probabilities for branching decisions—against supervised classifiers and generative language models on automated decision gate tasks. Eight checkpoints from six families, including the hosted model Jev, were benchmarked on workflow, intent, and social‑science items, showing that small trained classifiers match or slightly outperform decision models on intent and workflow when labels are available, while decision models outperform zero‑shot classifiers when labels are absent. The study also explores calibration, risk thresholds, and cost‑efficiency trade‑offs, providing condition‑dependent design guidelines for automated decision gates.

By Amir Rafe, Subasish Das