Hugging Face Trending Papers
PsyJev: Psychological Analysis via System-1 Judgment
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Oct 28
PsyJev: Psychological Analysis via System-1 Judgment
The paper introduces PsyJev, a System‑1 model for psychological analysis that directly outputs distributions over answers conditioned on questions. It leverages the PsyJudgeBench benchmark, which contains 13 annotated datasets and 82 questions across six psychological domains, and employs a joint supervised training followed by Judgment‑Anchored RLCD to adapt logit‑space reward optimization. Experiments on Qwen3.5‑based models show that the 9B variant achieves an average test F1 of 67.56, outperforming the strongest external baseline by 2.54 points.
Hugging Face Trending Papers
Jun 25
Ask, Don't Judge: Binary Questions for Interpretable LLM Evaluation and Self-Improvement
Evaluating LLM outputs remains a major bottleneck in NLP: human evaluation is expensive and slow, lexical metrics correlate poorly with human judgments on open-ended generation, and holistic LLM judges often produce opaque scores that are hard to debug. We propose BINEVAL, a framework that decomposes evaluation criteria into atomic binary questions and aggregates the resulting verdicts into interpretable, multi-dimensional scores.
arXiv AI
Jun 26
Ask, Don't Judge: Binary Questions for Interpretable LLM Evaluation and Self-Improvement
arXiv:2606. 27226v1 Announce Type: new Abstract: Evaluating LLM outputs remains a major bottleneck in NLP: human evaluation is expensive and slow, lexical metrics correlate poorly with human judgments on open-ended generation, and holistic LLM judges often produce opaque scores that are hard to debug.
arXiv AI
Oct 7
EnGRICH: Enhancing Generative Reward Modeling with Critiques from Humans
arXiv:2610.05370v2 Announce Type: replace Abstract: Generative reward models (GRMs) are important for LLM optimization. Unlike scalar reward models, GRMs generate natural-language critiques alongside...
arXiv Computation and Language
Sep 1
Small Language Models as Judges for Rubric-Based Reinforcement Learning
arXiv:2608.30005v1 Announce Type: new Abstract: Rubric-based reinforcement learning extends RL beyond tasks with exact answers or rule-based verifiers by scoring responses against instance-specific c...
arXiv AI
Jun 6
Improving Heart-Focused Medical Question Answering in LLMs via Variance-Aware Rubric Rewards with GRPO
arXiv:2606. 05174v1 Announce Type: cross Abstract: Large Language Models (LLMs) have shown strong promise in healthcare applications.