arXiv Computation and Language
4d ago

Keepace.ai: A Technical Report on a Large Language Model for Sports and Health

Keepace.ai is a domain‑specialized large language model for sports and health, built on Qwen3.5‑27B through post‑training. It is optimized for Chinese‑language exercise guidance across three tasks: workout plan generation, sports‑and‑health knowledge QA, and personal sports data analysis. Internal rubric‑based evaluations with domain experts show that Keepace outperforms its base model and larger general‑purpose baselines, especially in exercise safety, boundary compliance, structured output completeness, and scientific accuracy.

By ai Team, Bowen Wu, Heng Wang, Jufeng Mi, Kang Liu, Kun Li, Ling Man, Long He, Suli Fan, Xiaosen Jiang, Yi Wang, Ying He, Yu Tang, Yunhan Li, Zifang Liu
arXiv AI
Oct 27

Health-SCORE: Towards Scalable Rubrics for Improving Health-LLMs

Health‑SCORE is a scalable rubric‑based framework designed to evaluate and train health‑focused large language models (LLMs). It reduces the need for extensive human expertise and development cost while maintaining evaluation quality comparable to human‑created rubrics. The framework also serves as a structured reward signal for reinforcement learning and can be embedded in prompts to enhance response quality via in‑context learning.

By Zhichao Yang, Sepehr Janghorbani, Dongxu Zhang, Jun Han, Qian Qian, Andrew Ressler II, Gregory D. Lyng, Sanjit Singh Batra, Robert E. Tillman
arXiv AI
Jul 28

OpenAIs HealthBench in Action: Evaluating an LLM-Based Medical Assistant on Realistic Clinical Queries

arXiv:2509. 02594v3 Announce Type: replace-cross Abstract: Evaluating large language models (LLMs) on their ability to generate high-quality, accurate, situationally aware answers to clinical questions requires going beyond conventional benchmarks to assess how these systems behave in complex, high-stakes clinical scenarios.

By Sandhanakrishnan Ravichandran, Shivesh Kumar, Rogerio Corga Da Silva, Miguel Romano, Reinhard Berkels, Michiel van der Heijden, Olivier Fail, Valentine Emmanuel Gnanapragasam