Hugging Face Blog February 23, 2024

Introducing the Red-Teaming Resistance Leaderboard

Read the original on Hugging Face Blog →

The Flow has not summarised this story yet — read it at Hugging Face Blog.

OpenAI Blog

Nov 21, 2024

Advancing red teaming with people and AI

Hugging Face Blog

Oct 4, 2024

Introducing the Open FinLLM Leaderboard

benchmarks

arXiv Machine Learning

Jul 30

GPT-Red: Automated Red Teaming via Self-Play at Scale

arXiv:2607. 26115v1 Announce Type: cross Abstract: We introduce \textbf{GPT-Red}, an automated red-teaming agent that is trained to discover novel prompt injection attacks against frontier LLMs.

By Eric Wallace, Christopher A. Choquette-Choo, Nikhil Kandpal, Sam Toyer, Dylan Hunn, Stephanie Lin, Yuxin Wen, Xiangyu Qi, Christopher Wolff, Zizhao Wang, Milad Nasr, Sicheng Zhu, Chuan Guo, Juan Felipe Cer\'on Uribe, Kaiwen Wang, Aiden Low, Kai Xiao, Kai Chen

llms agents reinforcement-learning safety

Hugging Face Blog

Dec 1, 2023