OpenAI Blog

Upgrading the Moderation API with our new multimodal moderation model

Read the original on OpenAI Blog →

We’re introducing a new model built on GPT-4o that is more accurate at detecting harmful text and images, enabling developers to build more robust moderation systems.

Summary generated by The Flow from the publisher's feed. The full article lives at OpenAI Blog.

OpenAI Blog
Aug 15, 2023

Using GPT-4 for content moderation

We use GPT-4 for content policy development and content moderation decisions, enabling more consistent labeling, a faster feedback loop for policy refinement, and less involvement from human moderators.

arXiv AI
Jul 29

Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed

arXiv:2607. 24898v1 Announce Type: cross Abstract: State-of-the-art toxicity detectors for text-to-image generation adopt a one-size-fits-all approach: a single universal model applying fixed safety guidelines to all users.

By Xinnuo Xu, Anja Thieme, Daniela Massiceti, Ioana Tanase, Rita Marques, Melanie Fernandez Pradier, Martin Grayson, Camilla Longden, Cecily Morrison