Falcon Perception-HD: High Density Perception via Reinforcement Learning

Falcon Perception-HD applies reinforcement learning (GRPO) to autoregressive perception models, aligning them directly with precision and recall metrics rather than relying on maximum‑likelihood fine‑tuning. The RL framework introduces reward design for set‑structured outputs and multi‑head sampling control, enabling state‑of‑the‑art performance in very dense scenes (up to 500 objects) and eliminating common issues such as mask repetitions, NMS, and coordinate deduplication. Hybrid self‑annotation pipelines tailored for difficult referring expressions and dense scenes further boost RL training, with improvements observed across all difficulty levels on PBench and SACO‑Gold, and the model preserves object existence knowledge without negative samples.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

• computer-vision
• reinforcement-learning
• fine-tuning
• benchmarks