HighCapability
OpenAI releases Falcon Perception model for open-vocabulary grounding
Action Required
Organizations need to evaluate and potentially adopt this new model for open-vocabulary grounding and segmentation tasks, considering its performance and the need for code migration.
AI Impact Summary
OpenAI is releasing Falcon Perception, a new 0.6B-parameter early-fusion Transformer model designed for open-vocabulary grounding and segmentation. This model excels at processing image patches and text in a single sequence, achieving 68.0 Macro-F1 on SA-Co, outperforming SAM 3. The model introduces PBench, a diagnostic benchmark to isolate performance gaps by capability, and releases Falcon OCR, a 0.3B-parameter model with high throughput.
OpenAI releases Falcon Perception model for open-vocabulary grounding
Affected Systems
Falcon Perception
- Date
- 1 Apr 2026
- Change type
- capability
- Severity
- high