Teaching LLMs to express uncertainty in words
AI Impact Summary
Introducing a capability for language models to express uncertainty in their outputs. This will influence how responses are constructed, with explicit phrases or qualifiers indicating confidence. Teams must adapt prompts, response schemas, and evaluation metrics to handle uncertainty signals, and plan UI and logging changes to present and audit these cues without compromising safety.
Business Impact
Applications will start receiving responses that include explicit uncertainty cues, enabling better user decision-making, but will require UI/UX updates and data handling to present and interpret confidence signals correctly.
Risk domains
Source text
- Date
- Date not specified
- Change type
- capability
- Severity
- medium