Structured Outputs
Problem
You ask an LLM:
Give me customer name and invoice number.
It responds:
“Certainly! The customer appears to be Alice…”
Your software expected fields, not prose.
Solution — Structured Output
Require output conforming to a defined schema.
{
"customer": "Alice",
"invoice": 4711
}
Core idea: structured outputs make probabilistic model responses reliably consumable by software.