Where confidence comes from
Reading how sure an LLM was of its answer, from the probabilities it already computed
Reading how sure an LLM was of its answer, from the probabilities it already computed
Grammars, one-letter choices, and an LLM that can only answer with a label from your list
Getting an LLM to return a value your code can branch on with a confidence you can act on
