dukehoff-decide: Typed, Calibrated Decisions from Small Language Models

Author: Anton Epple

Original post on Foojay: Read More

Many LLM calls in Java apps are multiple choice. dukehoff-decide answers them with a small local model and returns a typed value with calibrated probabilities.