Don’t Classify—Hallucinate (Then Match): A Cheaper Way to Hit Your Real Taxonomy
Structured outputs work great until your taxonomy turns into a giant schema. A cheaper pattern is to ask a small model to hallucinate plausible category candidates, then map those candidates back to your real taxonomy using embeddings and vector similarity.
