“Since the outputs are constrained to only a fixed set of options, the model can’t select anything outside of those.”
Strip the branding and a decision model is a classifier bolted onto an LLM. Vendors are pitching it as a new category. One blog post and a 1.7B model reproduce it. The catch is the confidence score. The model is badly overconfident until you rescale it, and that score is exactly what these products sell.
