Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Smaller models really arent great at structured output. If this works it would be great for a local model that might not be as good but as long as it respects structured output will be vastly more useful.


We have a full benchmark breakdown specifically on structured output that you can take a look at https://interfaze.ai/leaderboards/structured-output-benchmar...


> Smaller models really arent great at structured output.

That doesn't seem to hold true. Consider gpt-5.4-nano which supports structured output just fine.

https://developers.openai.com/api/docs/models/gpt-5.4-nano

It seems like a concern that's orthogonal to the model size.


I genuinely doubt that they are just lying though lol




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: