Comment by mhitza

You can get rigid output format from "classic" LLMs https://docs.vllm.ai/en/latest/features/structured_outputs/ though model support is limited.

Would like to have something like in the original post but open weights.