Comment by dmayle
10 days ago
Did you finetune it before trying? Docs here:
https://ai.google.dev/gemma/docs/core/huggingface_text_full_...
10 days ago
Did you finetune it before trying? Docs here:
https://ai.google.dev/gemma/docs/core/huggingface_text_full_...
How well does using a SOTA model for fine-tuning work? I'm sure people have tried
Thanks, will check that out as well tomorrow or during the weekend!
If you know you want JSON for sure constrained decoding in an inference framework will help. The model is just one part of an overall inference system. I hope this model paired with other tools help you get done whatever it is you're looking to get done