Comment by samayashar

Great work by the author. Both Laya and Jev showcase how a different class of models can be efficient on tasks that don't require a 'generated output artifact'. I believe the same is true for VLMs where you're not always generating an image, but rather trying to understand more about the input image.

Token consumptions are flying through the roof and optimisation is the way forward.