Comment by starfallg
3 hours ago
This is a really good point that goes the other way as well. Some use cases are great for smaller and cheaper models, but it's not obviously when that's the case so I can bank the savings.
3 hours ago
This is a really good point that goes the other way as well. Some use cases are great for smaller and cheaper models, but it's not obviously when that's the case so I can bank the savings.
Very much so. Probably a lot of compute is being wasted on using SOTA models for tasks that can be done on way, way weaker models.