Comment by whazor

A competitive coding like devstral 2 runs fast enough to be very helpful: https://www.hardware-corner.net/devstral-2-hardware-requirem...

The required hardware is fits the budget for a professional developer.

Putting LLMs in the cloud allows the hardware to be utilised better and to have sharding of big models.