Comment by esseph

4 hours ago

Who was training LLMs on residential AMD GPUs?

I am. Most models that can be run locally have extraordinarily out of date training data for certain frameworks that predate breaking changes and important features, so their docs and API schemas need to be put into LoRAs.