Comment by jacquesm

Yes, you are right, and I was too optimistic. I'd have to level up.

This is the stuff I've put together and it is clearly too small for this:

https://jacquesmattheij.com/local-inference-with-large-langu...