Comment by mschild

Depends on your desktop specs and specific model.

The easiest way I have found is to use LM Studio, grab the model you want, and point whatever tooling you're using at the local exposed API.

You will have to configure the model params (temperature, etc) a bit to get the style you're expecting but it works decently well for me.