Comment by ontouchstart

4 days ago

I still have trouble to get unsloth studio setup working on my MacBook because of Python tooling issues.

However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases:

https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2...

https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9...

Very interesting.

Will do it again next week if I can get unsloth studio working.

4 comments

ontouchstart

Reply
danielhanchen  4 days ago

If you can try again we just updated the process sorry! We did a new pypi release:

curl -LsSf https://astral.sh/uv/install.sh | sh

uv venv unsloth_studio --python 3.13

source unsloth_studio/bin/activate

uv pip install unsloth==2026.3.7 --torch-backend=auto

unsloth studio setup

unsloth studio -H 0.0.0.0 -p 8888