Comment by danielhanchen
2 days ago
Oh ok sorry maybe I misunderstood sorry! I actually found my partial work I did for precompiled binaries! https://huggingface.co/datasets/unsloth/precompiled_llama_cp...
I was trying to see if I could pre-compile some llama.cpp binaries then save them as a zip file (I'm a noob sorry) - but I definitely need to investigate further on how to do python pip binaries
https://docs.astral.sh/uv/guides/package/#publishing-your-pa...
Oh thanks - we currently use Pypi so pip install works - https://pypi.org/project/unsloth/
But I think similarly for uv we need a setup.py for packaging binaries (more complex)