Comment by nateb2022
4 months ago
There's no GGUF available, but the process shouldn't be too hard from the provided .ckpt PyTorch checkpoint.
4 months ago
There's no GGUF available, but the process shouldn't be too hard from the provided .ckpt PyTorch checkpoint.
There is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_...
404
Looks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma...
After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp.
Edit: This one has now been deleted as well for some reason...
1 reply →