← Back to context Comment by ranger_danger 4 months ago There is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_... 3 comments ranger_danger Reply dTal 4 months ago 404 ranger_danger 4 months ago Looks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma...After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp.Edit: This one has now been deleted as well for some reason... ranger_danger 4 months ago Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5
dTal 4 months ago 404 ranger_danger 4 months ago Looks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma...After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp.Edit: This one has now been deleted as well for some reason... ranger_danger 4 months ago Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5
ranger_danger 4 months ago Looks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma...After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp.Edit: This one has now been deleted as well for some reason... ranger_danger 4 months ago Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5
ranger_danger 4 months ago Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5
404
Looks like it was deleted, here is another https://huggingface.co/DJLougen/talkie-1930-13b-GGUF/tree/ma...
After downloading, it looks like it uses a custom "talkie" model architecture that is not supported at least by llama.cpp.
Edit: This one has now been deleted as well for some reason...
Update: here is a patched llama.cpp and quantized model for desktop use: https://github.com/solwyc/talkie-1930-13b-it-q5