Comment by adastra22 11 days ago What’s the best open source alternative? 4 comments adastra22 Reply jckahn 11 days ago Jan: https://www.jan.ai/ PeterStuer 10 days ago LibreChat with vLLM?https://www.librechat.ai/docs/configuration/librechat_yaml/a... khimaros 11 days ago llama.cpp atwrk 10 days ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
PeterStuer 10 days ago LibreChat with vLLM?https://www.librechat.ai/docs/configuration/librechat_yaml/a...
khimaros 11 days ago llama.cpp atwrk 10 days ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
atwrk 10 days ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
Jan: https://www.jan.ai/
LibreChat with vLLM?
https://www.librechat.ai/docs/configuration/librechat_yaml/a...
llama.cpp
To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.