Comment by adastra22 1 day ago What’s the best open source alternative? 4 comments adastra22 Reply jckahn 1 day ago Jan: https://www.jan.ai/ PeterStuer 4 hours ago LibreChat with vLLM?https://www.librechat.ai/docs/configuration/librechat_yaml/a... khimaros 18 hours ago llama.cpp atwrk 9 hours ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
PeterStuer 4 hours ago LibreChat with vLLM?https://www.librechat.ai/docs/configuration/librechat_yaml/a...
khimaros 18 hours ago llama.cpp atwrk 9 hours ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
atwrk 9 hours ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
Jan: https://www.jan.ai/
LibreChat with vLLM?
https://www.librechat.ai/docs/configuration/librechat_yaml/a...
llama.cpp
To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.