← Back to context Comment by adastra22 21 hours ago What’s the best open source alternative? 4 comments adastra22 Reply PeterStuer 3 hours ago LibreChat with vLLM?https://www.librechat.ai/docs/configuration/librechat_yaml/a... jckahn 20 hours ago Jan: https://www.jan.ai/ khimaros 16 hours ago llama.cpp atwrk 8 hours ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
PeterStuer 3 hours ago LibreChat with vLLM?https://www.librechat.ai/docs/configuration/librechat_yaml/a...
khimaros 16 hours ago llama.cpp atwrk 8 hours ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
atwrk 8 hours ago To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.
LibreChat with vLLM?
https://www.librechat.ai/docs/configuration/librechat_yaml/a...
Jan: https://www.jan.ai/
llama.cpp
To add a few more details: llama.ccp now both has a web ui out of the box that even supports model switching, and easy model file downloads from huggingface using the cli: '-hf name_of_model:the_quant_you_want'.