← Back to context Comment by pulse7 2 days ago It there anything similar for RTX 3090 and RTX 4090? 3 comments pulse7 Reply mmlkrx 2 days ago I'm not sure about a 4090 but there is a fork for 3090s: https://github.com/Don-Chad/ninfer-3090 ixaxaar 2 days ago I'm running it using a 4090 on using llama.cpp with Q5_K_S and its running at ~33 t/s mirekrusin 2 days ago [dead]
mmlkrx 2 days ago I'm not sure about a 4090 but there is a fork for 3090s: https://github.com/Don-Chad/ninfer-3090
ixaxaar 2 days ago I'm running it using a 4090 on using llama.cpp with Q5_K_S and its running at ~33 t/s
I'm not sure about a 4090 but there is a fork for 3090s: https://github.com/Don-Chad/ninfer-3090
I'm running it using a 4090 on using llama.cpp with Q5_K_S and its running at ~33 t/s
[dead]