Comment by smcleod

Just 4K. Because deepseek doesn't allow for the use of flash attention it means you can't run quantised qkv