Comment by formerly_proven
2 hours ago
Open weight models are kind of weird because they're usually just a bunch of weights and maybe a chat template, not even test vectors or anything. Quite odd, and probably one of the reasons why vllm, sglang, the llamas etc. so often produce buggy output. It's actually quite strange how little attention is given to verifying these setups work.
Why cant the community piece together the open-weights using open community-based like, implementation or whatever magic sauce integrates those weights