Comment by kgeist

I'm currently evaluating GLM and oh boy, lots of correctness issues on large contexts if you run it on vLLM (bugs in the engine itself). I wonder what their config is.