Comment by jnwatson

2 hours ago

Oh I didn't; only a distilled 27B model ran locally. This was just to figure out if distilling caused the problem.

0 comments