Comment by FlyingLawnmower
21 days ago
Very nicely written guide!
If the authors or readers are interested in some of the more technical details of how we optimized guidance & llguidance, we wrote up a little paper about it here: https://guidance-ai.github.io/llguidance/llg-go-brrr
One of the authors here. I've read the paper. Brilliant work, especially the slicing implementation for denser token masks.