Comment by moralestapia
2 months ago
No, that intuition is incorrect.
Denoising models work because a lot of regions turn out to be smooth, you cannot do that "in a discrete way" if that makes sense.
2 months ago
No, that intuition is incorrect.
Denoising models work because a lot of regions turn out to be smooth, you cannot do that "in a discrete way" if that makes sense.
Feel free to give a better explanation. I am not an expert. Clearly denoising models do work on text though.
This one's closer to the thing.
https://news.ycombinator.com/item?id=44059646
They may be smooth in embedding space