Comment by albertzeyer
2 years ago
This is frequently a topic here on HN. E.g.:
https://news.ycombinator.com/item?id=35543774
There is a lot more. Just google for "deep learning", and you'll find a lot of content. And most of that will cover attention, as it is a really basic concept now.
Thanks for the udl book (Understanding Deep Learning), that looks like a really great starting point.