Comment by montebicyclelo
2 years ago
Reverse-mode automatic differentiation from scratch, in Python - https://sidsite.com/posts/autodiff/
Notes on training BERT from scratch on an 8GB consumer GPU - https://sidsite.com/posts/bert-from-scratch/
How the BPE tokenization algorithm used by large language models works - https://sidsite.com/posts/bpe/
No comments yet
Contribute on Hacker News ↗