Comment by roywiggins

1 month ago

imho the prose is very ChatGPT unfortunately

> Residual connections are more than a trick to help gradients flow. They’re a conservation law.

> Not a hack, not a trick. A principled constraint that makes the architecture work at scale.