Comment by WithinReason 2 months ago I made an explicit reverse pass (no autodiff), it was 8x faster in Python 6 comments WithinReason Reply hu3 2 months ago I made an explicit double-reverse pass (no code!), it was 80x faster in my head! spopejoy 2 months ago "I've got an ipod -- In My Mind"https://theonion.com/i-have-an-ipod-in-my-mind-1819584018/ WithinReason 2 months ago code here, it's just not interesting to look at:https://news.ycombinator.com/item?id=47220542 bear3r 2 months ago tradeoff worth naming: you avoid the autodiff graph overhead (hence the speedup), but any architecture change means rewriting every gradient by hand. fine for a pedagogical project, but that's exactly why autodiff exists. love2read 2 months ago Can you share a link? WithinReason 2 months ago https://www.ideone.com/VAz4NnDoesn't run inside IDEone due to the external download link, but you can copy&paste the code over
hu3 2 months ago I made an explicit double-reverse pass (no code!), it was 80x faster in my head! spopejoy 2 months ago "I've got an ipod -- In My Mind"https://theonion.com/i-have-an-ipod-in-my-mind-1819584018/ WithinReason 2 months ago code here, it's just not interesting to look at:https://news.ycombinator.com/item?id=47220542
spopejoy 2 months ago "I've got an ipod -- In My Mind"https://theonion.com/i-have-an-ipod-in-my-mind-1819584018/
WithinReason 2 months ago code here, it's just not interesting to look at:https://news.ycombinator.com/item?id=47220542
bear3r 2 months ago tradeoff worth naming: you avoid the autodiff graph overhead (hence the speedup), but any architecture change means rewriting every gradient by hand. fine for a pedagogical project, but that's exactly why autodiff exists.
love2read 2 months ago Can you share a link? WithinReason 2 months ago https://www.ideone.com/VAz4NnDoesn't run inside IDEone due to the external download link, but you can copy&paste the code over
WithinReason 2 months ago https://www.ideone.com/VAz4NnDoesn't run inside IDEone due to the external download link, but you can copy&paste the code over
I made an explicit double-reverse pass (no code!), it was 80x faster in my head!
"I've got an ipod -- In My Mind"
https://theonion.com/i-have-an-ipod-in-my-mind-1819584018/
code here, it's just not interesting to look at:
https://news.ycombinator.com/item?id=47220542
tradeoff worth naming: you avoid the autodiff graph overhead (hence the speedup), but any architecture change means rewriting every gradient by hand. fine for a pedagogical project, but that's exactly why autodiff exists.
Can you share a link?
https://www.ideone.com/VAz4Nn
Doesn't run inside IDEone due to the external download link, but you can copy&paste the code over