Comment by tbalsam
2 years ago
This is very cool but the use of the terms "Information Entropy" together as if they were a separate thing is maybe the furthest that any "ATM-machine"-type phrase has rustled my jimmies.
It is a cool article, just, wowzers, what a phrase.
are signal and noise the same thing?
grabs water spritzer
Stop that, now. Bad cat.
Yes, also no.
To be fair I think information entropy is more self descriptive than Shannon entropy
Corporate has asked you to find the differences between these two pictures.
They're two names which references the same concept, but Shannon entropy is not the only type of entropy. I mean maybe everything really is just Shannon entropy if you look deep enough and have a sufficiently powerful model of physics but we're not there today.
3 replies →
I mean, it's obviously not relevant here, but technically there is also heat entropy, isn't there? It's not always information.