Comment by cryptonector

Yes, that's what I say elsewhere. Digest some of the headers (not all) and the body. If you do it right you can even use that for dedup.