← Back to context

Comment by duskwuff

15 hours ago

> So if you detect usage of 3-byte encodings, chances are you'll continue encountering only 3-byte encodings, with the odd ASCII or emoji codepoints.

Depends on what kind of text you're processing. Many languages use the ASCII range for spaces/newlines, digits, and punctuation.