Comment by jimdavid

Did anyone check the token feature dimension? If we're talking about compression, "token length" is just one of the dimensions.