← Back to context

Comment by godelski

3 months ago

There's an encoding, processing, and decoding element to this.

The encoding puts the information into latent vector representations. Then the information is actually processed in this latent space. You are working on highly compressed data. Then there's decoding which brings it back to a representation we understand. This is the same reason you can highly train on one language and be good at translation.

This is over simplified as everything is coupled. But it can be difficult to censor because the fun nature of high dimensional spaces in addition to coupling effects (superposition)