Comment by ttoinou
1 year ago
Yeah basic math space transformation sandwich : 1) turn data into another space 2) operate in that space 3) transform back into original space. To optimize this, optimize each step and work as much as possible in the most efficient space
Remains to be seen how lossy the transformations are. We lose a lot of data in DSP (aka “media”) doing too much.
ReLU throws away half of data. Yet it works.