Comment by hexomancer
14 days ago
This is false. The const of producing a single token is linear but the cost of producing an entire sequence of length N is O(N^2) still (which is always what we meant when we talked about quadratic cost not the cost of a single token).
No comments yet
Contribute on Hacker News ↗