Comment by viraptor
2 months ago
There's still the question of whether they will try to change the architecture before they die. Using RWKV (or something similar) would drop the costs quite a bit, but will require risky investment. On the other hand some experiment with diffusion text already, so it's slowly happening.
No comments yet
Contribute on Hacker News ↗