Comment by jiggawatts

Sure, but the end-state of this isn't just chat bots! Bipedal robots are the real target application for this technology, and at least three big players have invested many billions each into base model training. The "GPT 2 moment" for robotics will happen likely later this year, next year at the latest. Then, the company that scales up from there to the equivalent of GPT 3.5 -- the first properly useful model -- can start selling androids by the tens of millions.

It'll be the next automobile, every well-to-do household will want one eventually. Every hospital, to assist/replace nurses. Every retirement home for the same reason.

Japan and China alone, with their ageing populations in dire need of nursing, will easily pay for the investment with that one use-case.