← Back to context Comment by kubb 18 hours ago The money will go to LLMs. 6 comments kubb Reply dgellow 18 hours ago Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested kubb 18 hours ago You will need 100s of billions to make a viable POC. AlexCoventry 14 hours ago You only need to train a range of small models in order to establish a plausible scaling law, IMO. dgellow 17 hours ago For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude 2 replies →
dgellow 18 hours ago Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested kubb 18 hours ago You will need 100s of billions to make a viable POC. AlexCoventry 14 hours ago You only need to train a range of small models in order to establish a plausible scaling law, IMO. dgellow 17 hours ago For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude 2 replies →
kubb 18 hours ago You will need 100s of billions to make a viable POC. AlexCoventry 14 hours ago You only need to train a range of small models in order to establish a plausible scaling law, IMO. dgellow 17 hours ago For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude 2 replies →
AlexCoventry 14 hours ago You only need to train a range of small models in order to establish a plausible scaling law, IMO.
dgellow 17 hours ago For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude 2 replies →
Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested
You will need 100s of billions to make a viable POC.
You only need to train a range of small models in order to establish a plausible scaling law, IMO.
For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
2 replies →