Comment by tonyhart7
1 day ago
there is no open source alternative to GPU farm, that's the moat
that's why they can open source their model and be fine because running this shit is actually hard, let alone maintaining SLA for millions of users??
1 day ago
there is no open source alternative to GPU farm, that's the moat
that's why they can open source their model and be fine because running this shit is actually hard, let alone maintaining SLA for millions of users??
How long until laptops are able to run high end models? What's the use case that requires a server farm for end user's?
maybe next 5 - 10 years??? but even then the frontier would be push further and people would get used to lets say 10 trillion model cloud host and using 600B model would feel stupid