Comment by isaacfrond
3 hours ago
> Surely researchers like this have the processing power to run them at home,
Nobody has that power. Certainly not mathematicians.
3 hours ago
> Surely researchers like this have the processing power to run them at home,
Nobody has that power. Certainly not mathematicians.
Yes people have to service the use case of a single person. All sorts of models exist that are designed to be ran at home. Yes, you need a relatively beefy graphics card for it but if your machine can handle the latest video games at good graphics it can handle these local models. How well they compare against these things remains to be seen but apparently OpenAI released gpt-oss-20b which is comparable to o3-mini apparently in terms of reasoning power. There's also oss-120b which does require at least a company server to run but this should well be within the budget of a university.