Comment by stillpointlab
8 days ago
I don't think it is self-serving. Tao has stated plainly that he thought LLMs would go the route of assistants, like co-pilots. But what he feels now is that they are actually being engineered to be replacements. His claim is that the way OpenAI dropped these math results isn't "assisting" anyone, so we should all read between the lines.
Consider any man at his job, fighting the good fight. Your boss says "I've hired this man to assist you" and you are happy to finally have some help with your difficult task. Then one morning you come into work and see that the coming day’s work was done overnight by this other fellow. And the realization sinks in, he isn't there to help you, he is there to replace you.
In this view his reaction seems totally expected. I expect many professionals, e.g. doctors, lawyers, accountants, etc. will make this realization sooner or later. The companies are saying these tools will assist professionals, but in reality they are aiming to replace them.
> The companies are saying these tools will assist professionals, but in reality they are aiming to replace them.
If anyone doubts this, consider that Anthropic considers its TAM to exceed $30 trillion which is nearly the entire GDP of the US and 25% of the world GDP.
Only makes sense if they believe they will massively replace labor. Which, to their credit, they used to admit openly and publicly and only stopped because some crisis PR people told them "hey maybe you shouldn't say the quiet part out loud while the hoi polloi still have the power to stop this from happening".
Do their own hiring practices reflect that ambition? They sure seem to be recruiting a lot of humans for typical roles in business, legal, and engineering. If they want to flex the power of their models to automate human jobs, why not lead by example?
https://www.anthropic.com/careers/jobs
> They sure seem to be recruiting a lot of humans for typical roles in business, legal, and engineering.
They have practically infinite investor money to throw at salaries (lost in the noise of how much they are spending on compute) so why not use it for now to reach their goal as fast as possible?
My thesis isn't that they have already achieved the ability to replace massive amounts of the labor pool, just that that has to be their goal given their stated TAM.
> If they want to flex the power of their models to automate human jobs, why not lead by example?
They don't want to flex this. They realized (after a false start) that it is better for them to avoid talking about this in public.
That doesn't mean their goals changed, they just realized that flexing before the goal is achieved could endanger the goal being achieved through political backlash.
1 reply →
I’m not making a claim one way or the other about the intent of these companies, but if your product made labor 3x more productive, you could still easily justify a TAM of the entirety of US GDP, without resulting in anyone losing their jobs. Obviously, here in reality, AI does act as a near 1:1 replacement for people in some roles, so we should expect some job losses. But I don’t think there’s any reason we should expect the entire US labor force to be automated away any time soon, even taking these assessments at face value
You do realise Anthropic's management, after throwing its tantrums, gets a seeing to and has to do what its investors want? Which is pump up the valuation.
You're not this naive are you?
Amazing, truly.
Isnt OpenAI and specifically Altman openly talking about that being the goal?
> The companies are saying these tools will assist professionals, but in reality they are aiming to replace them.
They are openly saying that the goal is to replace humans and make humans obsolete. Like, literally openly. I am not saying I agree with that goal or find it realistic, but they do think so.
A few-minute search on Google shows that Altman has said a lot of contradictory things on the subject. A few quotes, as examples:
“AI won't replace humans. But humans who use AI will replace those who don't.”
vs
"Some areas in the job market will be 'just like totally, totally gone' as they're replaced by AI agents.”
and
“AI will probably replace most of the jobs people do today,”
The most recent position I could find says he has revised his earlier position on a total replacement due to the lagging adoption of AI in many industries. But I don't think there is a single position we can point to that they are "openly saying". It is fair to grant even the CEOs of these companies a change in position as they gain more information about capabilities and adoption, rather than insist that they hold, have held and will continue to hold fixed opinions.
The point is that Tao's understanding has changed. He may have been naive before, he may have heard in their words something he wanted to believe. Perhaps he was misled by people who he trusted that worked in the company. But now that he has more evidence, in the form of the maths drops and the way they have been handled, his suspension of disbelief no longer holds. The companies could have done this in a way that included mathematicians, so they chose not to. And that choice reveals their aims unambiguously in a way that a media-trained CEO or careful PR department can avoid.
That suggests that Tao is not being "self-serving" as others claim. He is saying that his optimism in the best-case scenario turned out to be incorrect.
The reason we fell first is because we embraced the copilots. We used them heavily, this gave them more and more training data on top of the code they slurped up from our using their assistants. Soon the assistant became the agent who killed the human.
They also had a rich starting point from open source code (which we somehow gave up without realising it). All of this won't happen as efficiently for these other fields, but it will happen, much in the way you've described. We (swes) turned out to be a rather dumb group of people, which is hilarious since we think we're clever.
The only moat we have is the human to human element, we need to talk to other humans in the business. Customers, etc. But once they're replaced by machines or automation, then machine to machine communication will be the preferred mode of communication and work and the legacy humans will be increasingly cut out of the loop. Human in the loop is a death sentence we just don't realise it.
>Tao has stated plainly that he thought LLMs would go the route of assistants, like co-pilots.
As one of the smartest people in the world, he is so naive to believe that those capitalists will stop at that.
Tenured at age 24, I doubt he has any experience in industry to understand what he was getting into. Which makes me even more incredulous as to why people worship him.
> But what he feels now is that they are actually being engineered to be replacements
lol. lmao even.
I guess there is a first time for everything.
"doctors, lawyers, accountants, "
Regulated fields - another clueless poster lol.
I know many of you really hate whats happening but don't try and project it on other professions where the environment is different.
Society largely never cared about maths.
You might be mistaking my comment as a value judgement rather than an attempt to charitably explain the latest media communications from Tao. I detect in his position that some trust he granted the AI companies has been violated.
You are, of course, right that doctors, lawyers and accountants have more control over the environment they work in compared to mathematicians. But it doesn't change the underlying argument Tao is making. Your observation that those professions will react differently is likely to be true and only time will tell how effective their response will be.
But AI "assistants" is a marketing approach being made to all professionals at this time. Tao is implying this is a Trojan-horse strategy. If you let the assistants in without reasonable protections, you may lose control over the environment you are trying to protect.
you may not be aware of it but society largely runs on the results of maths, clueless indeed. and regulated or not, if there are financial savings to be made anyone can be shoved under the bus.
> Regulated fields - another clueless poster lol
Out of sheer, idle curiosity: were you actually laughing when you typed that out?