Comment by kilroy123
2 days ago
I personally do not like Meta, but I'll say this. The more competition, the better for regular consumers. (Enterprise too)
- Chinese models
- Grok
- Meta
- OpenAI
- Anthropic
I think this is a win. I'm building like crazy to take advantage of all these subsidized tokens while I can.
Meta's local llama models used to be the face of open source AI. The scene has really changed.
they likely got the Peter Theil newsletter proclaiming open source models are the antichrist
That person is Alexandr Wang. He made his money selling data annotation services to closed source companies: openai, anthropic, Google, even Meta
Only 666B models. Other sizes are fine.
Yeah, I think it is definitely great. Having said that, I am still debating in my mind whether the volume of software engineers needed in the AI era is going to increase or decrease because of all of these advancements.
On the one hand, because it is easy to build products, more and more people will build. And more and more products and features will be built. However, a lot of people who are non-technical will also try to build, but they get stuck, and then they will need engineers. The sheer volume of product built by both experienced technical companies and non-technical novice startups and founders and wannabe founders is going to be massive. That is the bull case for having more software engineers needed in the near future.
On the other hand, in a year or so, people will build all these products, and most of them won't be able to market them, sell them and make money. Eventually, there won't really be a need for that many software engineers.
I think overall the bull case is probably going to win net net.
I see some similarities to 3D printing here. It’s great that everyone can make their own toothbrush holder (or whatever) but I’m probably not going to pay for someone’s weekend project.
I’m “seeing” more devs stepping into the SendCutSend stage where they’re cleaning up/fixing/productizing vibe coded projects so maybe there will be some new demand in that space?
3D printing is a good comparison - it allows almost anyone to make things, but in the end very few do.
Another example is when the WWW first became available, and suddenly everyone COULD be a publisher (browsers even included built-in HTML editors), and for a while MySpace pages proliferated until the excitement died down and people went back to being media consumers.
I expect we'll see the same thing with consumer use of generative AI. Suddendly everyone is generating 3-D worlds/games with Fable because they can, but I expect that just as with the web the novelty will wear off and they'll leave it up to the pros.
Professional use of GenAI, and coding in particular, is certainly here to stay, but it seems we're still in the early experimental/hype phase. At least tokenmaxxing has passed, and it seems most companies are now paying attention to, and limiting, how much they are spending, but it doesn't seem we've yet progressed to the stage where companies are paying attention to what they are actually getting out of it - is the money spent showing up on the bottom line in the form of increased revenues.
A comparison I find useful here is Excel (and spreadsheets in general). Those enabled huge numbers of non-programmers to build software-like things, while the demand for expert developers grew enormously at the same time.
I'm hoping vibe-coding plays out the same way.
It’s terrible and depressing work to take vibe coded garbage and make it a real product. There will be demand, but good engineers won’t want to touch it. And people paying will think they did the hard work so why pay a good rate?
I think LLMs/coding agents in particular are going to play out like automation always does.
1. You have a task and it requires an expert to perform it (software engineering, where we were) 2. You automate the task, it still requires the expert to babysit it (where we are now) 3. Management works out that the expert is just monitoring what the automation is doing and has actually lost expertise because they are just watching, not doing. Pay collapses. (where we are going)
Source: https://en.wikipedia.org/wiki/Ironies_of_Automation
At least in China a lot of software developers are now struggling.
I think for a lot of type of software we have now reached peak employment.
Someone payed a few k just for a normal website.
> At least in China a lot of software developers are now struggling.
Do you think that Chinese software industry is that relevant to the kind of software market talked about on HN? I.e. lots of enterprise b2b and infra companies.
Chinese companies have always had a very low willingness to pay for software which kinda breaks the flywheel of B2B SaaS companies and companies to service those companies all the way down.
5 replies →
> On the one hand, because it is easy to build products, more and more people will build.
And those people won't need to be software engineers.
> but they get stuck, and then they will need engineers
You've implicitly assumed here that the AI systems will always be worse than the average engineer. That is IMO myopic. I'm not sure that it's even true now let alone in the nebulous future.
> And those people won't need to be software engineers....You've implicitly assumed here that the AI systems will always be worse than the average engineer.
Most of what we do as engineers is precisely describe or analyze the behavior we want or the behavior we don't want. All other engineering skills that are useful are ultimately downstream from understanding the behavior of software enough to know which parts to keep, improve, or jettison. Chatbots can take care, somewhat, of analysis or expansion of instructions.... but they can't read minds. I don't see that changing any time soon.
9 replies →
The big thing to me is why are we even running these models on top of an operating system?
What I really want is Claude as a deep part of the operating system.
If that happens then a whole lot of the abstraction of software vanishes along with what we think of today as software jobs. I think many new forms of knowledge work would emerge from this though.
I would think that needs massive local compute but I can't imagine that is not the future down the line.
It’s also not the future SV is incentivized to build. They want everything for rent, nothing can be owned.
Luckily, China is on the verge of a true breakout, I’m not sure what exactly it will be - but I’d make a very large wager the “next iPhone” is Chinese, and will constitute a full blown “Sputnik moment” for the US and SV.
If Americans weren’t forbidden to own Chinese EVs they’d know this. But tariffs mean the breakthrough will be even more unexpected.
Since Chinese actually “sell stuff” I’m guessing their unbeatable lead in AI efficiency, manufacturing, and distribution will produce a step change breakthrough within a decade.
While data centers are still using lots of energy created from fossil fuels and many still evaporate water for cooling?
No wonder we still can’t get climate change under control
> No wonder we still can’t get climate change under control
This is was historically a money issue, being green used to be wildly more expensive.
Now being green is cheaper, the limiting factor is how fast PV and batteries can be made or imported.
Recent reports of the sum of all US data centres currently in planning, has a power demand exceeding the (capacity-factor-adjusted!) global annual supply of new PV.
This would be less of a problem, but still a problem, if Trump wasn't trying to get in the way of anything green, or if the companies building data centres decided to also support factories to make more PV.
* Planned new demand: 300 GW; PV factory capacity ~ 600 GW nameplate, but the capacity factor is 14% so that's really 84 GW on average.
To expand on Chinese models:
- DeepSeek
- GLM (Z.ai)
- Minimax
- Kimi (Moonshot)
- Hy3 (Tencent)
- Qwen (Alibaba)
(Each one of these with weights available to download and run locally)
- MiMo (Xiaomi)
GLM 5.2 is great, but is so rate limited now I no longer recommend it
I'm looking ahead to the next wave of open-weight models that are as efficient as DSv4 (which is really efficient), and have been heavily distilled on GLM 5.2 (which is trivial, given it is open weight)
Aren't there multiple providers for it? is it rate limited in all providers?
2 replies →
I use it all the time through Fireworks. The normal version when I pay it myself and the fast one when company pays. It's really fast and I never get rate limited with my daily use.
Rumors are Nvidia H200s got approved so infrastructure might be improving soon.
He came to X to post about this instead of his very own meta threads. This just shows how much interested he is to make this thing big, and of course, the cost can stay bearable for us considering all of these cash burn that these companies are doing
Its the biggest technology race we have ever seen. Richest companies, smartest people, richest countries.
I do not know if competition is good, we will see in a few years.
Looking forward having a physical job for a change :D
A bit much describing our tech leadership as smartest people we've ever seen.
I would call the founders of DeepMind (Demis Hassabis, Mustafa Suleyman, Shane Legg) very smart people. Im pretty sure with the amount of funding everyone of these companies have, they have a long list of very smart researchers in their companies.
I do not mean Suckerberg or Eric Schmidt.
Greediest, perhaps?