Comment by steveklabnik
4 days ago
Google and Meta hit these sorts of limits over a decade ago. They then built new VCS stuff to handle it, Meta's part is the subject of this submission. This was even pre-agents.
Git is just not suited to truly large monorepos, and it won't ever be. That's totally fine, of course. Less of a monoculture here would be great.
Maybe it would help if I said I agree that this is a real problem that people are dealing with. However, I find it difficult to trust the words of a company that has agents "going rogue" due to their own negligence or for their own marketing reasons. It's hard to take their "we are experiencing tremendous growth"-coded blog posts like the one about their need for a new VCS seriously.
Just for comparison' sake: Google employs ~60,000 engineers. Anthropic has maybe 2,000. My uncharitable (and admittedly unverifiable) read is that even if they weren't directly experiencing this problem, the optics of being their size but needing Google or Meta-level scale for their work is a comparison they are happy to invite folks to make going into IPO season.
Maybe they do! But, well, I simply do not find them a reliable narrator.
Makes sense, all I wanted to point out is that this is a real problem for some real companies.
Microsoft hit it too and then improved git and made it faster. Right now Anthropic seems to be under 1 commit per second. I don't think that would make the git server break a sweat.
Microsoft's Scalar will help you with a medium-large repo in pure history and file and file count size, but it won't help you with a repo with a very high merge rate. Microsoft doesn't actually have a massive monorepo anywhere near Google or Meta's size so they never came close to hitting the same problems.
Microsoft did, but that doesn't change the limitations imposed by git's design. Their repos just weren't as large.
> under 1 commit per second
Sure, for arbitrary pushes, that's not a big deal. But for large repositories, with those changes landing on trunk at that rate, once you start talking about "commits per second" it gets very difficult.