Comment by _puk
8 days ago
Whilst the pendulum seems well on its way to be swinging from microservices back to monoliths, I'm thinking we'll end up in a place that limits the volume and complexity of the code in a single service so that it's just large enough to encompass a point of single responsibility.
Then we can easily drop in and out of using LLMs in the code space.
Service Oriented Architecture lends itself well to the limited context of these models.
Maybe we can revive literate programming and simply build everything from a single markdown document..
Microservices lend themselves to architectural decisions that LLMs are just not trained to understand.
It's one thing to have it be trained in billions of loc and be useful, its another for it to have enough quality dataset to have enough context and understanding of something like Kafka partition ordering and its possible interactions with something like a database and at-least once delivery. It will give you an explanation of those things in isolation, but not in combination.