Comment by amelius

Why, the LLM can make up its own architecture.

The value lies in the design space exploration, which is what an LLM can easily do.

https://en.wikipedia.org/wiki/Design_space_exploration