Comment by Schiendelman

You're right, of course!

The hard part is "just". If you have mechanisms that allow neighbors to have an opinion at all, they will organize around it, they will stop growth, and you will eventually get San Francisco and New York restrictions anywhere that has high demand.