Comment by xiphias2

7 days ago

The scariest thing for me about companies not caring even minimally about conservation is that when AI gets more powerful than humanity (which is clearly a when not an if, even if there's a lot of uncertainty and differences in opinion about the time horizon here), I want to hope that AI will care more about conservation of human people.

So far from how I see how powerful organizations work, I'm not as certain as I would like to be.

> AI gets more powerful than humanity (which is clearly a when not an if, even if there's a lot of uncertainty and differences in opinion about the time horizon here)

People say this all the time, but so far nothing has convinced me it's true.

LLM development has more or less plateaued, and the current boundaries are very real - energy, resources, capital.

At this point we're talking about marginal improvements against the same asymptotes of all technological innovations.