← Back to context

Comment by mikestylz

1 day ago

> When AI becomes more capable of navigating practical problems without human intervention, I will start to be concerned.

Given the past rate of progress, why not start being concerned now? It's a bit like the economist saying that the optimal number of flights to miss is not zero. If you keep landing short on your estimations for how far this technology will go, next time you should err on the other side.

And regarding Vending-Bench 2 (https://andonlabs.com/evals/vending-bench-2) my understanding is that models do pretty well on it now.

What's the point of being concerned?

We're not going to stop it because of the money involved and once we're dead, it won't matter anyway, might as well just enjoy life until you're done.

We're going to get AI'd to the max, whether or not we like it or not, might as well just go with it.

  • Your attitude is extremely sad. Do you think we would be where we are today if oppressed people's throughout history just gave up as easily? We have rights because people fight for them. We collectively have the power to decide what kind of future we want to live in.

  • We can't stop it. But you can use your voice to buy time and resources for alignment and safety research. A few additional months may make a world of difference.

    • All the billionaires making AI already say there's a 10-50% chance it's going to kill everyone.

      I don't think your LessWrong post is going to save us.

  • If anything is a doomer attitude, this is.

    • A doomer is someone who believes doom is inevitable or highly likely, I'm not saying that, I'm just saying "being concerned" will probably get you nothing in return and this tech is getting developed no matter what.

      The only way it will stop is if the wealthy / powerful people feel threatened by it, properly threatened.