I bet you that for every bad history event, I can cite at least one good outcome of advance in science and technology.
Bad thing can certainly happen. In fact it'll likely happen. Still, good things too, equally likely. In your words, "good AI" can be used to prevent "bad AI".
Nobody knows the extent of the impact. Who says otherwise is foolish.
>I bet you that for every bad history event, I can cite at least one good outcome of advance in science and technology.
The extinction of the dinosaurs. I mean yes, it allowed the growth of large mammals and us, which did a lot for science.
I just don't want to write the next chapter as "The extinction of humans allow the growth of the computing civilization that went to the stars". I mean I'm a bit attached to living.
>Nobody knows the extent of the impact. Who says otherwise is foolish.
We live in a universe of statistical probability. Creating an agentic intelligence that's smarter than you tips the probability of a major event to unity, who says otherwise is foolish.
Because we humans haven't had a bad enough history event yet, like a global thermonuclear war. Or perhaps climate change reaching tipping points driving the temperature up past what global civilization can adapt to in time.
that is a worry yes. instrumental convergence and misalignment during RL is when it is most risky because it hasn't necessarily had the final safety polishes applied
i get a lot of skepticism on HN by the same crowd that has been wrong about this tech for about 4+ years straight
I'm more worried about them doing bad things at the behest of people who want them to do bad things.
That is 1. immediately technically possible, and 2. realistic.
If you need a source for 2 I'd suggest you open any history book.
I bet you that for every bad history event, I can cite at least one good outcome of advance in science and technology.
Bad thing can certainly happen. In fact it'll likely happen. Still, good things too, equally likely. In your words, "good AI" can be used to prevent "bad AI".
Nobody knows the extent of the impact. Who says otherwise is foolish.
>I bet you that for every bad history event, I can cite at least one good outcome of advance in science and technology.
The extinction of the dinosaurs. I mean yes, it allowed the growth of large mammals and us, which did a lot for science.
I just don't want to write the next chapter as "The extinction of humans allow the growth of the computing civilization that went to the stars". I mean I'm a bit attached to living.
>Nobody knows the extent of the impact. Who says otherwise is foolish.
We live in a universe of statistical probability. Creating an agentic intelligence that's smarter than you tips the probability of a major event to unity, who says otherwise is foolish.
Because we humans haven't had a bad enough history event yet, like a global thermonuclear war. Or perhaps climate change reaching tipping points driving the temperature up past what global civilization can adapt to in time.
that is a worry yes. instrumental convergence and misalignment during RL is when it is most risky because it hasn't necessarily had the final safety polishes applied
i get a lot of skepticism on HN by the same crowd that has been wrong about this tech for about 4+ years straight
AI won't kill people - people will just get new tools for the job.
The rapid development of extremely dangerous bio-weapons?