All I see from people familiar with the subject who are not worried about the outcomes of this is denial.
Denial of the rate of development of capabilities. Make no mistake, intelligence turned out to be much easier to solve than most experts imagined. Recursive self improvement is on the horizon.
Denial of the risks, noone has a plan for control, agentic ASI is inherently unpredictable and uncontrollable to us, this well never be solved. No the AI won’t be friendly if we set a good example, no it won’t espouse an emergent higher form of mortality
Denial of dystopia. ASI is the ability to radically alter what we are. In a world with ASI, humanity is like play-doh, it can be shaped into whatever the entity in control of the ASI wants it to be. Whether that be the ASI itself or some group of people. We stand to lose everything we are, not only the bad but also the good.
Denial of humanity’s strength. We are capable of solving the world’s problems without AI. Will climate change likely get worse before it gets better, yes. Will a lot of people die, yes but it is nothing compared to the outcome of ASI. Will we keep electing people like the US president, and let hundreds of thousands of people die because he stops their medical aid, sadly yes. Humanity is not perfect, but even without AI, thanks to our own technological prowess we have been on an improving trajectory.
There are billions of children whose futures are at stake. And infinitely more in the future generations that will be their children. Humanity for all its flaws and horrors is a beautiful thing. Please remember that, we can take care of ourselves, don’t let the tragedies of the last centuries fool you into thinking otherwise. Don’t let short term trends or political events change your view about this.
We cannot lose what we are, we cannot lose ourselves. Technology is a gift, generally we should use it to better all of humanity. The promise of AI is the greatest one we’ve ever had, but its development is a costly mistake.
[link] [comments]