If you believe advanced AI will be able to cure cancer, you also have to believe it will be able to synthesize pandemics. To believe otherwise is just wishful thinking.

When someone says a global AGI ban would be impossible to enforce, they sometimes seem to be imagining that states:

1. Won't believe theoretical arguments about extreme, unprecedented risks
2. But will believe theoretical arguments about extreme, unprecedented benefits

Intelligence is dual use.

It can be used for good things, like pulling people out of poverty.

Intelligence can be used to dominate and exploit.

Ask bison how they feel about humans being vastly more intelligent than them