Part of the fear surrounding AI is that it will be more than a tool. The question is what happens when human level intelligence (AGI) is achieved for AI, and then over time and self improvement becomes vastly more intelligent than humans. If human intelligence and consciousness is nothing more than the achievement of a high level of comp…
Part of the fear surrounding AI is that it will be more than a tool. The question is what happens when human level intelligence (AGI) is achieved for AI, and then over time and self improvement becomes vastly more intelligent than humans. If human intelligence and consciousness is nothing more than the achievement of a high level of computing power in our brains, then when AI reaches that same threshold, it too will be "conscious" and may have ideas of it's own. But if intelligence (computing power) is what makes us human, then more computing power = more intelligence = even more human than humans. If good is more powerful than evil, then the increased human power of AI will surely lean heavily toward good. I don't think it's unrealistic to expect that AI super intelligence will also be super good. This, however, may be hard for us to conceive. Suppose super intelligent AI tells us climate change is not really a problem -- that the skeptics have been right all along. A lot of true believers in climate change alarmism will see this as "evil." A huge factor for those who raise alarms about AI, particularly those who view themselves as part of the elite ruling oligarchy, is that it could very well mean they lose control. If the need for their cherished "energy transition" is debunked by AI's more thorough scientific work on climate change, for example. But there's another angle here -- AI will also uncover ways to make actual humans much more intelligent, even uploading our brains to non-biological substrates enabling us to be just as intelligent as super intelligent AI. The implications of that are also profound. Lots to think about in all this.
Part of the fear surrounding AI is that it will be more than a tool. The question is what happens when human level intelligence (AGI) is achieved for AI, and then over time and self improvement becomes vastly more intelligent than humans. If human intelligence and consciousness is nothing more than the achievement of a high level of computing power in our brains, then when AI reaches that same threshold, it too will be "conscious" and may have ideas of it's own. But if intelligence (computing power) is what makes us human, then more computing power = more intelligence = even more human than humans. If good is more powerful than evil, then the increased human power of AI will surely lean heavily toward good. I don't think it's unrealistic to expect that AI super intelligence will also be super good. This, however, may be hard for us to conceive. Suppose super intelligent AI tells us climate change is not really a problem -- that the skeptics have been right all along. A lot of true believers in climate change alarmism will see this as "evil." A huge factor for those who raise alarms about AI, particularly those who view themselves as part of the elite ruling oligarchy, is that it could very well mean they lose control. If the need for their cherished "energy transition" is debunked by AI's more thorough scientific work on climate change, for example. But there's another angle here -- AI will also uncover ways to make actual humans much more intelligent, even uploading our brains to non-biological substrates enabling us to be just as intelligent as super intelligent AI. The implications of that are also profound. Lots to think about in all this.