Many people worry quite a bit about the impact AGI will have on human meaning. If AI's do all the productive labor, create all the entertainment and art, and solve all of the hard problems, what will be left for humans to do and accomplish? Is there not something extremely sad about the human experience being a bit of an unnecessary afterthought, an inefficient novelty that is surpassed by technological prowess? Nick Bostrom discusses these issues at length in Deep Utopia, but they are just now becoming more and more a part of daily discussions. First digital artists were fretting, and now mathematicians.
It's time to think clearly about ASI. Human meaning, and how it will be impacted by AIs that are superior in cognitive ability, isn't even in the top 25 most pressing problems we face.
