Putting the Brakes on the Singularity
The Singularity is coming. But not if I can help it.
Barring a miracle, the seminal event of the next few centuries--and all of human history--will be the Singularity, when human life as we know it ends due to rapid and deep technological development.
In a popular new book, The Singularity is Near, inventor/futurist Ray Kurzweil paints an extremely optimistic picture of a world in which individuals design their own mental habitats and all major world problems are solved. We will be able to select from alternate personalities. Life will be eternal, if desired.
Kurzweil is probably right about the possibilities of technology for human use within the next few centuries, if not decades. Scientists at Yale and elsewhere are already predicting that life expectancies will someday approach infinity. And it is easy to see how humans could use superhuman technologies, including their own dramatically retooled brains, to quickly solve problems like food shortage, pollution and poverty.
But in opposition to Kurzweil’s rosy scenario are legions of others in the scientific and technological communities, including the chief scientist at Sun Microsystems, Bill Joy, and person who first predicted the Singularity, Vernor Vinge. They project that if a Kurzweilian world is ever created, it will quickly disappear as humans lose control of their technology and face extermination, enslavement or worse.
Two things to bear in mind about the Singularity: one, it would happen very quickly. Technology advances exponentially, and if we created entities that exceeded our intelligence, their ability to create increasingly intelligent entities would immediately surpass even our highest rate. Two, there is no reason why higher-order beings would be at our service, any more than we are at the service of rabbits or horses. History has shown that beings work for their self-interest, and a more sophisticated being than humans would have no reason to treat us as equals, or, even more preposterously, as superiors.
Bearing in mind how quickly things might go horribly wrong, it is incumbent on this generation to stop humankind from signing away its fate to the spawn of its intelligence. We must act swiftly. It is not enough to continually muse that “the generations of tomorrow will have to face some tough quandaries at the intersection of genomics, law and ethics.” By the time those generations come of age, perhaps it will be too late to reverse our march toward the Singularity.
Without restricting research or thought in any way, the United Nations should make a concerted effort to identify all scientists, institutions and corporations working on the cutting edge of artificial intelligence. This would be a gigantic task because of its broad scope, the nebulous nature of intellectual property and some expected hostility from researchers, but not as difficult as, say, tracking down nuclear weapons from the former Soviet Union. This is for three reasons: the UN would be looking for large, well funded laboratories, not shadowy Central Asian criminal syndicates; the UN would be monitoring, not reclaiming stolen property and imprisoning; and, most importantly, the goal of UN monitoring would be to prevent an eventuality--a calamitous Singularity that would end the human race as we know it--that would augment neither business nor power.
The monitoring effort would be a safeguard. Perhaps the countless prognosticators and technology experts are wrong and the Singularity will forever elude the human grasp. But if we are someday able to assess whether our level of advancement is dangerously close to irrevocably producing the Singularity, it will be crucial to have a well established directory of researchers and their activities.
Freedom to research based on academic interest and monetary gain is at the heart of the Western world’s economic and political success over the past two centuries. That freedom should not be abrogated except for in the most desperate circumstances. We are possibly approaching exactly such a circumstance, however, and we must be prepared. If the UN is not up to the challenge, calls will have to filter up from the private sector, national governments and media watchdogs.
Those who oppose change are usually losers. The opponents of cooking, medicine, electricity and air travel are worse than forgotten--they are the enemies of history. But few historians would deny the exceptionalism of the 20th century and that technological advancement will someday elude the control of even our brightest scientists. Moreover, there is a philosophical resonance to the greatest driver of humankind’s earthly reign being its eventual undoing. To stop the exponential curve of technology from reaching its unimaginably disasterous asymptote, we must reject a fundamentally human instinct and prepare to restrain progress.
Perhaps humankind is destined to collapse under the weight of its greatest appetites. But I, for one, am not going down without a fight.
