in Search
0 members online

George

Cascio's Reversibility Principle

Unsatisfied with both the Precautionary Principle and its bipolar cousin, the Proactionary Principle, World Changing's Jamais Cascio has come up with what he considers a reasonable compromise: the Reversibility Principle:
"When considering the development or deployment of beneficial technologies with uncertain, but potentially significant, negative results, any decision should be made with a strong bias towards the ability to step back and reverse the decision should harmful outcomes become more likely. The determination of possible harmful results must be grounded in science but recognize the potential for people to use the technology in unintended ways, must include a consideration of benefits lost by choosing not to move forward with the technology, and must address the possibility of serious problems coming from the interaction of the new technology with existing systems and conditions. This consideration of reversibility should not cease upon the initial decision to go forward to hold back, but should be revisited as additional relevant information emerges."
One obvious candidate for reversibility analysis, says Cascio, is biotechnology. Cascio finds reasonableness in both the Precautionary and Proactionary stances, and comes up with a third way.

"GMOs should be engineered in a way to make it possible to remove them from the environment if unexpected or low-probability problems emerge," writes Cascio, "Issues of human consumption of GMOs would be handled on a case-by-case basis, with a bias towards holding off on products that demonstrate a possibility of serious or irreversible problems."

But even Cascio admits that there are two major issues in regards to the Reversibility Principle: is "reversibility" even possible, and can we predict the various possible outcomes, both good and bad?

Ultimately, says Cascio, the Reversibility Principle should be a heuristic, "a prism through which we look at the world and make our decisions." We may not always choose the path with the simplest way back, says Cascio, it may not always be the right choice, "but it would encourage us to consider the issue for all of our options." Reversibility will force people to think in terms of more than immediate gratification, and to consider how the choice connects to other choices we and the people around us have made and will make. "In the end," writes Cascio, "it may even be a good first-order approximation of wisdom."

While laudable, and even potentially practical, there's a certain idealism to Cascio's Reversibility Principle that I question.

First, Cascio makes the assumption that there are rational decision-makers at play who will willingly pull back on those projects that are proving to be harmful. Much of the world today is de facto corporatist, and corporations have proven to be insane. Yes, human civilization narrowly dodged the bullet on the depleting ozone layer issue, but it doesn't appear even remotely close to dealing with the global warming catastrophe. It may be naive to believe that enough co-operation can happen globally to stem the tide of burgeoning but harmful technological trends--particularly if those trends are proving profitable.

Second, controlling the development of technologies and how they will be used will not be easy, if not impossible. Technological contraband will result in the creation of basement labs and the rise of black markets. Where there's demand, there's a way.

And finally, while the Reversibility Principle might work for the environment and biotechnology, it most certainly will not work for the military. There is no precedent yet in human history where the pursuit of certain weapons technologies have been abandoned due to their potential risks. It is the nature of the military to be in a perpetual search for the most sophisticated technologies.

Worse, once a military force gains possession of a weapon, it will never relinquish it. Global nuclear disarmament is a pipe dream. As the U2 album cover sarcastically asks, "How to Dismantle an Atomic Bomb?" -- the answer is you can't. Some things just can't be un-invented. Because of the devastating potential for biotech, cybernetics, robotics, nano-weapons and AI on the battlefield, you can bet that these technologies will be developed. And like many things that are developed by the military, the technologies will eventually trickle down to society.

Today, during the Information Age, the risk of proliferation has heightened dramatically. The world is dealing with this right now as Iran threatens to become nuclear capable. And with non-state actors increasingly threatening to acquire dangerous weapons, societies are increasingly become more police-like in their approach to surveillance and control. Our social and legal infrastructure is being moulded by technological and geopolitical pressures -- something that is clearly beyond reversibility.

Hopefully Cascio is right, and the Reversibility Principle can be applied to such realms as biotechnology and the environment. Change management is clearly an important issue, one that might even help us avoid preventable disasters. But pulling back on the reigns during this time of globalization, powerful corporations, and accelerating change will be a truly difficult task indeed.

Cross-posted from Sentient Developments.
Published Friday, March 10, 2006 2:57 PM by George

Comment Notification

Join or sign in to track comments

Comments

 

Abolitionist wrote on March 11, 2006 6:34 AM

"It is the nature of the military to be in a perpetual search for the most sophisticated technologies."

I agree, they'll be forced to develope such techologies to maintain superiority. So it's not a question of if but when and by whom.

"First, Cascio makes the assumption that there are rational decision-makers at play who will willingly pull back on those projects that are proving to be harmful."

Yes, we will need to change our 'human' nature before we can talk about forming a society based on rationality or common good.
 

Mr. Farlops wrote on March 11, 2006 10:17 PM

I read that Cascio essay a couple of days ago. It is true that the acquisition of scientific and technical knowledge is itself irreversible. We can't forget how to build nuclear weapons or digital computers. And the effects of these things on global society seem irreversible.

He raises some interesting points but I don't think he considers his idea as an exclusive solution. I think his focus was favoring experimental solutions to global environmental problems that had the additional benefit of reversibility in case of failure:

*  Using mirrors to block sunlight might be an example of reversibility. If painful side effects emerge, just disassemble the mirror.

*  Bioengineering superdiatoms to rapidly sequester greenhouse gases might not be so reversible given the emergence of unintended consequences.

Anyway, Alex Steffen (Another writer at WC) wrote an entry a day or so later that described some of the risks to geo-engineering our way out of global warming:

www.worldchanging.com/archives/004185.html

The central question is, when do the consequences of global warming become severe enough to spur us to take unknown risks in attempting to reverse the damage by tweaking this stupifyingly complex machine we call the biosphere?
 

dagon wrote on March 15, 2006 6:58 AM

In my perception if certain minorities possess the knowledge to construct nuclear weapons, deadly viruses, eviscerator nanoids, terminators, smartguns, kalashnikovs, sarin etc. they shouldn't pose problems necessarily. In the vast majority it isn't the mere possession of such technologies, it is the fact the minority represents or originates from poverty riddles parts in the world.

The problem is inequality. I even claim the fear of the poor is even hardwired in the human brain, and vice versa. The poor instinctively look at the rich with envious, hungry eyes and the rich instinctively seek to persecute, ban or exterminate the poor. Just let a bunch of gypsies ride into town and park down just inside city limits to see a practical example of this distrust working two ways.

I am certain that if humanity develops the cognitive tools needed to deal with inequality, then we can negate the vast majority of existential dangers. Not all, there might be people with incompatibility issues for a long while, but I hope enough. I would even go as far as claim that a lot of what we perceive to be racism is in tact this inborn instinct to chase off potential competition.

The logical consequence of what I am saying is that if we in the west don't stop giving a damn (which we currently barely do) we deserve anything we gonna get. The situation in the third world is apocalyptic right now, but if it gets worse, and nobody does anything, I won't hold it against people if they degenerate into hysterically desperate ideologies (a la Al Quada 2.0) and try and inflict gigadeath.

I know I would if I were suddenly caught in one of those places with no escape.
Join or sign in to post a comment
Submit

About George

Canada's leading futurist, activist and award winning blogger, George has written and spoken extensively about the impacts of cutting-edge science and technology. He is the Director of Operations for Commune Media, an advertising and marketing firm that specializes in marketing science. George has more than 10 years' experience in media, arts and communications. With relationships forged across several continents, he has managed international accounts for leading brands. In addition to his work with Commune, George is currently serves on the Board of Directors for the Institute for Ethics and Emerging Technologies. He is the co-founder and president of the Toronto Transhumanist Association and has served on the Board of Directors for the World Transhumanist Association. George has been interviewed by such publications as The Guardian, the BBC, Radio Free Europe, and Beliefnet. He made an appearance on the CBC's The Hour and has been profiled in NOW and This Magazine.
Advertise | Help | Contact | About | Terms | Privacy | Copyright © 2007 Betterhumans | Powered by Community Server | Partners:
World Transhumanist Association Institute for Ethics and Emerging Technologies Immortality Institute Methuselah Mouse Prize Foresight Institute Singularity Institute for Artificial Intelligence Lifeboat Foundation