cooperation

A Fundamental Problem with Moral Enhancement

by Joao Fabiano
October 13, 2017October 16, 2017

by Joao Fabiano

Moral philosophers often prefer to conceive thought experiments, dilemmas and problem cases of single individuals who make one-shot decisions with well-defined short-term consequences. Morality is complex enough that such simplifications seem justifiable or even necessary for philosophical reflection. If we are still far from consensus on which is the best moral theory or what makes actions right or wrong – or even if such aspects should be the central problem of moral philosophy – by considering simplified toy scenarios, then introducing group or long-term effects would make matters significantly worse. However, when it comes to actually changing human moral dispositions with the use of technology (i.e., moral enhancement), ignoring the essential fact that morality deals with group behaviour with long-ranging consequences can be extremely risky. Despite those risks, attempting to provide a full account of morality in order to conduct moral enhancement would be both simply impractical as well as arguably risky. We seem to be far away from such account, yet there are pressing current moral failings, such as the inability for proper large-scale cooperation, which makes the solution to present global catastrophic risks, such as global warming or nuclear war, next to impossible. Sitting back and waiting for a complete theory of morality might be riskier than attempting to fix our moral failing using incomplete theories. We must, nevertheless, proceed with caution and an awareness of such incompleteness. Here I will present several severe risks from moral enhancement that arise from focusing on improving individual dispositions while ignoring emergent societal effects and point to tentative solutions to those risks. I deem those emergent risks fundamental problems both because they lie at the foundation of the theoretical framework guiding moral enhancement – moral philosophy – and because they seem, at the time, inescapable; my proposed solution will aim at increasing awareness of such problems instead of directly solving them.

Less cooperation, please

by Joao Fabiano
September 8, 2015September 8, 2015

Written by Joao Fabiano

Since the idea of enhancing human morality was proposed – and perhaps long before then – there has been a great deal of scientific research directly or indirectly inspired by the goal of improving human moral dispositions. Manipulations which result in increased levels of cooperation, prosociality or altruism are often seen as promising discoveries towards the path of developing moral enhancement technologies. The fact that increasing cooperation between individuals would be going in the wrong direction seems to be ignored. The problem moral enhancement proposes to fix is large-scale cooperation – cooperation between groups of individuals – not between individuals inside a group. Issues like global warming and nuclear disarmament arise primarily in the interaction between large groups of individuals, not in the interaction of individuals within the same group.

In actuality, humans already cooperate well inside small groups. We have evolved many emotional and cognitive mechanisms which enable us to function quite satisfactorily in the context of small cooperative groups such as the ones more frequently prominent in pharmacological research. Many have proposed local economies as the ideal design for producing sustainable management of common resources[1]. There is not that much room for improvement there.

On the other hand, when it comes to interactions between groups of different religions, nationalities and morals we can fail spectacularly. What’s more, our ability to cooperate well inside groups seems to be directly correlated with our inability for cooperation between groups.Read More »Less cooperation, please

What Got Us Here Won’t Get Us There: Failure Modes on the Way to Global Cooperation

by Joao Fabiano
June 12, 2015June 14, 2015

By Joao Fabiano and Diego Caleiro (UC Berkeley, Biological Anthropology)

From single-celled to pluricellular to multicellular organisms or from hunter-gatherers to the EU, the history NASA Flickr of evolutionary forces that resulted in human society is a history where cooperation has emerged at increasingly large scales. The major life transitions and, once human, the major cultural transitions have rearranged the fitness landscape of evolving entities in ways that increased the size of the largest existing coalitions. Notwithstanding, it seems that freewheeling evolution will not lead to satisfactory levels of global human cooperation in time to prevent severe risks. Nor it will lead to the preservation of human values in the long run; humans, human values, and human cooperation are in no way the end-point of evolutionary processes. Read More »What Got Us Here Won’t Get Us There: Failure Modes on the Way to Global Cooperation

Cooperating with the future

by Nadira Faber
October 21, 2014October 22, 2014

This is a guest post by Oliver P. Hauser & David G. Rand.

“It often strikes me that the complex problems we face in the world – problems of corruption, environment, politics, and so on – almost always indicate a failure of moral ethics and inner values. … The failure of the 2009 Copenhagen Summit on the global environment was, sadly, an example of how, when parties fail to look beyond their own narrow self-interest, cooperation becomes impossible.”

— The Dalai Lama, Beyond Religion

Do we have a moral responsibility to sustain the planet for future generations? The Dalai Lama, in the quotation above, gives an almost unequivocal ‘yes’. But a cursory understanding of economics shows us that it’s not just about morality – or at least, that morality doesn’t always have the final word. We, today’s decision-makers, are simply better off economically if we harvest all resources today without thinking about the future. To state the economic, ‘rational’ argument in bald terms: why leave something for the future if we won’t benefit from it?

Emergence’s devil haunts the moral enhancer’s kingdom come

by Joao Fabiano
December 20, 2013December 25, 2013

It is 2025. Society has increasingly realised the importance of breaking evolution’s chains and enhancing the human condition. Large grants are awarded for building sci-fi-like laboratories to search for and create the ultimate moral enhancer. After just a few years, humanity believes it has made one of its most major breakthroughs: a pill which will rid our morality of all its faults. Without any side-effects, it vastly increases our ability to cooperate and to think rationally on moral issues, while also enhancing our empathy and our compassion for the whole of humanity. By shifting individuals’ socio-value orientation towards cooperation, this pill will allow us to build safe, efficient and peaceful societies. It will cast a pro-social paradise on earth, the moral enhancer kingdom come.

I believe we better think twice before endeavouring ourselves into this pro-social paradise on the cheap. Not because we will lose “the X factor”, not because it will violate autonomy, and not because such a drug would cause us to exit our own species. Even if all those objections are refuted, even if the drug has no side-effects, even if each and every human being, by miracle, willingly takes the drug without any coercion whatsoever, even then, I contend we could still have trouble.

Oxford Martin School Seminar: Robert Rogers and Paul Van Lange on Social Dilemmas

by Nadira Faber
December 13, 2013December 13, 2013

In a joint event on November 15^th, Prof Robert Rogers and Prof Paul van Lange presented their scientific work related to social dilemmas.

Social dilemmas are situations in which private interests conflict with collective interests. This means that people facing a social dilemma have to decide whether to prioritise either their own short-term interests or the long-term interests of a group. Many real-life situations are social dilemmas. For example, as individuals we would (economically) benefit from using public motorways without paying taxes to maintain them, but if all acted according to their self-interest, no motorways would be built and the whole society would be worse off. In the academic literature, the three types of social dilemmas that are discussed most prominently are the Prisoner’s Dilemma, the Public Goods Dilemma, and the Tragedy of the Commons. All three types have been modelled as experimental games, and research from different fields like psychology, neuroscience, and behavioural economics uses these games to tackle the question of under which conditions people are willing to cooperate with one another in social dilemmas, instead of maximising their self-interest. The ultimate goal of such research is to be able to give recommendations about how to solve social dilemmas in society.