Article
AI - Artificial Intelligence
Culture
5 min read

What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre
A digital momento mori.
Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this? 

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. 

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct? 

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness. 

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)  

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.  

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality. 

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality. 

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality. 

Article
Community
Culture
Generosity
Psychology
7 min read

Is empathy really a weapon?

Musk and Fonda disagree on whether empathy is a bug or a feature.
A montage shows Elon Musk wielding a chain saw, Jane Fonda flexing her muscles and Hannah Arendt smoking.
Wordd Wrestling Empathy.

You may have heard that you can kill a person with kindness, but in recent weeks have you also heard that you can bring about your own death through empathy? In an interview recorded with podcaster Joe Rogan in February, Elon Musk added his voice to a cohort of American neo-capitalists when he claimed, “We've got civilizational suicidal empathy going on” and went on to describe empathy as having been “weaponized” by activist groups.  

“The fundamental weakness of western civilization is empathy, the empathy exploit… they’re exploiting a bug in western civilization, which is the empathy response.”  

In recent weeks empathy has become one of the hot topics of American politics, but this is not the first time that Musk has shared his thoughts about empathy, and it should be noted that on the whole he is not really against it. Musk identifies, rightly, that empathy is a fundamental component of what it means to be human, and in previous interviews has often spoken often about his vision to preserve “the light of human consciousness” – hence his ambition to set up a self-sustaining colony of humans on Mars.  

But he also believes that empathy is (to continue in Musk’s computer programming terminology) a vulnerability in the human code: a point of entry for viruses which have the capacity to manipulate human consciousness and take control of human behaviours. Empathy, Musk has begun to argue, makes us vulnerable to being infected:  

"The woke mind virus is fundamentally anti-science, anti-merit, and anti-human in general. Empathy is a good thing, but when it is weaponized to push irrational or extreme agendas, it can become a dangerous tool." 

Strangely, on certain fundamentals, I find it easy to agree with Musk and his contemporaries about empathy. For example, I agree that empathy is essential to being human. Although, far from empathy leading us to “civilisational suicide”, I would say it is empathy that saves humanity from this fate. If consciousness is (as Musk would define it) the brain’s capacity to process complex information and make a rational and informed choices, then empathy, understood as the ability to anticipate the experiences, feelings, and even reactions of others, is a crucial source of that information. Without empathy, we cannot make good decisions that benefit wider society and not just ourselves. Without it, humanity becomes a collection of mere sociopaths. 

Another point on which Musk and I agree is that empathy is a human weak point, one that can be easily exploited. Ever since the term “empathy” was coined in the early twentieth century, philosophers and psychologists have shown a sustained fascination with the way that empathy causes us to have concern for the experiences of others (affective empathy), to think about the needs of others (cognitive empathy), and even to feel the feelings of others (emotional contagion). Any or all of these responses can be used for good or for ill – so yes, I agree with Musk that empathy has the potential to be exploited.  

But it is on this very question of who is exploiting empathy and why, that I find myself much more ready to disagree with Musk. Whilst he argues that “the woke mind virus” is using empathy to push “irrational and extreme agendas”, his solution is to propose that empathy must be combined with “knowledge”. On the basis of knowledge, he believes, sober judgement can be used to resist the impulse of empathy and rationally govern our conscious decision making. Musk states: 

“Empathy is important. It’s important to view knowledge as sort of a semantic tree—make sure you understand the fundamental principles, the trunk and big branches, before you get into the leaves/details or there is nothing for them to hang on to." 

What I notice in this system is that Musk places knowledge before empathy, as if existing bits of information, “fundamental principles”, are the lenses through which one can interpret the experiences of another and then go on to make a conscious and rational judgement about what we perceive.  

There is a certain realism to this view, one that has not been ignored by philosophers. The phenomenologists of the early twentieth century, Husserl, Heidegger, Stein – those who first popularised the very idea of empathy – each described in their own way how all of us experience the world from the unique positionality of our own perspective. Our foreknowledge is very much like a set of lenses that strongly governs what we perceive and dictates what we can see about the world around us. The problem is: that feeling of foreknowledge can easily be manipulated. To put it another way – we ourselves don’t entirely decide what our own lenses are.  

To graft this on to Musk’s preferred semantic tree: empathy is a means by which the human brain can write brand new code. 

In The Origins of Totalitarianism, another great twentieth century thinker, Hannah Arendt, explored how totalitarian regimes seek to control not just the public lives but also the thought lives of individuals, flooding them with ideologies that manipulate precisely this: they tell people what to see. Ideologies are, in a sense, lenses – ones that make people blind to the unjust and violent actions of a regime:  

"The ideal subject of totalitarian rule is not the convinced Nazi or the dedicated communist, but people for whom the distinction between fact and fiction, true and false, no longer exists." 

A big part of the manipulation of people’s sense of foreknowledge is the provision of simplistic explanations for complex issues. For example, providing a clearly identifiable scapegoat, a common enemy, as a receptacle of blame for complex social and economic problems. As we know all too painfully, in early twentieth century Europe, this scapegoat became the Jewish people. Arendt describes how, whilst latent antisemitism had long been a feature of European public life, the Nazi party harnessed this this low-level antipathy and weaponised it easily. People’s sense of foreknowledge about the “differentness” of this group of “outsiders” was all too manipulable, and it was further cultivated by the Nazis’ use of “disease”, “contagion” and “virus” metaphors when speaking about the Jews. This gave rise a belief that it was rational and sensible to keep one’s distance and have no form of dialogue with this ostracised group.  

But with such distance, how would a well-meaning German citizen ever identify that their sense of foreknowledge about what it meant to be Jewish had been manipulated? Arendt identified rightly that totalitarian systems seek to eliminate dialogue, because dialogue creates the possibility of empathy, the possibility of an exchange of perspectives that might lead to knowledge – or at least a more nuanced understanding of what is true about complex situations. 

When I look at Musk’s comments, I wonder if what I can see is a similar instinct for scapegoating, and for preventing dialogue with those who might provide the knowledge that comes from another person’s perspective. In his rhetoric, the “woke mind” has been declared a common enemy, a “dangerous virus” that can deceive us into becoming “anti-merit” and “anti-human.” In dialogue, those who claim to be suffering or speaking about the suffering of others might be enabled to deploy their weaponized empathy, trying to make us care about other, to the potential detriment of ourselves and even wider humanity’s best interests. Therefore, it is made to seem better to isolate oneself and make rational judgements on behalf of those in need, firmly based on one’s existing foreknowledge, rather than engage in dialogue that might expose us to the contagion of wokeness.  

Whilst this isolationist approach appears to wisely prioritise knowledge over empathy, it misses the crucial detail that empathy itself is a form of knowledge. The experience of empathising through paying attention to and dialoguing with the “other” is what expands our human consciousness and complexifies our human decision making by giving us access to new information. To graft this on to Musk’s preferred semantic tree: empathy is a means by which the human brain can write brand new code.  

In these divisive and divided times, there are, fortunately, those who are still bold enough to make the rallying cry back to empathy. At her recent acceptance speech for a Lifetime Achievement Award, actor and committed Christian Jane Fonda spoke warmly and compellingly in favour of empathy:  

“A whole lot of people are going to be really hurt by what is happening, what is coming our way. And even if they are of a different political persuasion, we need to call upon our empathy, and not judge, but listen from our hearts, and welcome them into our tent, because we are going to need a big tent to resist successfully what's coming at us.”  

Fonda’s use of the tent metaphor, I’m sure, was quite deliberate. One of the most famous bible passages about the birth of Jesus describes how he “became flesh and dwelt among us.” The word “dwelt” can also be translated “tabernacled” or, even more literally, “occupied a tent” among us. The idea is that God did not sit back, judging from afar, despite having all the knowledge in the world at his disposal. Instead, God came to humanity through the birth of Jesus, and dwelt alongside us, in all our messy human complexity.  

Did Jesus then kill us with his kindness? No. But you might very well argue that his empathy led to his death. Perhaps this was Musk’s “suicidal empathy.” But in that case Musk and I have found another point about empathy on which we can agree – one that is summed up in the words of Jesus himself: “Greater love has no one than this: to lay down one’s life for one’s friends.”   

Celebrate our Second Birthday!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief