Article
AI
Culture
5 min read

What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre
A digital momento mori.
Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this? 

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. 

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct? 

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness. 

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)  

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.  

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality. 

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality. 

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality. 

Article
AI
Culture
Digital
Education
6 min read

Could thinking and feeling become futile pastimes in the future?

AI, and more, is eroding our agency, we need to act now

Jamie is Vicar of St Michael's Chester Square, London.

A seated teenager stretches back bored, a phone is on the table in front of them
Nick Jones/Midjourney.ai.

Jane Austen is an author universally acknowledged. So much so that she was acknowledged on the £10 note in 2017. The quote the note bore is not the immortal opening sentence from Pride & Prejudice, but something less obvious:  

'I declare after all there is no enjoyment like reading.' 

So concise, so inspiring. However, the quote belongs to her character Caroline Bingley. She isn't reading for pleasure, she's just trying to impress the dashing Mr Darcy. Jane Austen, well before 2017, has always been on the money. Her parable of disparity shows that despite the odds, Lizzie Bennett has agency as she comes face-to-face with Darcy to thrash out their differences. 

Such human agency is now being lost in many ways, as the art of empathy, reality itself, and even thinking are under attack. 

 Firstly, there's what Simon Burton-Jones startlingly outlined Seen & Unseen recently. Our empathy for our fellow creatures, which is taking a nosedive, has a direct correlation to our lack of seeing each other face-to-face.  

Secondly, he noted that reality, or reality as we've known it up until now, might only be really experienced by the wealthy. The fullness of life that is available to each of us is diluted and diminished because we don't suck the marrow out of life, we simply observe it from afar through digital lenses. 

The next, equally startling way agency is being lost is detailed in Mary Harrington's guest essay in the New York Times about how 'thinking is becoming a luxury good'. Only the Caroline Bingleys, and not the Bennetts of today would be reading and expanding their minds for pleasure: 

'In a culture saturated with more accessible and engrossing forms of entertainment, long-form literacy may soon become the domain of elite subcultures… as new generations reach adulthood having never lived in a world without smartphones, we can expect the culture to stratify ever more starkly.'

In other words, there's an ever-widening gap. As our digital and real worlds blend, we need to narrow the gap not just between women and men of different classes, but also where our agency truly resides: our appreciation for our own thinking and feeling. 

This is a tall order, given our devaluing of thinking. We shortcut our brains with AI and cut short the careers of those who've been taught to compute and analyse. The edifice on which many have constructed their careers is crumbling. So, there's the equal danger that thinking becomes both elitist and also perceived as futile. 

It might not be a silver bullet, but education can still lead the way. Parents can't delegate responsibility to schools and must surely be part of the solution. And neither is confining thinking and feeling to those who appreciate Shakespeare. As veteran educationalist Sir Ken Robinson noted, there is an inherent creativity, not necessarily academic, in children that is often flattened beyond all recognition by the education system itself. Any parent of small children will know, as I do, that there is an intriguing inquisitiveness and playfulness in our early years. As a father, I want that to come alive in my children. 

Education can close the gap between pleasure and thinking. The teachers I remember well took the kindling of dry subjects and ignited them. Philip Womack recently said, in The Spectator, that children's literature is increasingly becoming 'easily translated, and easily disseminated, but will it sing in a child's mind, or set it alight?'. 'With a massive decline in children reading for pleasure, this trend will become worse, as publishers attempt to lure children away from screens with increasingly desperate pandering.'  

So let's remove the competition: we must implement Jonathan Haidt's pleadings around banning smartphones for the young. They steal away resilience. 

The division between head and heart is the sort of false dichotomy that works well on an Instagram reel but fails to account that thinking and feeling are not in opposition.

But in a reactive world, what else can we adopt to ensure each child grows up with agency over their thoughts and feelings? Where might deeper resources come from that we can build upon? The Christian tradition offers us a solid foundation. This might not seem instinctive, as Christians can take a dualistic approach to thinking and feeling. I've often heard talk about 'head knowledge' and 'heart knowledge', among some of the Christians I hear. The former is dry and irrelevant at best, and something more sinister at worst. Blaise Pascal wouldn't have recognised this. Sadly, sometimes the more exuberant expressions of Christianity have championed anti-intellectualism. The division between head and heart is the sort of false dichotomy that works well on an Instagram reel but fails to account that thinking and feeling are not in opposition. Advertisers have long understood this.  

Looking back historically, there was an understanding that one's heart comprised both the emotions and thinking. Tennyson encouraged us to 'keep your head about you', and someone losing their temper might phrase it as 'I'm losing my mind.' If our heads are online, it's not just our heads that are on the line. 

Further back, St Paul writes about the Gentiles' 'futile' thinking. There's that F word again. He writes that: 

'They are darkened in their understanding and separated from the life of God because of the ignorance that is in them due to the hardening of their hearts. Having lost all sensitivity, they have given themselves over to sensuality so as to indulge in every kind of impurity, and they are full of greed.' 

To be desensitised to an incarnate life is to numb our thinking and feeling. And the numbing that Paul writes of here is to be separated from the life of God. Paul wants his fellow believers to have 'the eyes of their hearts' enlightened. And the enlightening here is the revelation of who God is. 

This was the gift of the printing press at the time of the Reformation - that power resides not in the pulpit, but in the people's hands. We are now at danger of delegating our thinking and feeling not to a priest but to AI. The Bible is not a straightforward life manual that will tell you which school to send your children to or which car to buy. You have to think deeply, to connect the dots of the grand narrative, to engage your head and your heart. This takes us not only deeper into ourselves, but out of ourselves to one another. Paul's letter to the Ephesians emphasised the closing of the gap between types of people made possible by the cross. For this same Bible warns against being too wise in our own eyes. Ultimately, God’s thoughts are higher than ours. In him we ultimately find the place to process and develop our thoughts and feelings. 

As we convulse through another great revolution, we need to take courage that we each have agency to feel and think, if only we give them enough airtime in our crammed headspace. It's enough to make us think. And to rethink. But we can fling open the gate to an enchanting and enriching hinterland we can never fully traverse. 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief