Article
AI - Artificial Intelligence
Culture
5 min read

What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre
A digital momento mori.
Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this? 

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. 

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct? 

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness. 

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)  

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.  

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality. 

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality. 

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality. 

Article
Books
Culture
Original sin
Trust
6 min read

When the penny drops, on the Salt Path or a London street

Being taken in unleashes dark, unpalatable emotions

Susan is a writer specialising in visual arts and contributes to Art Quarterly, The Tablet, Church Times and Discover Britain.

A painting show Adam and Eve wide-eyed after the fall.
Paradise Lost, Emil Nolde, 1921.
Nolde Foundation Seebüll.

Doubts about the honesty of The Salt Path, Raynor Winn’s memoir of walking the Southwest coastal path with her ill husband Moth, have raged in the past weeks. Investigations revealing the duo’s real names, financial history and the medical unlikelihood of the reversals in Moth’s degenerative condition, as presented in the book, provoked thousands of readers to express anger and disappointment at being duped. But being taken in and learning from it is part of being human: a lesson in how to trust more wisely, rather than not trusting at all 

Last summer I was scam mugged on my local high street. Passing a frail pensioner pulling loose notes from his pocket, I picked up his fallen tenners and returned them. Six steps later, a woman shrieking I’d thieved her “granddad’s” money grabbed my arm. Cue a few minutes of struggling and shouting, before I got away, bruised and humiliated, but still gripping my bag. Vowed afterwards to always walk on by if I saw someone needing help on London’s streets, as it could be a set up. 
But this detachment didn’t last. Being a goodish Samaritan is hardwired, even on the capital’s occasionally mean streets. We want to support and connect with our brothers and sisters. Withdrawal from our fellow citizens makes us more unsafe, not less. As Kaya Comer-Schwartz, London’s Deputy Mayor for Policing and Crime, said: “The safety of our town centres is more than just policing – it's about building stronger, more connected communities where everyone feels secure.” 

Certainly, a police officer would have been a welcome sight while tussling with my would-be conwoman. But I was grateful to the handful of people who stopped, as they would be my witnesses if the assailant went full mugger, in frustration that the ploy for me to open my bag had gone awry.  

Memoirs also entreat us to bear witness, explaining the betrayal felt by some of the Salt Path’s two million readers who invested emotion and empathy in its uplifting tale of a hard -done -by couple finding solace in nature. Identifying with the memoir’s midlife, everyman duo and believing a long trek through the Southwest is a silver bullet for homelessness, financial woes and degenerative medical conditions, does not make the Salt Path’s former fans saps, it makes them beautifully human.  

Raynor and Moth’s unmasking as Sally and, still remarkably healthy, Tim Walker, who lost their Welsh farmhouse following accusations of embezzlement against Sally and owned a property in France when claiming to be homeless, has lifted the lid on the publishing industry’s hunger for real life stories, with morally simple, feelgood narrative arcs. Bonus points if the tale includes a “nature cure”, where nature is not just a balm for grief and pain, but somehow vanquishes it altogether. Fact checking takes a lower priority than shaping a story into a series of emotional hot button scenes, with a neat, satisfying ending. And publishers may be guilty of their own sleight-of-hand by incentivising booksellers to personally recommend to customers a list of predetermined titles, creating the aura of ‘word of mouth’ hits. 

Mean Girls’ great line “Jealous much?” captures journalists’ enthusiasm, mine included, for the Salt Path scandal. How can bestseller success pass over writers with have spent decades crafting phrases like popular orange vegetable to avoid writing carrot twice, yet shine on Raynor/ Sally’s repetitive, clunky prose? ”We lost. Lost the case. Lost the house.” Her dizzying ascent from unknown debut non-fiction author, with only a piece in the Big Issue to her name, to a book deal with Penguin, seems to other writers a mystery as great as anything in her trekking tale. 

Feeling deceived unleashes these dark, unpalatable emotions such as envy and desire for revenge. I long nourished fantasies of catching the scammers in action and deflecting their next victim by shouting “Look! Granddad’s dropping his money again,” before handily nearby forces of law and order brought them to book. Even if you lose little materially from a con, the loss of dignity and sense of agency from becoming a mark, a manipulated, dehumanised bit player in another’s exploitive narrative, takes time to get over.  

Popular accounts of online romance fraud feel designed to give audiences a sense of superiority, ‘I’d see that coming a mile off’, over the victims, reinforcing their sense of shame. Yet evidently with many thousands being lured by romance fraud, the perpetrators use effective psychological coercion techniques. Omniscient superiority needs to be replaced with empathy and support for fleeced, broken-hearted victims. 

Grifters are part of life, but their reductive, empathy-free, world view does not have to be. As singer Nick Cave’s counsels, cynicism is not the answer: "Cynicism is not a neutral position — and although it asks almost nothing of us, it is highly infectious and unbelievably destructive. In my view, it is the most common and easy of evils.”  

Religious origin stories, including the Garden of Eden, contain an element of falling for a trick. Eve does the serpent’s bidding, and she and Adam are banished from paradise. “So he drove out the man; and he placed at the east of the garden of Eden Cherubims, and a flaming sword which turned every way, to keep the way of the tree of life.” Emil Nolde’s painting Paradise Lost, 1921, catches perfectly the moment the penny drops with Adam and Eve on the consequences of falling for the serpent. Yet by the following chapter of Genesis they start a family, moving on with life with new insight. 

To never confront disappointment would be to remain as an infant, without the opportunities to grow and develop as adults. 

In the Good Samaritan, one of the best-known parables, Jesus transforms the categorising question ‘who is my neighbour?’ into the universal quest of ‘how can I be a better neighbour’? Our bonds with our communities, a sense of shared humanity are the best, possibly the only defence, against those who would mislead us or do us harm. 

Celebrated American journalist Ira Glass said: “Great stories happen to those who can tell them.” Published in 2018, The Salt Path’s direct, film-like scenes of survival against the odds and against the elements, would have resonated with all the people who saw their security and lifestyle nosedive after the 2008 financial crash, never to recover. Suspending disbelief, Raynor and Moth’s 620-mile wild camping trek, represented a symbolic railing against a heartless economic system. 

My experience of the penny dropping a fraction too late to escape the scammers, has made me revise my self image as a streetwise Londoner. On my way to pick up holiday money that afternoon, my head was full of travel plans rather than focused on the here and now, a tendency I must curb.  

If my assailant was writing her memoir I like to think our scrap would be the opening chapter, where she is at a crossroads of having to mug somebody in broad daylight, with a small, attentive audience, or rethink her street hustling career. Dressed in a fake leather biker jacket on a hot summer day - the smell lingers in my olfactory memory - her outfit was possibly an homage to Catherine Zeta Jones’ catsuit in Entrapment. As we know from all the TV series on con artists, looking the part is key. 

 Finding out the reality of her life since I broke free of her grip 11 months ago would not be hard, as she is now stationed outside Premier Foods by the tube station, in much scruffier clothes, asking for a pound for water. This sideways, or probably downwards move, in the street economy appears to be working out for her, and the peace of the neighbourhood. 

Despite having lived in small rural communities for decades, throughout all The Salt Path controversy, nobody has come forward to say the Winns / Walkers were good neighbours. Setting this right could be their next adventure and next bestseller. 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief