Article
AI - Artificial Intelligence
Creed
Wisdom
6 min read

Forget AI: I want a computer that says ‘no’

Chatbots only tell us what we want to hear. If we genuinely want to grow, we need to be OK with offence

Paul is a pioneer minister, writer and researcher based in Poole, Dorset.

A person hold their phone on their desk, a think bubble from it says 'no'.
Nick Jones/Midjourney.ai.

It is three years since the public release of Open AI’s ChatGPT. In those early months, this new technology felt apocalyptic. There was excitement, yes – but also genuine concern that ChatGPT, and other AI bots like it, had been released on an unsuspecting public with little assessment or reflection on the unintended consequences they might have the potential to make. In March 2023, 1,300 experts signed an open letter calling for a six month pause in AI labs training of the most advanced systems arguing that they represent an ‘existential risk’ to humanity. In the same month Time magazine published an article by a leading AI researcher which went further, saying that the risks presented by AI had been underplayed. The article visualised a civilisation in which AI had liberated itself from computers to dominate ‘a world of creatures, that are, from its perspective, very stupid and very slow.’ 

But then we all started running our essays through it, creating emails, and generating the kind of boring documentation demanded by the modern world. AI is now part of life. We can no more avoid it than we can avoid the internet. The genie is well and truly out of the bottle.  

I will confess at this point to having distinctly Luddite tendencies when it comes to technology. I read Wendell Berry’s famous essay ‘Why I will not buy a computer’ and hungered after the agrarian, writerly world he appeared to inhabit; all kitchen tables, musty bookshelves, sharpened pencils and blank pieces of paper. Certainly, Berry is on to something. Technology promises much, delivers some, but leaves a large bill on the doormat. Something is lost, which for Berry included the kind of attention that writing by hand provides for deep, reflective work.  

This is the paradox of technology – it gives and takes away. What is required of us as a society is to take the time to discern the balance of this equation. On the other side of the equation from those heralding the analytical speed and power of AI are those deeply concerned for ways in which our humanity is threatened by its ubiquity. 

In Thailand, where clairvoyancy is big business, fortune tellers are reportedly seeing their market disrupted by AI as a growing number of people turn to chat bots to give them insights into their future instead.  

A friend of mine uses an AI chatbot to discuss his feelings and dilemmas. The way he described his relationship with AI was not unlike that of a spiritual director or mentor.  

There are also examples of deeply concerning incidents where chat bots have reportedly encouraged and affirmed a person’s decision to take their own life. Adam took his own life in April this year. His parents have since filed a lawsuit against OpenAI after discovering that ChatGPT had discouraged Adam from seeking help from them and had even offered to help him write a suicide note. Such stories raise the critical question of whether it is life-giving and humane for people to develop relationships of dependence and significance with a machine. AI chat bots are highly powerful tools masquerading behind the visage of human personality. They are, one could argue, sophisticated clairvoyants mining the vast landscape of the internet, data laid down in the past, and presenting what they extract as information and advice. Such an intelligence is undoubtedly game changing for diagnosing diseases, when the pace of medical research advances faster than any GP can cope with. But is it the kind of intelligence we need for the deeper work of our intimate selves, the soul-work of life? 

Of course, AI assistants are more than just a highly advanced search engines. They get better at predicting what we want to know. Chatbots essentially learn to please their users. They become our sycophantic friends, giving us insights from their vast store of available knowledge, but only ever along the grain of our desires and needs. Is it any wonder people form such positive relationships with them? They are forever telling us what we want to hear.  

Or at least what we think we want to hear. Because any truly loving relationship should have the capacity and freedom to include saying things which the other does not want to hear. Relationships of true worth are ones which take the risk of surprising the other with offence in order to move toward deeper life. This is where user’s experience suggests AI is not proficient. Indeed, it is an area I suggest chatbots are not capable of being proficient in. To appreciate this, we need to explore a little of the philosophy of knowledge generation.  

Most of us probably recognise the concepts of deduction and induction as modes of thought. Deduction is the application of a predetermined rule (‘A always means B…’) to a given experience which then confidently predicts an outcome (‘therefore C’). Induction is the inference of a rule from series of varying (but similar) experiences (‘look at all these slightly different C’s – it must mean that A always means B’). However, the nineteenth century philosopher CS Pierce described a third mode of thought that he called abduction.  

Abduction works by offering a provisional explanatory context to a surprising experience or piece of information. It postulates, often very creatively and imaginatively, a hypothesis, or way of seeing things, that offers to make sense of new experience. The distinctives of abduction include intuition, imagination, even spiritual insight in the working towards a deeper understanding of things. Abductive reasoning for example includes the kind of ‘eureka!’ moment of explanation which points to a deeper intelligence, a deeper connectivity in all things that feels out of reach to the human mind but which we grasp at with imaginative and often metaphorical leaps.  

The distinctive thing about abductive reasoning, as far as AI chatbots are concerned, lies in the fact that it works by introducing an idea that isn’t contained within the existing data and which offers an explanation that the data would not otherwise have. The ‘wisdom’ of chatbots on the other hand is really only a very sophisticated synthesis of existing data, shaped by a desire to offer knowledge that pleases its end user. It lacks the imaginative insight, the intuitive perspective that might confront, challenge, but ultimately be for our benefit. 

If we want to grow in the understanding of ourselves, if we genuinely want to do soul-work, we need to be open to the surprise of offence; the disruption of challenge; the insight from elsewhere; the pain of having to reimagine our perspective. The Christian tradition sometimes calls this wisdom prophecy. It might also be a way of understanding what St Paul meant by the ‘sword of the Spirit’. It is that voice, that insight of deep wisdom, which doesn’t sooth but often smarts, but which we come to appreciate in time as a word of life. Such wisdom may be conveyed by a human person, a prophet. And the Old Testament’s stories suggests that its delivery is not without costs to the prophet, and never without relationship. A prophet speaks as one alongside in community, sharing something of the same pain, the same confusion. Ultimately such wisdom is understood to be drawn from divine wisdom, God speaking in the midst of humanity   

You don’t get that from a chatbot, you get that from person-to-person relationships. I do have the computer (sorry Wendell!), but I will do my soul-work with fellow humans. And I will not be using an AI assistant. 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief

1,000th Article
AI - Artificial Intelligence
Creed
Death & life
Digital
6 min read

AI deadbots are no way to cope with grief

The data we leave in the cloud will haunt and deceive those we leave behind.

Graham is the Director of the Centre for Cultural Witness and a former Bishop of Kensington.

A tarnished humaniod robot rests its head to the side, its LED eyes look to the camera.
Nicholas Fuentes on Unsplash.

What happens to all your data when you die? Over the years, like most people, I've produced a huge number of documents, letters, photos, social media posts, recordings of my voice, all of which exist somewhere out there in the cloud (the digital, not the heavenly one). When I die, what will happen to it all? I can't imagine anyone taking the time to climb into my Dropbox folder or Instagram account and delete it all? Does all this stuff remain out there cluttering up cyberspace like defunct satellites orbiting the earth?  

The other day I came across one way it might have a future - the idea of ‘deadbots’. Apparently, AI has now developed to such an extent that it can simulate the personality, speech patterns and thoughts of a deceased person. In centuries past, most people did not leave behind much record of their existence. Maybe a small number of possessions, memories in the minds of those who knew them, perhaps a few letters. Now we leave behind a whole swathe of data about us. AI is now capable of taking all this data and creating a kind of animated avatar, representing the deceased person, known as a ‘deadbot’ or even more weirdly, a ‘griefbot’. 

You can feel the attraction. An organisation called ‘Project December’ promises to ‘simulate the dead’, offering a ghostly video centred around the words ‘it’s been so long: I miss you.’ For someone stricken with grief, wondering whether there's any future in life now that their loved one has gone, feeling the aching space in the double bed, breakfast alone, the silence where conversation once filled the air, the temptation to be able to continue to interact and talk with a version of the deceased might be irresistible. 

There is already a developing ripple of concern about this ‘digital afterlife industry’. A recent article in Aeon explored the ethical dilemmas. Researchers in Cambridge University have already called for the need for safety protocols against the social and psychological damage that such technology might cause. They focus on the potential for unscrupulous marketers to spam surviving family or friends with the message that they really need XXX because ‘it's what Jim would have wanted’. You can imagine the bereaved ending up being effectively haunted by the ‘deadbot’, and unable to deal with grief healthily. It can be hard to resist for those whose grief is all-consuming and persistent. 

Yet it's not just the financial dangers, the possibility of abuse that troubles me. It's the deception involved which seems to me to operate in at a number of ways. And it's theology that helps identify the problems.  

The offer of a disembodied, AI-generated replication of the person is a thin paltry offering, as dissatisfying as a Zoom call in place of a person-to-person encounter. 

An AI-generated representation of a deceased partner might provide an opportunity for conversation, but it can never replicate the person. One of the great heresies of our age (one we got from René Descartes back in the seventeenth century) is the utter dualism between body and soul. It is the idea that we have some kind of inner self, a disembodied soul or mind which exists quite separately from the body. We sometimes talk about bodies as things that we have rather than things that we are. The anthropology taught within the pages of the Bible, however, suggests we are not disembodied souls but embodied persons, so much so that after death, we don't dissipate like ethereal ‘software’ liberated from the ‘hardware’ of the body, but we are to be clothed with new resurrection bodies continuous with, but different from the ones that we possess right now. 

We learned about the importance of our bodies during the COVID pandemic. When we were reduced to communicating via endless Zoom calls, we realised that while they were better than nothing, they could not replicate the reality of face-to-face bodily communication. A Zoom call couldn't pick up the subtle messages of body language. We missed the importance of touch and even the occasional embrace. Our bodies are part of who we are. We are not souls that happen to temporarily inhabit a body, inner selves that are the really important bit of us, with the body an ancillary, malleable thing that we don't ultimately need. The offer of a disembodied, AI-generated replication of the person is a thin paltry offering, as dissatisfying as a virtual meeting in place of a person-to-person encounter. 

Another problem I have with deadbots, is that they fix a person in time, like a fossilised version of the person who once lived. AI can only work with what that person has left behind - the recordings, the documents, the data which they produced while they were alive. And yet a crucial part of being human is the capacity to develop and change. As life continues, we grow, we shift, our priorities change. Hopefully we learn greater wisdom. That is part of the point of conversation, that we learn things, it changes us in interaction with others. There is the possibility of spiritual development of maturity, of redemption. A deadbot cannot do that. It cannot be redeemed, it cannot be transformed, because it is, to quote U2, stuck in a moment, and you can’t get out of it.  

This is all of a piece with a general trajectory in our culture which is to deny the reality of death. For Christians, death is an intruder. Death - or at least the form in which we know it, that of loss, dereliction, sadness - was not part of the original plan. It doesn't belong here, and we long for the day when one day it will be banished for good. You don’t have to be a Christian to feel the pain of grief, but paradoxically it's only when you have a firm sense of hope that death is a defeated enemy, that you can take it seriously as a real enemy. Without that hope, all you can do is minimise it, pretend it doesn't really matter, hold funerals that try to be relentlessly cheerful, denying the inevitable sense of tragedy and loss that they were always meant to express.  

Deadbots are a feeble attempt to try to ignore the deep gulf that lies between us and the dead. In one of his parables, Jesus once depicted a conversation between the living and the dead:  

“between you and us a great chasm has been fixed, so that those who might want to pass from here to you cannot do so, and no one can cross from there to us.”  

Deadbots, like ‘direct cremations’, where the body is disposed without any funeral, denying the bereaved the chance to grieve, like the language around assisted dying that death is ‘nothing at all’ and therefore can be deliberately hastened, are an attempt to bridge that great chasm, which, this side of the resurrection, we cannot do. 

Deadbots in one sense are a testimony to our remarkable powers of invention. Yet they cannot ultimately get around our embodied nature, offer the possibility of redemption, or deal with the grim reality of death. They offer a pale imitation of the source of true hope - the resurrection of the body, the prospect of meeting our loved ones again, yet transformed and fulfilled in the presence of God, even if it means painful yet hopeful patience and waiting until that day. 

Celebrate with us - we're 2!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief