Article
AI - Artificial Intelligence
Creed
Wisdom
6 min read

Forget AI: I want a computer that says ‘no’

Chatbots only tell us what we want to hear. If we genuinely want to grow, we need to be OK with offence

Paul is a pioneer minister, writer and researcher based in Poole, Dorset.

A person hold their phone on their desk, a think bubble from it says 'no'.
Nick Jones/Midjourney.ai.

It is three years since the public release of Open AI’s ChatGPT. In those early months, this new technology felt apocalyptic. There was excitement, yes – but also genuine concern that ChatGPT, and other AI bots like it, had been released on an unsuspecting public with little assessment or reflection on the unintended consequences they might have the potential to make. In March 2023, 1,300 experts signed an open letter calling for a six month pause in AI labs training of the most advanced systems arguing that they represent an ‘existential risk’ to humanity. In the same month Time magazine published an article by a leading AI researcher which went further, saying that the risks presented by AI had been underplayed. The article visualised a civilisation in which AI had liberated itself from computers to dominate ‘a world of creatures, that are, from its perspective, very stupid and very slow.’ 

But then we all started running our essays through it, creating emails, and generating the kind of boring documentation demanded by the modern world. AI is now part of life. We can no more avoid it than we can avoid the internet. The genie is well and truly out of the bottle.  

I will confess at this point to having distinctly Luddite tendencies when it comes to technology. I read Wendell Berry’s famous essay ‘Why I will not buy a computer’ and hungered after the agrarian, writerly world he appeared to inhabit; all kitchen tables, musty bookshelves, sharpened pencils and blank pieces of paper. Certainly, Berry is on to something. Technology promises much, delivers some, but leaves a large bill on the doormat. Something is lost, which for Berry included the kind of attention that writing by hand provides for deep, reflective work.  

This is the paradox of technology – it gives and takes away. What is required of us as a society is to take the time to discern the balance of this equation. On the other side of the equation from those heralding the analytical speed and power of AI are those deeply concerned for ways in which our humanity is threatened by its ubiquity. 

In Thailand, where clairvoyancy is big business, fortune tellers are reportedly seeing their market disrupted by AI as a growing number of people turn to chat bots to give them insights into their future instead.  

A friend of mine uses an AI chatbot to discuss his feelings and dilemmas. The way he described his relationship with AI was not unlike that of a spiritual director or mentor.  

There are also examples of deeply concerning incidents where chat bots have reportedly encouraged and affirmed a person’s decision to take their own life. Adam took his own life in April this year. His parents have since filed a lawsuit against OpenAI after discovering that ChatGPT had discouraged Adam from seeking help from them and had even offered to help him write a suicide note. Such stories raise the critical question of whether it is life-giving and humane for people to develop relationships of dependence and significance with a machine. AI chat bots are highly powerful tools masquerading behind the visage of human personality. They are, one could argue, sophisticated clairvoyants mining the vast landscape of the internet, data laid down in the past, and presenting what they extract as information and advice. Such an intelligence is undoubtedly game changing for diagnosing diseases, when the pace of medical research advances faster than any GP can cope with. But is it the kind of intelligence we need for the deeper work of our intimate selves, the soul-work of life? 

Of course, AI assistants are more than just a highly advanced search engines. They get better at predicting what we want to know. Chatbots essentially learn to please their users. They become our sycophantic friends, giving us insights from their vast store of available knowledge, but only ever along the grain of our desires and needs. Is it any wonder people form such positive relationships with them? They are forever telling us what we want to hear.  

Or at least what we think we want to hear. Because any truly loving relationship should have the capacity and freedom to include saying things which the other does not want to hear. Relationships of true worth are ones which take the risk of surprising the other with offence in order to move toward deeper life. This is where user’s experience suggests AI is not proficient. Indeed, it is an area I suggest chatbots are not capable of being proficient in. To appreciate this, we need to explore a little of the philosophy of knowledge generation.  

Most of us probably recognise the concepts of deduction and induction as modes of thought. Deduction is the application of a predetermined rule (‘A always means B…’) to a given experience which then confidently predicts an outcome (‘therefore C’). Induction is the inference of a rule from series of varying (but similar) experiences (‘look at all these slightly different C’s – it must mean that A always means B’). However, the nineteenth century philosopher CS Pierce described a third mode of thought that he called abduction.  

Abduction works by offering a provisional explanatory context to a surprising experience or piece of information. It postulates, often very creatively and imaginatively, a hypothesis, or way of seeing things, that offers to make sense of new experience. The distinctives of abduction include intuition, imagination, even spiritual insight in the working towards a deeper understanding of things. Abductive reasoning for example includes the kind of ‘eureka!’ moment of explanation which points to a deeper intelligence, a deeper connectivity in all things that feels out of reach to the human mind but which we grasp at with imaginative and often metaphorical leaps.  

The distinctive thing about abductive reasoning, as far as AI chatbots are concerned, lies in the fact that it works by introducing an idea that isn’t contained within the existing data and which offers an explanation that the data would not otherwise have. The ‘wisdom’ of chatbots on the other hand is really only a very sophisticated synthesis of existing data, shaped by a desire to offer knowledge that pleases its end user. It lacks the imaginative insight, the intuitive perspective that might confront, challenge, but ultimately be for our benefit. 

If we want to grow in the understanding of ourselves, if we genuinely want to do soul-work, we need to be open to the surprise of offence; the disruption of challenge; the insight from elsewhere; the pain of having to reimagine our perspective. The Christian tradition sometimes calls this wisdom prophecy. It might also be a way of understanding what St Paul meant by the ‘sword of the Spirit’. It is that voice, that insight of deep wisdom, which doesn’t sooth but often smarts, but which we come to appreciate in time as a word of life. Such wisdom may be conveyed by a human person, a prophet. And the Old Testament’s stories suggests that its delivery is not without costs to the prophet, and never without relationship. A prophet speaks as one alongside in community, sharing something of the same pain, the same confusion. Ultimately such wisdom is understood to be drawn from divine wisdom, God speaking in the midst of humanity   

You don’t get that from a chatbot, you get that from person-to-person relationships. I do have the computer (sorry Wendell!), but I will do my soul-work with fellow humans. And I will not be using an AI assistant. 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief

Article
Attention
Creed
Education
Psychology
6 min read

We miss so much when we only see what we are looking for

Explaining why we don't see the unseen - with the help of a gorilla.
A blurred image of a blindfolded man.
Manuel Bonadeo on Unsplash.

In a thriving Pentecostal Church on an English city street, a room full of worshippers are singing, clapping, dancing and throwing their hands in the air. The preacher cries “Come, Holy Spirit!” and there are cries of “Amen!” and “Yes Lord!” One person has tears on their cheeks.  

A few doors down, a few dozen Anglicans also gather. Heads bent over their liturgy books, there is a hum of responses and an air of reverence. “Give us the joy of your saving help: and sustain us with your life-giving Spirit.” The altar candles flicker as the community settles itself into pews. The Holy Spirit is no less present to these worshippers, although they respond in a completely different way.  

Both churches share one creed, in which they commit to their belief in God as the source of all things, seen and unseen. Whilst Pentecostal theologies tend to focus on the observable and unpredictable signs of the Spirit at work, many Anglicans would describe the Spirit in terms of an inner experience, perhaps one that is cognitive rather than physical. But either way, Christians share one belief – that God is present in the world, and we call that the Holy Spirit.  

However, there are also hundreds of people who walk past both of these churches, week by week, who would never dream of setting foot inside. Many of them will think that anyone who believes in God is deluded or deceived. Such rationalist thinkers often have a strongly monist view of the world, in which everything, even mysterious things such as human consciousness and perception of non-physical entities, must have a physical or biological basis. As Ebenezer Scrooge says to the apparent ghost of Marley in Charles Dickens’ book, A Christmas Carol, “You may be an undigested bit of beef, a blot of mustard, a crumb of cheese, a fragment of an underdone potato. There's more gravy than of grave about you, whatever you are!” 

It is almost impossible to convince someone who hasn’t had a first first-hand experience of God that anything like the Holy Spirit exists. Many nay-sayers, I suspect, quietly (or maybe not so quietly) believe that their unbelief is because they are more rational and maybe even more intelligent than those who get excited by such things. But there is another possible explanation for why some people apparently cannot, or will not, see the unseen.  

The British education system is heavily orientated towards STEM. Even when more creative subjects such as literature find their way into the syllabus, they are often studied in a rather dry and analytical way. Notwithstanding the efforts of the occasional maverick teacher, I recall much time spent learning how to identify the iambic pentameter of Shakespeare, and little (if any) time learning to articulate how his sonnets made me feel. Such a system turns out good scientists, but it may be that in doing so it trains our young people out of being able to perceive a whole raft of things which are arguably just as important to human flourishing.  

The world around us contains significantly more sensory input than our minds can process, so we simply don’t pay attention to most of it. 

A “selective attention test” can quickly prove this point. I did one recently with a room full of psychology undergraduates, almost all of whom had identified as monists. “Since you guys are the brightest and the best,” I simpered “let’s do a little intelligence test. Apparently only five per cent of the general population get the answer right to this puzzle, but in this room, I expect the success rate will be a little higher…”  

Having primed them by flattering their egos, I proceeded to show them a video called “The Monkey Business Illusion”, designed in 2009 by scientists Christopher Chabris and Daniel Simons. During the short film, a group of people pass basket balls to each other, and viewers are asked to count how many times the players wearing white shirts pass the ball. It seems simple enough, and when the film ended, I asked the students how many counted the right number of passes. Almost every hand in the room went up. No surprises there.  

Then I asked the more important question – who saw the gorilla? There was a smattering of laughter, and this time only about half of the hands went up. Meanwhile, the other half of my students were looking around at their peers, utterly confused… 

But it was true. In “The Monkey Business Illusion”, a person in a 6ft gorilla costume walks right across the middle of the scene, weaving through the players in the game. However, because most viewers are intently focussed on watching the players in white, they simply don’t perceive it. You can try this for yourself - the video I’m talking about can be found easily on YouTube, and if you follow the search term “selective attention test” there are many others like it.  

The material point is that the world around us contains significantly more sensory input than our minds can process, so we simply don’t pay attention to most of it. If you pause for a moment right now, you might notice that there is the hum of a heater in your room, or the noise of traffic outside, or the smell of an air freshener, or that a piece of your clothing that is too tight – things you were simply not aware of until I pointed them out. It’s common that we don’t perceive things until something else makes us think that they are important. If someone tells you that your house might have structural damage, you will suddenly start to notice every creak that comes from your walls and ceilings, even though those creaks have probably been happening for years.  

As social beings, we can be easily conditioned into paying attention to certain things and ignoring others. If I tell a group of students that intelligent people are highly attentive to the players in white shirts, I increase the likelihood that they simply will not notice a gorilla.  

There is good research to show that children, even in our modern and secular society, are inherently spiritual – most young kids believe in God, or gods, fairies and the existence of many things unseen. But this is not celebrated in our STEM focussed education system, wherein young minds are highly conditioned to let go of such “irrational” beliefs and trust in the full explanatory power of science. It is so effective that, by the time they get to my classroom at university, I’ve got little hope of persuading any of my monists that there was a 6ft gorilla without showing the video again and letting them see it for themselves.  

But there are always some people who are willing to challenge the idea that Marley was just an undigested bit of beef. There are always some people who attend churches of one type or another, or practice other forms of spirituality and religion. Some pray, some meditate, and many take part in rituals. This trains them in what anthropologist Tanya Luhrmann calls “micro-processes of attending”, leaving them more ready to perceive spiritual things instead of screening them out of their conscious awareness. How they respond might depend on preferred tradition – dancing, liturgy, or a little bit of both. But all agree that there is something going on that is unseen and important.  

Many STEM educated, highly rational and fully committed monists no doubt think that those who attend churches are deluded and deceived into perceiving unseen things are simply just not there. These nay-sayers have been taught, implicitly and explicitly, that it is more intelligent to believe in the all-explanatory power of science. But perhaps it is they who have been deluded and deceived? As the Monkey Business Illusion demonstrates, if you flatter someone’s intelligence enough, it becomes entirely possible to hide a 6ft gorilla in plain sight.  

Watch the Monkey Business Illusion

Celebrate our 2nd birthday!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.
If you enjoy Seen & Unseen, would you consider making a gift towards our work?
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.
Graham Tomlin
Editor-in-Chief