Explainer
AI
Belief
Creed
5 min read

Whether it's AI or us, it's OK to be ignorant

Our search for answers begins by recognising that we don’t have them.

Simon Walters is Curate at Holy Trinity Huddersfield.

A street sticker displays multiple lines reading 'and then?'
Stephen Harlan on Unsplash.

When was the last time you admitted you didn’t know something? I don’t say it as much as I ought to. I’ve certainly felt the consequences of admitting ignorance – of being ridiculed for being entirely unaware of a pop culture reference, of being found out that I wasn’t paying as close attention to what my partner was saying as she expected. In a hyper-connected age when the wealth of human knowledge is at our fingertips, ignorance can hardly be viewed as a virtue. 

A recent study on the development of artificial intelligence holds out more hope for the value of admitting our ignorance than we might have previously imagined. Despite wide-spread hype and fearmongering about the perils of AI, our current models are in many ways developed in similar ways to how an animal is trained. An AI system such as ChatGPT might have access to unimaginable amounts of information, but it requires training by humans on what information is valuable or not, whether it has appropriately understood the request it has received, and whether its answer is correct. The idea is that human feedback helps the AI to hone its model through positive feedback for correct answers, and negative feedback for incorrect answers, so that it keeps whatever method led to positive feedback and changes whatever method led to negative feedback. It really isn’t that far away from how animals are trained. 

However, a problem has emerged. AI systems have become adept at giving coherent and convincing sounding answers that are entirely incorrect. How has this happened? 

This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality. 

In digging into the training method for AI, the researchers found that the humans training the AI flagged answers of “I don’t know” as unsatisfactory. On one level this makes sense. The whole purpose of these systems is to provide answers, after all. But rather than causing the AI to return and rethink its data, it instead developed increasingly convincing answers that were not true whatsoever, to the point where the human supervisors didn’t flag sufficiently convincing answers as wrong because they themselves didn’t realise that they were wrong. The result is that “the more difficult the question and the more advanced model you use, the more likely you are to get well-packaged, plausible nonsense as your answer.” 

Uncovering some of what is going on in AI systems dispels both the fervent hype that artificial intelligence might be our saviour, and the deep fear that it might be our societal downfall. This is a tool; it is good at some tasks, and less good at others. And, like all tools, it does not have an intrinsic morality. Whether it is used for good or ill depends on the approach of the humans that use it. 

But this study also uncovers our strained relationship with ignorance. Problems arise in the answers given by systems like ChatGPT because a convincing answer is valued more than admitting ignorance, even if the convincing answer is not at all correct. Because the AI has been trained to avoid admitting it doesn’t know something, all of its answers are less reliable, even the ones that are actually correct.  

This is not a problem limited to artificial intelligence. I had a friend who seemed incapable of admitting that he didn’t know something, and whenever he was corrected by someone else, he would make it sound like his first answer was actually the correct one, rather than whatever he had said. I don’t know how aware he was that he did this, but the result was that I didn’t particularly trust whatever he said to be correct. Paradoxically, had he admitted his ignorance more readily, I would have believed him to be less ignorant. 

It is strange that admitting ignorance is so avoided. After all, it is in many ways our default state. No one faults a baby or a child for not knowing things. If anything, we expect ignorance to be a fuel for curiosity. Our search for answers begins in the recognition that we don’t have them. And in an age where approximately 500 hours of video is uploaded to YouTube every minute, the sum of what we don’t know must by necessity be vastly greater than all that we do know. What any one of us can know is only a small fraction of all there is to know. 

Crucially, admitting we do not know everything is not the same as saying that we do not know anything

One of the gifts of Christian theology is an ability to recognize what it is that makes us human. One of these things is the fact that any created thing is, by definition, limited. God alone is the only one who can be described by the ‘omnis’. He is omnipotent, omnipresent, and omniscient. There is no limit to his power, and presence, and knowledge. The distinction between creator and creation means that created things have limits to their power, presence, and knowledge. We cannot do whatever we want. We cannot be everywhere at the same time. And we cannot know everything there is to be known.  

Projecting infinite knowledge is essentially claiming to be God. Admitting our ignorance is therefore merely recognizing our nature as created beings, acknowledging to one another that we are not God and therefore cannot know everything. But, crucially, admitting we do not know everything is not the same as saying that we do not know anything. Our God-given nature is one of discovery and learning. I sometimes like to imagine God’s delight in our discovery of some previously unknown facet of his creation, as he gets to share with us in all that he has made. Perhaps what really matters is what we do with our ignorance. Will we simply remain satisfied not to know, or will it turn us outwards to delight in the new things that lie behind every corner? 

For the developers of ChatGPT and the like, there is also a reminder here that we ought not to expect AI to take on the attributes of God. AI used well in the hands of humans may yet do extraordinary things for us, but it will not truly be able to do anything, be everywhere, or know everything. Perhaps if it was trained to say ‘I don’t know’ a little more, we might all learn a little more about the nature of the world God has made. 

Article
Attention
Creed
Education
Psychology
6 min read

We miss so much when we only see what we are looking for

Explaining why we don't see the unseen - with the help of a gorilla.
A blurred image of a blindfolded man.
Manuel Bonadeo on Unsplash.

In a thriving Pentecostal Church on an English city street, a room full of worshippers are singing, clapping, dancing and throwing their hands in the air. The preacher cries “Come, Holy Spirit!” and there are cries of “Amen!” and “Yes Lord!” One person has tears on their cheeks.  

A few doors down, a few dozen Anglicans also gather. Heads bent over their liturgy books, there is a hum of responses and an air of reverence. “Give us the joy of your saving help: and sustain us with your life-giving Spirit.” The altar candles flicker as the community settles itself into pews. The Holy Spirit is no less present to these worshippers, although they respond in a completely different way.  

Both churches share one creed, in which they commit to their belief in God as the source of all things, seen and unseen. Whilst Pentecostal theologies tend to focus on the observable and unpredictable signs of the Spirit at work, many Anglicans would describe the Spirit in terms of an inner experience, perhaps one that is cognitive rather than physical. But either way, Christians share one belief – that God is present in the world, and we call that the Holy Spirit.  

However, there are also hundreds of people who walk past both of these churches, week by week, who would never dream of setting foot inside. Many of them will think that anyone who believes in God is deluded or deceived. Such rationalist thinkers often have a strongly monist view of the world, in which everything, even mysterious things such as human consciousness and perception of non-physical entities, must have a physical or biological basis. As Ebenezer Scrooge says to the apparent ghost of Marley in Charles Dickens’ book, A Christmas Carol, “You may be an undigested bit of beef, a blot of mustard, a crumb of cheese, a fragment of an underdone potato. There's more gravy than of grave about you, whatever you are!” 

It is almost impossible to convince someone who hasn’t had a first first-hand experience of God that anything like the Holy Spirit exists. Many nay-sayers, I suspect, quietly (or maybe not so quietly) believe that their unbelief is because they are more rational and maybe even more intelligent than those who get excited by such things. But there is another possible explanation for why some people apparently cannot, or will not, see the unseen.  

The British education system is heavily orientated towards STEM. Even when more creative subjects such as literature find their way into the syllabus, they are often studied in a rather dry and analytical way. Notwithstanding the efforts of the occasional maverick teacher, I recall much time spent learning how to identify the iambic pentameter of Shakespeare, and little (if any) time learning to articulate how his sonnets made me feel. Such a system turns out good scientists, but it may be that in doing so it trains our young people out of being able to perceive a whole raft of things which are arguably just as important to human flourishing.  

The world around us contains significantly more sensory input than our minds can process, so we simply don’t pay attention to most of it. 

A “selective attention test” can quickly prove this point. I did one recently with a room full of psychology undergraduates, almost all of whom had identified as monists. “Since you guys are the brightest and the best,” I simpered “let’s do a little intelligence test. Apparently only five per cent of the general population get the answer right to this puzzle, but in this room, I expect the success rate will be a little higher…”  

Having primed them by flattering their egos, I proceeded to show them a video called “The Monkey Business Illusion”, designed in 2009 by scientists Christopher Chabris and Daniel Simons. During the short film, a group of people pass basket balls to each other, and viewers are asked to count how many times the players wearing white shirts pass the ball. It seems simple enough, and when the film ended, I asked the students how many counted the right number of passes. Almost every hand in the room went up. No surprises there.  

Then I asked the more important question – who saw the gorilla? There was a smattering of laughter, and this time only about half of the hands went up. Meanwhile, the other half of my students were looking around at their peers, utterly confused… 

But it was true. In “The Monkey Business Illusion”, a person in a 6ft gorilla costume walks right across the middle of the scene, weaving through the players in the game. However, because most viewers are intently focussed on watching the players in white, they simply don’t perceive it. You can try this for yourself - the video I’m talking about can be found easily on YouTube, and if you follow the search term “selective attention test” there are many others like it.  

The material point is that the world around us contains significantly more sensory input than our minds can process, so we simply don’t pay attention to most of it. If you pause for a moment right now, you might notice that there is the hum of a heater in your room, or the noise of traffic outside, or the smell of an air freshener, or that a piece of your clothing that is too tight – things you were simply not aware of until I pointed them out. It’s common that we don’t perceive things until something else makes us think that they are important. If someone tells you that your house might have structural damage, you will suddenly start to notice every creak that comes from your walls and ceilings, even though those creaks have probably been happening for years.  

As social beings, we can be easily conditioned into paying attention to certain things and ignoring others. If I tell a group of students that intelligent people are highly attentive to the players in white shirts, I increase the likelihood that they simply will not notice a gorilla.  

There is good research to show that children, even in our modern and secular society, are inherently spiritual – most young kids believe in God, or gods, fairies and the existence of many things unseen. But this is not celebrated in our STEM focussed education system, wherein young minds are highly conditioned to let go of such “irrational” beliefs and trust in the full explanatory power of science. It is so effective that, by the time they get to my classroom at university, I’ve got little hope of persuading any of my monists that there was a 6ft gorilla without showing the video again and letting them see it for themselves.  

But there are always some people who are willing to challenge the idea that Marley was just an undigested bit of beef. There are always some people who attend churches of one type or another, or practice other forms of spirituality and religion. Some pray, some meditate, and many take part in rituals. This trains them in what anthropologist Tanya Luhrmann calls “micro-processes of attending”, leaving them more ready to perceive spiritual things instead of screening them out of their conscious awareness. How they respond might depend on preferred tradition – dancing, liturgy, or a little bit of both. But all agree that there is something going on that is unseen and important.  

Many STEM educated, highly rational and fully committed monists no doubt think that those who attend churches are deluded and deceived into perceiving unseen things are simply just not there. These nay-sayers have been taught, implicitly and explicitly, that it is more intelligent to believe in the all-explanatory power of science. But perhaps it is they who have been deluded and deceived? As the Monkey Business Illusion demonstrates, if you flatter someone’s intelligence enough, it becomes entirely possible to hide a 6ft gorilla in plain sight.  

Watch the Monkey Business Illusion

Celebrate our 2nd birthday!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.
If you enjoy Seen & Unseen, would you consider making a gift towards our work?
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.
Graham Tomlin
Editor-in-Chief