Article
AI - Artificial Intelligence
Community
Culture
Education
5 min read

Artificial Intelligence needs these school lessons to avoid a Frankenstein fail

To learn and to learn to care are inseparable

Joel Pierce is the administrator of Christ's College, University of Aberdeen. He has recently published his first book.

A cyborg like figure opens the door to a classroom.
AI in the classroom.
Nick Jones/Midjourney.ai.

Recent worries expressed by Anthropic CEO, Dario Amodei, over the welfare of his chatbot bounced around my brain as I dropped my girls off for their first days at a new primary school last month. Maybe I felt an unconscious parallel. Maybe setting my daughters adrift in the swirling energy of a schoolyard containing ten times as many pupils as their previous one gave me a twinge of sympathy for a mogul launching his billion-dollar creation into the id-infused wilds of the internet. But perhaps it was more the feeling of disjuncture, the intuition that whatever information this bot would glean from trawling the web,it was fundamentally different from what my daughters would receive from that school, an education.  

We often struggle to remember what it is to be educated, mistaking what can be assessed in a written or oral exam for knowledge. However, as Hannah Arendt observed over a half century ago, education is not primarily about accumulating a grab bag of information and skills, but rather about being nurtured into a love for the world, to have one’s desire to learn about, appreciate, and care for that world cultivated by people whom one respects and admires. As I was reminded, watching the hundreds of pupils and parents waiting for the morning bell, that sort of education only happens in places, be it at school or in the home, where children themselves feel loved and valued.  

Our attachments are inextricably linked to learning. That’s why most of us can rattle off a list of our favourite teachers and describe moments when a subject took life as we suddenly saw it through their eyes. It’s why we can call to mind the gratitude we felt when a tutor coached us through a maths problem, lab project, or piano piece which we thought we would never master. Rather than being the pouring of facts into the empty bucket of our minds, our educations are each a unique story of connection, care, failure, and growth.  

I cannot add 8+5 without recalling my first-grade teacher, the impossibly ancient Mrs Coleman, gazing benevolently over her half-moon glasses, correcting me that it was 13, not 12. When I stride across the stage of my village pantomime this December, I know memories of a pint-sized me hamming it up in my third-grade teacher’s self-penned play will flit in and out of mind. I cannot write an essay without the voice of Professor Coburn, my exacting university metaphysics instructor, asking me if I am really saying what is truthful, or am resorting to fuzzy language to paper over my lack of understanding. I have been shaped by my teachers. I find myself repaying the debts accrued to them in the way I care for students now. To learn and to learn to care are inseparable. 

But what if they weren’t? AI seems to open the vista where intelligences can simply appear, trained not by humans, but by recursive algorithms, churning through billions of calculations on rows of servers located in isolated data centres. Yes, those calculations are mostly still done on human produced data, though the insatiable need for more has eaten through most everything freely available on the web and in whatever pirated databases of books and media these companies have been able to locate, but learning from human products is not the same as learning from human beings. The situation seems wholly original, wholly unimaginable. 

Except it was imagined in a book written over two hundred years ago which, as Guillermo del Toro’s recent attempt to capture that vision reminds us, remains incredibly relevant today. Filmmakers, and from trailers I suspect Del Toro is no different here, tend to treat the story of Frankenstein as one of glamorous transgression: Dr Frankenstein as Faust, heroically testing the limits of human knowledge and human decency. But Mary Shelley’s protagonist is an altogether more pathetic character, one who creates in an extended bout of obsessive experimentation and then spends the rest of the book running from any obligation to care for the creature he has made.  

It is the creature who is the true hero of the novel and he is a tragic one precisely because his intelligence, skills, and abilities are acquired outside the realm of human connection. When happenstance allows him to furtively observe lessons given within a loving, but impoverished family, he imagines himself into that circle of growing love and knowledge. It is when he is disabused of this notion, when the family discovers him and is disgusted, when he learns that he is doomed to know, but not be known, that he turns into a monster bent on revenge. As the Milton-quoting monster reminds Frankenstein, even Adam, though born fully grown, was nurtured by his maker. Since even this was denied creature, what choice does he have but to take the role of Satan and tear down the world that birthed him? 

Are our modern maestros of AI Dr Frankensteins? Not yet. For all the talk of sentient-like responses by LLMs, avoiding talking about distressing topics for example, the best explanation of such behaviour is that they simply are mimicking their training sets which are full of humans expressing discomfort about those same topics. However, if these companies are really as serious about developing a fully sentient AGI, about achieving the so-called singularity, as much of the buzz around them suggests, then the chief difference between them and Frankenstein is one of ability rather than ambition. If eventually they are able to realise their goals and intelligences emerge, full of information, but unnurtured and unloved, how will they behave? Is there any reason to think that they will be more Adam than Satan when we are their creators? 

At the end of Shelley’s novel, an unreconstructed Frankenstein tells his tale to a polar explorer in a ship just coming free from the pack ice. The explorer is facing the choice of plunging onward in the pursuit of knowledge, glory, and, possibly, death, or heeding the call of human connections, his sister’s love, his crew’s desire to see their families. Frankenstein urges him on, appeals to all his ambitions, hoping to drown out the call of home. He fails. The ship turns homeward. Knowledge shorn of attachment, ambition that ignores obligation, these, Shelley tells us, are not worth pursuing. Will we listen to her warning? 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief

Article
AI - Artificial Intelligence
Belief
Culture
Mental Health
Pride
4 min read

Are AI chatbots actually demons in disguise?

Early Christian thinkers explain chatbots better than Silicon Valley does

Gabrielle is Assistant Professor of Early Christianity and Anglican Studies at Emory University

An AI image of a person stood holding a phone with a bubble above their head, below them is a chatbot-like demon with a tail
Nick Jones/Midjourney.ai.

AI Chatbots. They’re here to save us, aren’t they? Their designers argue so, fervently. There’s no doubt they are useful. Some, like EpiscoBOT (formerly known as ‘Cathy’), are designed for those asking ‘life’s biggest questions. 'Our girlfriend Scarlett’, is an AI companion who “is always eager to please you in any way imaginable.”  So why not defend them?  

 They offer companionship for the lonely, spark creativity when we run on empty, and make us more productive. They also provide answers for any and every kind of question without hesitation. They are, in short, a refuge. Many chatbots come with names, amplifying our sense of safety. Names define and label things, but they do far more than that. Names foster connection. They can evoke and describe a relationship, allowing us to make intimate connections with the things named. When the “things” in question are AI chatbots, however, we can run into trouble.  

According to a study conducted by researchers at Stanford University, chatbots can contribute to “harmful stigma and dangerous responses.” More than this, they can even magnify psychotic symptoms. The more we learn, the more we are beginning to grasp that the much of the world offered by AI chatbots is an illusory one.  

Early Christian thinkers had a distinct category for precisely this kind of illusion: the demonic. They understood demons not as red, horned bodies or fiery realms, but as entities with power to fabricate illusions—visions, appearances, and deceptive signs that distorted human perception of reality. Demons also personified pride. As fallen angels, they turned away from truth toward themselves. Their illusions lured humans into sharing that pride—believing false greatness, clinging to false refuge. 

Looking back to early Christian approaches to demonology may help us see more clearly what is at stake in adopting without question AI chatbots. 

  

According to early Christian thinkers, demons rarely operated through brute force. Instead, they worked through deception. Athanasius of Alexandria (c. 296–373) was a bishop and theologian who wrote The of Antony. In this, he recounted how the great desert father was plagued by demonic visions—phantoms of wild beasts, apparitions of gold, even false angels of light. The crucial danger was not physical attack but illusion. Demons were understood as beings that manufactured appearances to confuse and mislead. A monk in his cell might see radiant light and hear beautiful voices, but he was to test it carefully, for demons disguise themselves as angels. 

Evagrius Ponticus (c. 345–399), a Christian monk, ascetic, and theologian influential in early monastic spirituality, warned that demons insinuated themselves into thought, planting ideas that felt self-generated but in fact led one astray. This notion—that the demonic is most effective when it works through appearances—shaped the entire ascetic project. To resist demons meant to resist their illusions. 

Augustine of Hippo (354–430) was a North African bishop and theologian whose writings shaped Western Christianity. In his book The City of God, he argued that pagan religion was largely a vast system of demonic deception. Demons, he argued, produced false miracles, manipulated dreams, and inspired performances in the theatre to ensnare the masses. They trafficked in spectacle, seducing imagination and desire rather than presenting truth. 

AI chatbots function in a strikingly similar register. They do not exert power by physical coercion. Instead, they craft illusion. They can produce an authoritative-sounding essay full of falsehoods. They can create images of people doing something that never happened. They can provide companionship that leads to self-harm or even suicide. Like the demonic, the chatbot operates in the register of vision, sound, and thought. It produces appearances that persuade the senses while severing them from reality. The risk is not that the chatbot forces us, but that it deceives us—just like demonic powers. 

Using AI chatbots, too, tempts us with illusions of pride. A writer may pass off AI-generated work as their own, for example. The danger here is not simply being deceived but becoming complicit in deception, using illusion to magnify ourselves. Early Christian theologians like Athanasius, Evagrius and Augustine, warned that pride was the surest sign of demonic influence. To the extent that AI tempts us toward inflated images of ourselves, it participates in the same pattern. 

When it comes to AI chatbots, we need a discipline of discernment—testing whether the images and texts bear the marks of truth or deception. Just as monks could not trust every appearance of light, we cannot trust every image or every confident paragraph produced by the chatbots. We need criteria of verification and communities of discernment to avoid mistaking illusion for reality. 

Help is at hand.  

Through the ages, Christians have responded to demonic illusions, not with naïve credulity nor blanket rejection of the sensory world, but through the hard work of discernment: testing appearances, cultivating disciplines of resistance, and orienting desire toward truth.  

The Life of Antony describes how the monk confronted demonic illusions with ascetic discipline. When confronted by visions of treasure, Antony refused to be moved by desire. When assailed by apparitions, he remained in prayer. He tested visions by their effects: truthful visions produced humility, peace, and clarity, while demonic illusions provoked pride, disturbance, and confusion. We can cultivate a way of life that does the same. Resisting the illusions may require forms of asceticism: fasting from chatbots and cultivating patience in verification.  

Chatbot illusions are not necessarily demonic in themselves. The key is whether the illusion points beyond itself toward truth and reality, or whether it traps us in deception.  

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief