Article
AI - Artificial Intelligence
Community
Culture
Education
5 min read

Artificial Intelligence needs these school lessons to avoid a Frankenstein fail

To learn and to learn to care are inseparable

Joel Pierce is the administrator of Christ's College, University of Aberdeen. He has recently published his first book.

A cyborg like figure opens the door to a classroom.
AI in the classroom.
Nick Jones/Midjourney.ai.

Recent worries expressed by Anthropic CEO, Dario Amodei, over the welfare of his chatbot bounced around my brain as I dropped my girls off for their first days at a new primary school last month. Maybe I felt an unconscious parallel. Maybe setting my daughters adrift in the swirling energy of a schoolyard containing ten times as many pupils as their previous one gave me a twinge of sympathy for a mogul launching his billion-dollar creation into the id-infused wilds of the internet. But perhaps it was more the feeling of disjuncture, the intuition that whatever information this bot would glean from trawling the web,it was fundamentally different from what my daughters would receive from that school, an education.  

We often struggle to remember what it is to be educated, mistaking what can be assessed in a written or oral exam for knowledge. However, as Hannah Arendt observed over a half century ago, education is not primarily about accumulating a grab bag of information and skills, but rather about being nurtured into a love for the world, to have one’s desire to learn about, appreciate, and care for that world cultivated by people whom one respects and admires. As I was reminded, watching the hundreds of pupils and parents waiting for the morning bell, that sort of education only happens in places, be it at school or in the home, where children themselves feel loved and valued.  

Our attachments are inextricably linked to learning. That’s why most of us can rattle off a list of our favourite teachers and describe moments when a subject took life as we suddenly saw it through their eyes. It’s why we can call to mind the gratitude we felt when a tutor coached us through a maths problem, lab project, or piano piece which we thought we would never master. Rather than being the pouring of facts into the empty bucket of our minds, our educations are each a unique story of connection, care, failure, and growth.  

I cannot add 8+5 without recalling my first-grade teacher, the impossibly ancient Mrs Coleman, gazing benevolently over her half-moon glasses, correcting me that it was 13, not 12. When I stride across the stage of my village pantomime this December, I know memories of a pint-sized me hamming it up in my third-grade teacher’s self-penned play will flit in and out of mind. I cannot write an essay without the voice of Professor Coburn, my exacting university metaphysics instructor, asking me if I am really saying what is truthful, or am resorting to fuzzy language to paper over my lack of understanding. I have been shaped by my teachers. I find myself repaying the debts accrued to them in the way I care for students now. To learn and to learn to care are inseparable. 

But what if they weren’t? AI seems to open the vista where intelligences can simply appear, trained not by humans, but by recursive algorithms, churning through billions of calculations on rows of servers located in isolated data centres. Yes, those calculations are mostly still done on human produced data, though the insatiable need for more has eaten through most everything freely available on the web and in whatever pirated databases of books and media these companies have been able to locate, but learning from human products is not the same as learning from human beings. The situation seems wholly original, wholly unimaginable. 

Except it was imagined in a book written over two hundred years ago which, as Guillermo del Toro’s recent attempt to capture that vision reminds us, remains incredibly relevant today. Filmmakers, and from trailers I suspect Del Toro is no different here, tend to treat the story of Frankenstein as one of glamorous transgression: Dr Frankenstein as Faust, heroically testing the limits of human knowledge and human decency. But Mary Shelley’s protagonist is an altogether more pathetic character, one who creates in an extended bout of obsessive experimentation and then spends the rest of the book running from any obligation to care for the creature he has made.  

It is the creature who is the true hero of the novel and he is a tragic one precisely because his intelligence, skills, and abilities are acquired outside the realm of human connection. When happenstance allows him to furtively observe lessons given within a loving, but impoverished family, he imagines himself into that circle of growing love and knowledge. It is when he is disabused of this notion, when the family discovers him and is disgusted, when he learns that he is doomed to know, but not be known, that he turns into a monster bent on revenge. As the Milton-quoting monster reminds Frankenstein, even Adam, though born fully grown, was nurtured by his maker. Since even this was denied creature, what choice does he have but to take the role of Satan and tear down the world that birthed him? 

Are our modern maestros of AI Dr Frankensteins? Not yet. For all the talk of sentient-like responses by LLMs, avoiding talking about distressing topics for example, the best explanation of such behaviour is that they simply are mimicking their training sets which are full of humans expressing discomfort about those same topics. However, if these companies are really as serious about developing a fully sentient AGI, about achieving the so-called singularity, as much of the buzz around them suggests, then the chief difference between them and Frankenstein is one of ability rather than ambition. If eventually they are able to realise their goals and intelligences emerge, full of information, but unnurtured and unloved, how will they behave? Is there any reason to think that they will be more Adam than Satan when we are their creators? 

At the end of Shelley’s novel, an unreconstructed Frankenstein tells his tale to a polar explorer in a ship just coming free from the pack ice. The explorer is facing the choice of plunging onward in the pursuit of knowledge, glory, and, possibly, death, or heeding the call of human connections, his sister’s love, his crew’s desire to see their families. Frankenstein urges him on, appeals to all his ambitions, hoping to drown out the call of home. He fails. The ship turns homeward. Knowledge shorn of attachment, ambition that ignores obligation, these, Shelley tells us, are not worth pursuing. Will we listen to her warning? 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief

Article
Books
Culture
Morality
5 min read

Never Let Me Go: 20 years on

Ishiguro’s brilliant novel is the perfect Frankenstein story for today.

Beatrice writes on literature, religion, the arts, and the family. Her published work can be found here

Four young people peer through a window.
Carey Mulligan and Keira Knightley in the 2010 film adaption.
Fox Searchlight Films.

This article contains spoilers. 

Human beings are creative. For good or for evil, making new things out of raw materials is something that we can’t help doing, whether that’s writing new books, creating new recipes, or building new houses. Why are we born this way? Christians would say it’s because of the imago Dei: because according to the book of Genesis, the first book in the Bible, we are made in the image of God. If God created the world and every one of us, and if we’re made in his image, then it follows that all of us have this creative impulse within us, too.  

But if creating is something natural to us, does it follow that it’s also core to our identity as human beings? In other words, is making something that we do, or something that we are? Are we different from all other living creatures in this world by being creators ourselves?  

Although he doesn’t call himself a Christian, these are precisely the kind of theological questions the novelist Kazuo Ishiguro asks time and time again in his books. And nowhere does he ask them more powerfully than in Never Let Me Go, which was published 20 years ago. 

Never Let Me Go starts off as the story of three children at a boarding school. Kathy, one of three friends, serves as our first-person narrator; it’s through her eyes that we slowly realise something sinister is taking place. As Kathy, Tommy, and Ruth grow into teenagers and then young adults, it’s finally revealed that they are clones, brought into being thanks to advancements in cloning technology in a dystopian post-World War II Britain. They are brought up for the sole purpose of being organ donors. Or, to put it more bluntly, they’ve been raised for slaughter.  

Kathy, Ruth, and Tommy have a happy childhood at their boarding school, Hailsham. Their future is hinted at by their teachers, but they’re largely shielded from the truth. All around the country, we later find out, clone children are being raised in horrific conditions. But Hailsham is different, because its Headteacher, Miss Emily, is part of a group that believes the clones deserve to be treated humanely – at least until someone needs a kidney transplant.  

But, though treated in a ‘humane’ way, society doesn’t see the Hailsham clones as ‘human’, and that’s precisely what Miss Emily is trying to prove: that they are not unlike real, normal people. So, she encourages the children to make art. ‘A lot of the time’, Kathy tells us, ‘how you were regarded at Hailsham, how much you were liked and respected, had to do with how good you were at “creating”’. The children don’t understand why they must always paint and draw, but they’re told that Madame Marie-Claude, a mysterious figure, will collect their best artworks for a seemingly important ‘gallery’.  

Years later, Tommy and Kathy have become a couple. Before dying – or ‘completing’, as they call it – after her second ‘donation’, Ruth tells them that she believes a deferral is possible for couples that are truly in love. Kathy and Tommy go to Miss Emily’s house, their former Headmistress, certain that, as children, they were encouraged to produce art precisely to be able to prove, one day, their true feelings.  

They are quickly disappointed. Miss Emily reveals that Hailsham has now closed down, but that while the school stood, it was meant as an experiment, aimed at convincing the public to improve living conditions for the clones: 

‘We took away your art because we thought it would reveal your souls. Or to put it more finely, we did it to prove you had souls at all…we demonstrated to the world that if students were reared in humane, cultivated environments, it was possible for them to grow to be as sensitive and intelligent as any human being.’ 

Equating creativity with human identity does make sense, to an extent at least. In The Mind of the Maker (1941), Christian novelist and critic Dorothy L. Sayers argued that the closest we can get to understanding God as our Creator is through engaging ourselves in creative acts: ‘the experience of the creative imagination in the common man or woman and in the artist is the only thing we have to go upon in entertaining and formulating the concept of creation’. In creative acts, from a Christian perspective, we partially grasp God’s creation of us.  

Ultimately, however, being creative in imitation of God, is not enough to get to the very core of what defines a human being. There are all kinds of factors, from old age to mental or physical disability, that make any form of traditionally creative act highly unlikely for some people. By that definition, someone in a coma or a newborn baby is not fully human. 

That’s exactly the definition of humanity that underpins the cruel society of Ishiguro’s Never Let Me Go. We need a better definition, and Christianity provides a unique tradition to help us on the way. A Christian concept of the human person is one that looks both at why we were made, and what we were made for. Christians believe that God made us out of love, and for the purpose of being in communion with him. He made each one of us as a special and irreplaceable individual, and for each of us our telos – the end or aim of our life – is to join him in heaven.  

If we embrace this definition of what it means to be human, then the extent to which we are able to express our intelligence or creativity while on earth doesn’t really matter anymore. If we believe that merely to exist is good – not to exist and fulfil our potential through this or that accomplishment, but just to exist – then we can’t deny that each member of the human family is, in fact, a ‘person’ in the fullest sense of the word.  

It is precisely this God-shaped hole that makes the concept of human dignity so fragile and slippery in Never Let Me Go. Ishiguro’s brilliant novel is, ultimately, the perfect Frankenstein story for the modern day. It warns us about the consequences of what might happen if we try to treat other human beings as things we have paid, but even more powerfully it shows us the danger of valuing human life for its creativity, instead of loving it as the creation of God. 

Celebrate our 2nd birthday!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.
If you enjoy Seen & Unseen, would you consider making a gift towards our work?
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.
Graham Tomlin
Editor-in-Chief