Article
AI - Artificial Intelligence
Community
Culture
Education
5 min read

Artificial Intelligence needs these school lessons to avoid a Frankenstein fail

To learn and to learn to care are inseparable

Joel Pierce is the administrator of Christ's College, University of Aberdeen. He has recently published his first book.

A cyborg like figure opens the door to a classroom.
AI in the classroom.
Nick Jones/Midjourney.ai.

Recent worries expressed by Anthropic CEO, Dario Amodei, over the welfare of his chatbot bounced around my brain as I dropped my girls off for their first days at a new primary school last month. Maybe I felt an unconscious parallel. Maybe setting my daughters adrift in the swirling energy of a schoolyard containing ten times as many pupils as their previous one gave me a twinge of sympathy for a mogul launching his billion-dollar creation into the id-infused wilds of the internet. But perhaps it was more the feeling of disjuncture, the intuition that whatever information this bot would glean from trawling the web,it was fundamentally different from what my daughters would receive from that school, an education.  

We often struggle to remember what it is to be educated, mistaking what can be assessed in a written or oral exam for knowledge. However, as Hannah Arendt observed over a half century ago, education is not primarily about accumulating a grab bag of information and skills, but rather about being nurtured into a love for the world, to have one’s desire to learn about, appreciate, and care for that world cultivated by people whom one respects and admires. As I was reminded, watching the hundreds of pupils and parents waiting for the morning bell, that sort of education only happens in places, be it at school or in the home, where children themselves feel loved and valued.  

Our attachments are inextricably linked to learning. That’s why most of us can rattle off a list of our favourite teachers and describe moments when a subject took life as we suddenly saw it through their eyes. It’s why we can call to mind the gratitude we felt when a tutor coached us through a maths problem, lab project, or piano piece which we thought we would never master. Rather than being the pouring of facts into the empty bucket of our minds, our educations are each a unique story of connection, care, failure, and growth.  

I cannot add 8+5 without recalling my first-grade teacher, the impossibly ancient Mrs Coleman, gazing benevolently over her half-moon glasses, correcting me that it was 13, not 12. When I stride across the stage of my village pantomime this December, I know memories of a pint-sized me hamming it up in my third-grade teacher’s self-penned play will flit in and out of mind. I cannot write an essay without the voice of Professor Coburn, my exacting university metaphysics instructor, asking me if I am really saying what is truthful, or am resorting to fuzzy language to paper over my lack of understanding. I have been shaped by my teachers. I find myself repaying the debts accrued to them in the way I care for students now. To learn and to learn to care are inseparable. 

But what if they weren’t? AI seems to open the vista where intelligences can simply appear, trained not by humans, but by recursive algorithms, churning through billions of calculations on rows of servers located in isolated data centres. Yes, those calculations are mostly still done on human produced data, though the insatiable need for more has eaten through most everything freely available on the web and in whatever pirated databases of books and media these companies have been able to locate, but learning from human products is not the same as learning from human beings. The situation seems wholly original, wholly unimaginable. 

Except it was imagined in a book written over two hundred years ago which, as Guillermo del Toro’s recent attempt to capture that vision reminds us, remains incredibly relevant today. Filmmakers, and from trailers I suspect Del Toro is no different here, tend to treat the story of Frankenstein as one of glamorous transgression: Dr Frankenstein as Faust, heroically testing the limits of human knowledge and human decency. But Mary Shelley’s protagonist is an altogether more pathetic character, one who creates in an extended bout of obsessive experimentation and then spends the rest of the book running from any obligation to care for the creature he has made.  

It is the creature who is the true hero of the novel and he is a tragic one precisely because his intelligence, skills, and abilities are acquired outside the realm of human connection. When happenstance allows him to furtively observe lessons given within a loving, but impoverished family, he imagines himself into that circle of growing love and knowledge. It is when he is disabused of this notion, when the family discovers him and is disgusted, when he learns that he is doomed to know, but not be known, that he turns into a monster bent on revenge. As the Milton-quoting monster reminds Frankenstein, even Adam, though born fully grown, was nurtured by his maker. Since even this was denied creature, what choice does he have but to take the role of Satan and tear down the world that birthed him? 

Are our modern maestros of AI Dr Frankensteins? Not yet. For all the talk of sentient-like responses by LLMs, avoiding talking about distressing topics for example, the best explanation of such behaviour is that they simply are mimicking their training sets which are full of humans expressing discomfort about those same topics. However, if these companies are really as serious about developing a fully sentient AGI, about achieving the so-called singularity, as much of the buzz around them suggests, then the chief difference between them and Frankenstein is one of ability rather than ambition. If eventually they are able to realise their goals and intelligences emerge, full of information, but unnurtured and unloved, how will they behave? Is there any reason to think that they will be more Adam than Satan when we are their creators? 

At the end of Shelley’s novel, an unreconstructed Frankenstein tells his tale to a polar explorer in a ship just coming free from the pack ice. The explorer is facing the choice of plunging onward in the pursuit of knowledge, glory, and, possibly, death, or heeding the call of human connections, his sister’s love, his crew’s desire to see their families. Frankenstein urges him on, appeals to all his ambitions, hoping to drown out the call of home. He fails. The ship turns homeward. Knowledge shorn of attachment, ambition that ignores obligation, these, Shelley tells us, are not worth pursuing. Will we listen to her warning? 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief

Article
Culture
Film & TV
Trauma
Work
5 min read

What would Pascal make of Emmy-winner Severance?

Locking ourselves away in a room still doesn’t work

Rick writes and speaks on leadership, transformation, and culture.

Pascal ponders a steampunk TV showing Severance.
Nick Jones/Copilot.

Severance, the hit Apple TV series, garnered the most Emmy nominations at the star-studded 77th Emmy Awards. Colors and fame popped on the vibrant red carpet as Hollywood’s elite strolled along the walkway, exuding famous smiles, elegant evening wear, and their signature flair.  

It was strikingly ironic, however, to see the Severance actors in such formal attire, ripe with ready-made smiles. Their presence was, well, very Hollywood. This contrasted sharply with their on-screen characters, who are typically set against a dark, desolate backdrop of despair, compelled to force smiles as if it were an immense burden on their very souls.   

The stark contrast between the opulent Hollywood red carpet and the sterile, bland workspace Severance is set in underscores a core theme in the show: the tension between faith and doubt, belief and despair, light and darkness. 

In the show, the main character Mark S. grapples with the challenge of navigating his own tension in his own calibrated nightmare of hope and despair. He has to cope with the sudden loss of his wife, and it's suffocating him.  

His company, Lumon, helps him deal with this loss through a surgical procedure called Severance. This procedure implants a chip in his brain that creates two separate identities: an "Innie" for work and an "Outie" for home. These two co-existing selves are emotionally, physically, and psychologically unaware of each other, essentially severing the person's whole self into two pieces. Whatever they are trying to bury or escape, becoming “severed” keeps the person’s “Innie” from dealing with this delicate paradox of the “Outie”. In short, they don’t have to choose the light or the dark.  

For Mark S., severance offers a thin thread of disguised hope, a potential breach in his unbearable pain. 

In his Pensées, French philosopher Blaise Pascal explores this intrinsic human tension between faith and doubt, belief and despair - a fundamental aspect of the human experience. He says, "In faith there is enough light for those who want to believe and enough shadows to blind those who don’t."   

He posits that the evidence between the light and the shadow is just enough to sway us in one direction or the other. It’s calibrated on either side allowing us to lean into our personal autonomy. We are free to choose the hope of the light or succumb to the despair of the darkness; the outcome depends entirely on what we choose.  

Leaning into Pascal, the act of severance relieves Mark S. of this beautiful yet complicated tension.  

A review on Reddit said it simply, “Severing allows Mark to just literally shut his brain off, get the work done, then go home and distract himself with TV and alcohol... he doesn’t want to let it go.”  

It’s real pain and he doesn’t know how to manage it. The shadows are pervasive. However, by choosing severance, Mark avoids the light and the shadows. The more he relies on severance for hope or healing by attempting to bury the shadows, the more the shadows intensify - the shadows Pascal says will blind us in our disbelief.   

The battle that Mark S. faces embodies the very tension that Pascal is surfacing. This tension of choosing the light or the shadows is something we all must face.  

We all carry shadows wrapped in our own circumstances. I think many of us would likely prefer to avoid confronting them. They are painful. They are dark. They are heavy. In truth, if we had the choice I think many of us would likely choose an escape instead of dealing with the darkness, with the secrets and the pain that hide in our souls.  

For example, many of us show up to work or to life like Mark S. in some version of our “Innie” - a professional face of compliance, rule following, corporate persona, goal oriented, etc. and leave the version of our “Outie” at home alone and isolated to wrestle with our demons, with our painful, confusing questions. We curate our internal messiness and disguise ourselves with our own “Innie”. 

For some, our day job is an actual version of a self-imposed severance.  

I wish this tension between the light and shadows Pascal speaks of was less “tense” to say it plainly, and yet it is an inherent, essential part of the human experience.  

This faith that both we and Mark S. wrestle with, by its very nature, lacks complete clarity; this tension is, in fact, a testament to this profound mystery of life itself. It's the wonder of life. There’s just enough data for us to lean into the light and also just as much for us to lean into the shadows. What we see depends on what we choose to believe in.  

This tension is similarly addressed in the Biblical book of Hebrews. It highlights Pascal's subtle paradox and defines faith as "the substance of things hoped for, the evidence of things not seen."  

The freedom to choose “the substance of things hoped for”, this inherent tension of Pascal, is the true marvel and mystery of life. It’s both messy and wonderful.  

Our capacity for choice, to engage with the light and shadows and to lean into one over the other as we wish is a profound gift.  

While some find this very tension a reason for disbelief, Pascal tugs on this and says it's actually fundamental to belief, it's a wonderful component of the human condition - a true gift. It hints at the very essence of hope. It’s the same process we must engage when choosing to believe in or not to believe in something beyond our selves, and ultimately beyond this world.  

This struggle, the shadows of pain and suffering and the light of hope and belief is precisely what makes us alive; it’s what makes us human. It points us to the heavens where hope and faith were authored.  

The question isn’t whether we have an “Innie” or an “Outie”, a tension of light and darkness, of faith and doubt. We all do. We all wrestle with this essence. The question is do we have the courage to wrestle with these internal conflicts, enabling us to bring our whole selves - our flaws and pains, our joys and hopes  - into every interaction. 

This tension Pascal speaks of is ultimately a mirror that shows us, us. We are all tempted to numb our pain, divide ourselves, to compartmentalize the shadows. But Pascal reminds us there is always enough light to see, if we choose it.

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief