Article
AI - Artificial Intelligence
Community
Culture
Education
5 min read

Artificial Intelligence needs these school lessons to avoid a Frankenstein fail

To learn and to learn to care are inseparable

Joel Pierce is the administrator of Christ's College, University of Aberdeen. He has recently published his first book.

A cyborg like figure opens the door to a classroom.
AI in the classroom.
Nick Jones/Midjourney.ai.

Recent worries expressed by Anthropic CEO, Dario Amodei, over the welfare of his chatbot bounced around my brain as I dropped my girls off for their first days at a new primary school last month. Maybe I felt an unconscious parallel. Maybe setting my daughters adrift in the swirling energy of a schoolyard containing ten times as many pupils as their previous one gave me a twinge of sympathy for a mogul launching his billion-dollar creation into the id-infused wilds of the internet. But perhaps it was more the feeling of disjuncture, the intuition that whatever information this bot would glean from trawling the web,it was fundamentally different from what my daughters would receive from that school, an education.  

We often struggle to remember what it is to be educated, mistaking what can be assessed in a written or oral exam for knowledge. However, as Hannah Arendt observed over a half century ago, education is not primarily about accumulating a grab bag of information and skills, but rather about being nurtured into a love for the world, to have one’s desire to learn about, appreciate, and care for that world cultivated by people whom one respects and admires. As I was reminded, watching the hundreds of pupils and parents waiting for the morning bell, that sort of education only happens in places, be it at school or in the home, where children themselves feel loved and valued.  

Our attachments are inextricably linked to learning. That’s why most of us can rattle off a list of our favourite teachers and describe moments when a subject took life as we suddenly saw it through their eyes. It’s why we can call to mind the gratitude we felt when a tutor coached us through a maths problem, lab project, or piano piece which we thought we would never master. Rather than being the pouring of facts into the empty bucket of our minds, our educations are each a unique story of connection, care, failure, and growth.  

I cannot add 8+5 without recalling my first-grade teacher, the impossibly ancient Mrs Coleman, gazing benevolently over her half-moon glasses, correcting me that it was 13, not 12. When I stride across the stage of my village pantomime this December, I know memories of a pint-sized me hamming it up in my third-grade teacher’s self-penned play will flit in and out of mind. I cannot write an essay without the voice of Professor Coburn, my exacting university metaphysics instructor, asking me if I am really saying what is truthful, or am resorting to fuzzy language to paper over my lack of understanding. I have been shaped by my teachers. I find myself repaying the debts accrued to them in the way I care for students now. To learn and to learn to care are inseparable. 

But what if they weren’t? AI seems to open the vista where intelligences can simply appear, trained not by humans, but by recursive algorithms, churning through billions of calculations on rows of servers located in isolated data centres. Yes, those calculations are mostly still done on human produced data, though the insatiable need for more has eaten through most everything freely available on the web and in whatever pirated databases of books and media these companies have been able to locate, but learning from human products is not the same as learning from human beings. The situation seems wholly original, wholly unimaginable. 

Except it was imagined in a book written over two hundred years ago which, as Guillermo del Toro’s recent attempt to capture that vision reminds us, remains incredibly relevant today. Filmmakers, and from trailers I suspect Del Toro is no different here, tend to treat the story of Frankenstein as one of glamorous transgression: Dr Frankenstein as Faust, heroically testing the limits of human knowledge and human decency. But Mary Shelley’s protagonist is an altogether more pathetic character, one who creates in an extended bout of obsessive experimentation and then spends the rest of the book running from any obligation to care for the creature he has made.  

It is the creature who is the true hero of the novel and he is a tragic one precisely because his intelligence, skills, and abilities are acquired outside the realm of human connection. When happenstance allows him to furtively observe lessons given within a loving, but impoverished family, he imagines himself into that circle of growing love and knowledge. It is when he is disabused of this notion, when the family discovers him and is disgusted, when he learns that he is doomed to know, but not be known, that he turns into a monster bent on revenge. As the Milton-quoting monster reminds Frankenstein, even Adam, though born fully grown, was nurtured by his maker. Since even this was denied creature, what choice does he have but to take the role of Satan and tear down the world that birthed him? 

Are our modern maestros of AI Dr Frankensteins? Not yet. For all the talk of sentient-like responses by LLMs, avoiding talking about distressing topics for example, the best explanation of such behaviour is that they simply are mimicking their training sets which are full of humans expressing discomfort about those same topics. However, if these companies are really as serious about developing a fully sentient AGI, about achieving the so-called singularity, as much of the buzz around them suggests, then the chief difference between them and Frankenstein is one of ability rather than ambition. If eventually they are able to realise their goals and intelligences emerge, full of information, but unnurtured and unloved, how will they behave? Is there any reason to think that they will be more Adam than Satan when we are their creators? 

At the end of Shelley’s novel, an unreconstructed Frankenstein tells his tale to a polar explorer in a ship just coming free from the pack ice. The explorer is facing the choice of plunging onward in the pursuit of knowledge, glory, and, possibly, death, or heeding the call of human connections, his sister’s love, his crew’s desire to see their families. Frankenstein urges him on, appeals to all his ambitions, hoping to drown out the call of home. He fails. The ship turns homeward. Knowledge shorn of attachment, ambition that ignores obligation, these, Shelley tells us, are not worth pursuing. Will we listen to her warning? 

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief

Review
Ageing
AI - Artificial Intelligence
Culture
Film & TV
5 min read

Foundation shows you can’t ‘Ctrl+V’ a soul

A sci-fi classic unearths transhumanism’s flaws

Giles is a writer and creative who hosts the God in Film podcast.

A woman confronts a man whose clone stands behind her.
Apple TV.

One of the reasons that science fiction has had enduring popularity as a genre is its ability to illustrate thought experiments. The way it can attempt to answer questions that can’t even be asked in any other kind of fiction is what gives it power as a form of storytelling. One question that keeps coming up is: what if you could live forever, through technology?  

One person to attempt to answer this question is Isaac Asimov, one of the early giants of the sci-fi genre. Born in 1920, Asimov arrived into a world that was rapidly changing, and yet, his imagination was still able to outpace it. Much of what he is known for is his depiction of robots, with ‘Asimov’s laws of robotics’ influencing the depiction of androids in Star Trek: The Next Generation. However, direct adaptations of Asimov’s own work were few and far between. Robin Williams’ Bicentennial Man released in 1999 and Will Smith starred in I, Robot in 2004 were the best of the bunch. That is, until Apple TV began adapting Asimov’s Foundation

Asimov’s Foundation books were written across the span of fifty years. The premise of the stories is that in a distant future, a galactic empire is beginning to fail and cannot be saved. The mathematician Hari Seldon develops the theory of psychohistory, where he uses statistical laws to predict the future of large populations. In the wake of the empire’s fall, Seldon predicts a dark age lasting 30,000 years before a second empire arises. Seldon devises a plan to reduce this dark age to just one thousand years by preserving a ‘foundation’ of knowledge. The novels describe some of the dramatic events that frustrate, or are a result of Seldon's Plan. One of the features of the story that the Apple TV show of Foundation focuses on is attempted immortality.  

Foundation gives us three depictions of ‘immortality’. Firstly, Seldon orchestrates having his conscience eventually uploaded into the Prime Radiant, a super-computer in order to allow him to shepherd his plans beyond the limits of his own human lifespan. Secondly, his protégé, Gaal Dornick is throughout the first season put into a cryo-sleep that lets her move into the future without ageing. Finally, the characters of Dawn, Day and Dusk attempt immortality through cloning. The tyrannical emperor Cleon decided that the only person fit to succeed him was…himself. So, he creates a revolving triumvirate of his own clones: Brother Day, a Cleon in his prime; Brother Dusk, an aging Cleon who serves to advise Day; and Brother Dawn, a young Cleon being trained to succeed Brother Day. This "genetic dynasty" has been ruling with an iron fist for 400 years by the start of the series.  

These interpretations of immortality grant each character the ability to shape and curate history in a way that no one human could ever achieve. But as there’s no drama without conflict, Foundation shows us the downsides of this kind of immortality. Firstly, Gaal’s version, being frozen in cryo-sleep for decades might literally extend her life, but from Gaal’s perspective, it is no longer than it would have been otherwise. Whilst she does get to see history play out, she loses connections with people like her family and her lover Raych. She is unable to build the life she would have planned for herself.    

No-one mourns your absence because there’s an identical copy of you still walking about. 

Seldon’s version of immortality is flirted with by tech bros and transhumanists like Peter Thiel. The idea of a computer that has the processing power to replicate a human brain turns up in numerous stories, but it’s another false immortality. Firstly, the original Hari Seldon still dies, and the ‘digital version’ stored eventually in the Prime Radiant is merely a copy. We might not think much of copy and pasting a document or file on our computer, but it doesn’t quite work the same for human beings. A copy is not the same as the original. You can’t ‘Ctrl+V’ a soul. In addition to this, we find out at one point that due to a mistake, Hari’s digital self has been trapped in darkness, fully conscious but with no rest, no distractions and no way of communicating with the outside world for 148 years. This naturally drags Hari into an interminable madness.  

Lastly, the Empire run by the clones, Dawn, Day and Dusk suffer much the same problem as the other two. It’s not a real immortality; as each clone eventually dies. But in many ways, it’s even worse than death. No-one mourns your absence because there’s an identical copy of you still walking about. This is a trope that is troubling, because a protagonist dying and being returned via cloning is often presented as a ‘resurrection’. It has been used as a story arc in the X-men comics and in Peter Capaldi’s era of Doctor Who, with very little outcry from their respective fandoms. Possibly because the thought that the producers have canonically killed the main character and replaced them with an exact copy is simply too uncomfortable to consider. In Foundation itself, the clones are judged by their fidelity to the original (a cold and petty despot) and any deviation is met with a death sentence. Whilst clones may be one way to rule a sci-fi galactic empire, it’s possibly their inability to adapt to changing circumstances that contributes to the fall of civilisation.  

The great irony in all of these interpretations is; you are only immortal to those observing you, and an immortality that relies on perspective is not really an immortality at all.  

It seems that hard science fiction, and ancient Greek myths can at times, overlap in their focus. Viewed in one light, Asimov’s Foundation series can be seen as one long story of Prometheus, who steals fire from the gods to give it as a gift to mankind, only to be punished by Zeus for his actions. Asimov appears to be telling us that mankind can’t accurately predict the future and you can’t live forever. So despite being a staunch atheist, one of the great minds of science fiction might be suggesting that immortality may belong squarely in the realm of the divine.

Support Seen & Unseen

Since Spring 2023, our readers have enjoyed over 1,500 articles. All for free. 
This is made possible through the generosity of our amazing community of supporters.

If you enjoy Seen & Unseen, would you consider making a gift towards our work?
 
Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin
Editor-in-Chief