What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre

A digital momento mori.

Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this?

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out.

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans.

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct?

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness.

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality.

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality.

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality.

Article

Books

Culture

Sustainability

Wildness

5 December 2024

7 min read

Wild writers for those who wish to wonder

A wilderness reader for wintertime and beyond

Elizabeth Wainwright

Elizabeth Wainwright is a writer, coach and walking guide. She's a former district councillor and has a background in international development.

Sheep around a frozen pond in a snowy landscape, a ruined cottage sits beyond.

Winter near Brno, Czechia.

Tomas Tuma on Unsplash.

We live in a time of decreasing biodiversity, reduced access to wilderness, and worsening mental health, and these things are, I think, linked. I wrote a bit about this recently. We are intimately tied to wilderness. We evolved on a diverse, living planet – not separate to it, but in it, dependent on it. It can be easy to forget this in part because we manipulate the world with lights and schedules and ideas of progress; we seal ourselves away in the walls of home, of work, of shops. Some of us live within the walls of church, too – disconnecting us from a wild God who increasingly to me seems most at home under the loud silence of the stars, and in the way the setting sun points to beauty before darkness, and in the way two people can bask in each other’s hearts. When I encounter love, and the loveliness of the world, I also encounter God.

We are good at taking for granted the strange beauty of the planet. We are good at forgetting how to sit with wonder, how to even access it. The poetry of the Psalms tells us that “…they forgot what he had done, the wonders he had shown them...” We must restore not only the living breathing wilderness of the planet we live in and on, but also our own ability to feel wonder, because this can be a first step towards feeling, caring, and acting.

There are writers I turn to when I need to remember the diverse wildness and unlikeliness of our planet that is, as far as we so far know, an island of life in a cold and vast universe. When I read them, I wonder at our shared earth, at our hearts, and at the mysterious holiness of it all. Here then, some of those wild writers:

Wendell Berry has influenced the way I interact with my locality, my faith, my responsibility to the earth I stand on. He is the author of essays, poetry, non-fiction and novels, but he is also a farmer in Kentucky. His preferred tools are a pencil and a team of work horses. For decades, his tending of both words and soil have each strengthened the other. His writing is rooted in the particularity of place, and through that, he speaks to the universality of our shared existence. His voice is incisive and honest, clear-eyed but full of a well-worn love. His call to a more localised and rooted way of life is not a call to escape, but to encounter – with beauty, with neighbour, with a spirit that breathes life through it all. In recent years, his writings have found new audiences. A good place to start, is The World Ending Fire: The Essential Wendell Berry. It contains a selection of his essays written over decades – essays that call out ideas of endless progress and the unthinkingness that feeds it. From here, you might turn to other collections like The Unsettling of America, or The Art of the Commonplace. His poems are earthy and beautiful – look at The Peace of Wild Things And Other Poems. For fiction, his best-known works are Jayber Crow and Hannah Coulter, rooted in the complexity of people and their community. At a time in which our planet burns faster than ever, his writing is prophetic and honest, yet braided with grace and love.

The World Ending Fire is curated and has an introduction by Paul Kingsnorth: a writer I increasingly turn to. His story travels a path from environmental activism via explorations of various beliefs (including Wicca, Paganism, and Buddhism) to a recent – and unexpected to both him and many of his readers – conversion to Christianity. His journey is recounted in his essay, The Cross and the Machine. In his popular newsletter, The Abbey of Misrule, he writes essays that explore deep ecology, and ideas of a wild God, and of early Christian mystics who seemed much closer to the earth than many modern Christians do. His background in environmental activism still echoes – he cares for the world deeply, but his writing now, like his contemporary Dougald Hine, faces what might come when modern life as we know it becomes untenable. Like Berry, Kingsnorth brings an honesty to his writing that is often challenging to sit with. His collection of essays and talks, Confessions of a Recovering Environmentalist, was key in my own journey. He also writes fiction, set in a strange, old England. And his short book Savage Gods, in his words, “…marks a break in my writing, my style and my worldview. This slim semi-memoir is one long question about the value of writing itself, and about what it means to belong, or not to.”

Another writer of honesty and clarity is Marylinne Robinson. She is a social critic and novelist, perhaps Gilead being her most well-known book. Her latest book, Reading Genesis, is an interpretation of the book of Genesis. She takes words that are often interpreted in two-dimensional ways and makes them come alive. She speaks not just to the complexities of faith, but of what it is to be human in this world. Throughout her work more broadly, nature is a recurring theme, symbolising beauty but also fragility, and pointing to wonder and to our own inner state.

The late and beloved Mary Oliver points to the luminosity of the world. Whether small creature or vast landscape, she invites us to slow down and really look. She insists again and again that we “Pay attention. Be astonished. Tell about it.” Often, her writing helps me to touch the interconnectedness of the living world, and of our humanity. Each fragment she shows us feels part of a larger whole she is also pointing to, and for which she regularly expresses gratitude, inviting the readers to consider “what is it you plan to do with your one wild and precious life?” A good place to start is with Devotions, a collection of her most loved poems, or with Upstream, a mix of poetry and essays. Here, in the details of her daily walks and reflections, Oliver manages to conjure awe and a sense of the sacred.

Another author who is extraordinarily attentive to the natural world is Annie Dillard. Her rapturous wonderings and explorations of world and place and self, link to deeper reflections, and often to the divine. Like Oliver, Dillard values specifics: “The sheer fringe and network of detail assumes primary importance. That there are so many details seems to be the most important and visible fact about creation.” Dillard weaves her senses with her reading, and often her humour, zooming out and reminding us that “the universe has continued to deal exclusively in extravagances, flinging intricacies and colossi down aeons of emptiness.” Her 1975 Pulitzer prizewinning Pilgrim at Tinker Creek is perhaps her best-known work, but a good place to start is Teaching a Stone to Talk; a slim collection of essays that begin with her observations of natural phenomena but end up encompassing the wilds of her mind and of its “ultimate concerns.”

Poet, author, musician and playwright Joy Harjo was the first Native American to hold the position of Poet Laureate. She is a member of the Mvskoke Nation, and often explores themes of identity, history and social justice. Harjo weaves together past, present and future, linking our innate holiness with the natural world. A good place to start is the personal collection Conflict Resolution for Holy Beings, or for an insight into her life, try Poet Warrior which brings together memoir, poetry and song, singing often of regeneration in the face of darkness.

A few others you might naturally turn to from these authors include the late essayist Barry Lopez (his last remarkable collection published in 2022 is Embrace Fearlessly the Burning World), novelist and essayist Ursula K Le Guin (her Earthsea trilogy is fantasy but offers I think a profound reflection on who we are), and Robert Macfarlane, who writes thoughtfully of nature and myth, inner and outer landscape. And the old Psalmists tell of beauty and wonder: Psalm 104, in the New King James version, contains leviathans and rock badgers, lions and moons, trees and humans, all of it singing together the great song of life – a life that is precious, earthy and holy; a life woven by a God who we hear in Genesis say, “let us make mankind in our image, according to our likeness.” God is plural, as diverse as his creation. I am grateful for the writers, just a few of whom I’ve shared here, who help me to pay attention to the diverse and strange beauty of the world, and through that, help me see its luminous holiness. That holiness – wholeness – depends on all of us, all of creation, being able to be itself. As Mary Oliver says:

“…Whoever you are, no matter how lonely,
the world offers itself to your imagination,
calls to you like the wild geese, harsh and exciting –
over and over announcing your place
in the family of things.”