What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre

A digital momento mori.

Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this?

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out.

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans.

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct?

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness.

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die.

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality.

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality.

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality.

Review

Attention

Culture

Music

25 November 2024

5 min read

James MacMillan’s music of tranquility and discord

The composer’s music contends both the secular and sacred.

Jonathan Evens

Jonathan is Team Rector for Wickford and Runwell. He is co-author of The Secret Chord, and writes on the arts.

A conductor leans in toward an unseen orchestra with a raised hand.

MacMillan conducting.

Hans van der Woerd, Intermusica.

Sir James MacMillan is one of today’s most successful composers, as is evidenced by his achievements in 2024. This year alone has seen the premiere of a new work for choir ‘Ordo Virtutum’ (January), the UK premiere of his cantata ‘Fiat Lux’ (March), the premiere of his new version of Robert Burns’ song ‘Composed in August’ (March), the premiere of his ‘Concerto for Orchestra’ (September), and the premiere of his ‘Duet for Horn and Piano’ (November).

Back in March he also became the 26th Fellow of The Ivors Academy, joining a rollcall of extraordinary composers and songwriters, including John Rutter, John Adams, Sir Elton John, Sir Paul McCartney, Dame Judith Weir and Sting. While, in September, he accepted the Sky Arts Classical Music Award 2024 on behalf of The Cumnock Tryst, the annual music festival he founded in his hometown, which brings together many local community groups on stage alongside some of the world’s most acclaimed musicians.

His music, which is notable for its energy and emotion, is imbued with influences from his Scottish heritage, Catholic faith, social conscience and close connection with Celtic folk music, blended with influences from Far Eastern, Scandinavian and Eastern European music. Accordingly, Tom Gray, Chair of The Ivors Academy, describes MacMillan as “a titan of music, generous in his creativity and craft” and “a foremost proponent of the power of music to communicate and forge bonds”.

He first became internationally recognised after the extraordinary success of ‘The Confession of Isobel Gowdie’ at the BBC Proms in 1990. Since then, his prolific output has been performed and broadcast around the world with his major works including his most performed work the percussion concerto ‘Veni, Veni, Emmanuel’ (1992), a cello concerto for Mstislav Rostropovich (1996), an opera ‘The Sacrifice’ (2007), the ‘St John Passion’ (2008), and five symphonies. For his services to music, he was awarded a CBE in 2004 and a knighthood in 2015.

“In this age of unbelief, the search for the sacred in art and music hasn’t gone away”.

James MacMillan

As will be clear from the titles of works cited thus far, many of his works, such as ‘Ordo Virtutum’, a setting of a sacred music drama by Hildegard of Bingen concerned with the struggle for the human soul in a battle between good and evil, and ‘Fiat Lux’, a celebration of the divine gift of light, directly express his Catholic faith. David Clayton writes that, “Aside from being one of the greatest living composers and conductors of classical music, Sir James is a Catholic whose faith informs all his work”. Clayton also describes him as “a deep thinker who communicates clearly the nature of the creative process when one seeks to create beauty to bring Glory to God”.

MacMillan believes that “Far from being a "spent force", religion has proved to be a vibrant, animating principle in modern music and continues to promise much for the future.” When he speaks about music and the idea of the sacred, as he did most recently at The Sheldonian Theatre in Oxford in October, he emphasises that music seems to be “the most spiritual of the arts, and composers have always seemed to be on a search for the sacred in their work”. He notes that “In this age of unbelief, the search for the sacred in art and music hasn’t gone away”.

In brief, he sees himself as standing in a modernist tradition that includes: Stravinsky, who “was as conservative in his religion as he was revolutionary in his musical imagination”; Schoenberg, “a mystic who reconverted to practising Judaism after the Holocaust”; John Cage, who explored “the spiritual connections between music and silence”; Olivier Messiaen, who “was famously Catholic” with “every note of his unique contribution to music” being “shaped by a deep religious conviction”; Jonathan Harvey, “who has allowed eastern mysticism and his own Anglicanism to adorn his searchingly original scores”; John Tavener, whose conversion to Orthodoxy “had a dramatic impact on his style and aesthetic”; and the “intriguing and disturbing religious shadings of musical modernity” to be found in the post-Shostakovich generation from eastern Europe - Henryk Górecki (Poland), Arvo Pärt (Estonia) Giya Kancheli (Georgia), Galina Ustvolskaya, Alfred Schnittke and Sofia Gubaidulina (Russia).

In this 'obedience' of listening and following, we are stretched and deepened, physically challenged as performers, imaginatively as listeners.

He argues that while, for a time, a post-War reaction led many modernist composers to opt for a primarily abstract style and eschew the stirring up of emotions through music, in more recent years, composers have increasingly re-embraced emotion and, thereby, also spirituality. He also notes significant connections between the music of antiquity and that the modern world. The influence of plainsong and Gregorian chant on modern music, for example, demonstrates a continuing relationship between faith and the arts.

He has suggested that God's power “is presence as absence; absence as presence” and that this is also “precisely what music is”. So, “The umbilical cord between silence and music is the umbilical cord between heaven and earth”. As a result, “the war against silence is a war against ourselves and against our interior life”. He is in agreement with the Scottish Jesuit John McDade, who wrote that "Music may be the closest human analogue to the mystery of the direct and effective communication of grace". MacMillan suggests, therefore, “that music is a phenomenon connected to the work of God in the way it touches something deep in our souls and releases a divine force”.

In similar vein, he also quotes Rowan Williams who, in a sermon some years ago for the Three Choirs Festival, said: "To listen seriously to music and to perform it are among our most potent ways of learning what it is to live with and before God, learning a service that is a perfect freedom... In this 'obedience' of listening and following, we are stretched and deepened, physically challenged as performers, imaginatively as listeners. The time we have renounced, given up, is given back to us as a time in which we have become more human, more real, even when we can't say what we have learned, only that we have changed."

Being stretched and deepened in this way is certainly our experience as listeners of MacMillan’s works. Michael Capps suggests that MacMillan knows that “music dealing openly and honestly with the Christian tradition will not always be pleasing, safe, or tame”. His music “contends” in that it “produces arguments and embodies alternatives, not only to its many secular substitutes, but also to allegedly Christian options that lack the tang and piquancy of Christian particularity.” As a result, “MacMillan’s music also reveals: it shows us a world of both tranquility and discord that we readily recognize, and allows us to better appreciate that world’s fleeting harmonies”.