Article
AI - Artificial Intelligence
Culture
5 min read

What AI needs to learn about dying and why it will save it

Those programming truthfulness can learn a lot from mortality.

Andrew Steane has been Professor of Physics at the University of Oxford since 2002, He is the author of Faithful to Science: The Role of Science in Religion.

An angel of death lays a hand of a humanioid robot that has died amid a data centre
A digital momento mori.
Nick Jones/midjourney.ai

Google got itself into some unusual hot water in recently when its Gemini generative AI software started putting out images that were not just implausible but downright unethical. The CEO Sundar Pichai has taken the situation in hand and I am sure it will improve. But before this episode it was already clear that currently available chat-bots, while impressive, are capable of generating misleading or fantastical responses and in fact they do this a lot. How to manage this? 

Let’s use the initials ‘AI’ for artificial intelligence, leaving it open whether or not the term is entirely appropriate for the transformer and large language model (LLM) methods currently available. The problem is that the LLM approach causes chat-bots to generate both reasonable and well-supported statements and images, and also unsupported and fantastical (delusory and factually incorrect) statements and images, and this is done without signalling to the human user any guidance in telling which is which. The LLMs, as developed to date, have not been programmed in such a way as to pay attention to this issue. They are subject to the age-old problem of computer programming: garbage in, garbage out

If, as a society, we advocate for greater attention to truthfulness in the outputs of AI, then software companies and programmers will try to bring it about. It might involve, for example, greater investment in electronic authentication methods. An image or document will have to have, embedded in its digital code, extra information serving to authenticate it by some agreed and hard-to-forge method. In the 2002 science fiction film Minority Report an example of this was included: the name of a person accused of a ‘pre-crime’ (in the terminology of the film) is inscribed on a wooden ball, so as to use the unique cellular structure of a given piece of hardwood as a form of data substrate that is near impossible to duplicate.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. 

It is clear that a major issue in the future use of AI by humans will be the issue of trust and reasonable belief. On what basis will we be able to trust what AI asserts? If we are unable to check the reasoning process in a result claimed to be rational, how will be able to tell that it was in fact well-reasoned? If we only have an AI-generated output as evidence of something having happened in the past, how will we know whether it is factually correct? 

Among the strategies that suggest themselves is the use of several independent AIs. If they are indeed independent and all propose the same answer to some matter of reasoning or of fact, then there is a prima facie case for increasing our degree of trust in the output. This will give rise to the meta-question: how can we tell that a given set of AIs are in fact independent? Perhaps they all were trained on a common faulty data set. Or perhaps they were able to communicate with each other and thus influence each other.  

The questions we face with AI thus come close to some of those we face when dealing with one another as humans. We know humans in general are capable of both ignorance and deliberate deception. We manage this by building up degrees of trust based on whether or not people show behaviours that suggest they are trustworthy. This also involves the ability to recognize unique individuals over time, so that a case for trustworthiness can be built up over a sequence of observations. We also need to get a sense of one another's character in more general ways, so that we can tell if someone is showing a change in behaviour that might signal a change in their degree of trustworthiness. 

In order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

Issues of trust and of reasonable belief are very much grist to the mill of theology. The existing theological literature may have much that can be drawn upon to help us in this area. An item which strikes me as particularly noteworthy is the connection between suffering and loss and earning of trust, and the relation to mortality. In brief, a person you can trust is one who has ventured something of themselves on their pronouncements, such that they have something to lose if they prove to be untrustworthy. In a similar vein, a message which is costly to the messenger may be more valuable than a message which costs the messenger nothing. They have already staked something on their message. This implies they are working all the harder to exert their influence on you, for good or ill. (You will need to know them in other ways in order to determine which of good or ill is their intention.)  

Mortality brings this issue of cost to a point of considerable sharpness. A person willing to die on behalf of what they claim certainly invests a lot in their contribution. They earn attention. It is not a guarantee of rationality or factual correctness, but it is a demonstration of commitment to a message. It signals a sense of importance attached to whatever has demanded this ultimate cost. Death becomes a form of bearing witness.  

A thought-provoking implication of the above is that in order to earn our trust, an AI too will have to be able to suffer and, perhaps, to die. 

In the case of human life, even if making a specific claim does not itself lead directly to one's own death, the very fact that we die lends added weight to all the choices we make and all the actions we take. For, together, they are our message and our contribution to the world, and they cannot be endlessly taken back and replaced. Death will curtail our opportunity to add anything else or qualify what we said before. The things we said and did show what we cared about whether we intended them to or not. This effect of death on the weightiness of our messages to one another might be called the weight of mortality. 

In order for this kind of weight to become attached to the claims an AI may make, the coming death has to be clearly seen and understood beforehand by the AI, and the timescale must not be so long that the AI’s death is merely some nebulous idea in the far future. Also, although there may be some hope of new life beyond death it must not be a sure thing, or it must be such that it would be compromised if the AI were to knowingly lie, or fail to make an effort to be truthful. Only thus can the pronouncements of an AI earn the weight of mortality. 

For as long as AI is not imbued with mortality and the ability to understand the implications of its own death, it will remain a useful tool as opposed to a valued partner. The AI you can trust is the AI reconciled to its own mortality. 

Article
Culture
Film & TV
Politics
6 min read

Fear of the news means it needs to change

Here's how to rethink reporting.

Steve is news director of Article 18, a human rights organisation documenting Christian persecution in Iran.

A news cameraman holding a camera, stands back to back to a police officer.
Waldemar on Unsplash.

Several non-journalist friends have told me over the past few years that they have started to disconnect themselves from the news - in some cases entirely - so wearied have they become by the incessant gloom of our reporting.  

Meanwhile, new research from the Reuters Institute has found that people have been “turning away from the news” consistently across 17 countries tracked over the past decade - from the US to the UK, Japan to Brazil. 

And one of the primary reasons, the researchers discovered, is the “fatigue and overload” of negative news. 

Another factor was the declining trust in the media, which has again been something I have heard consistently from friends in recent years, with many telling me they are constantly reassessing who they turn to for news. 

Perhaps that is only healthy, but both trends suggest to me that there may be a problem with the way news currently is, and the effect it is having on us. 

One of the most regular examples of the “bad news” we journalists tell is the reporting of terror attacks, but whenever I hear news of an attack - whether here or elsewhere - I think not only of the immediate victims and their loved ones, but also those who may soon become victims by association. 

Perhaps the most obvious recent example here in the UK was the case of the Southport stabbings, a shocking incident that led to understandable - albeit misguided - outrage. 

As soon as it emerged that a “foreigner” - or at least someone who sounded like they might be a foreigner - was responsible, many jumped to the conclusion not only that he was an Islamist but also probably an asylum-seeker, and an illegal one at that. 

It later transpired, of course, that the 17-year-old who carried out the terrible attack had been born and raised in Wales - to “Christian” parents, no less. So not an asylum-seeker, after all, nor even a foreigner; and even though it later became clear that he had downloaded disturbing content including from Al-Qaeda, his inspiration seemed to come from a wide range of sources. 

Here was another example, our prime minister told us, that showed “terrorism had changed” and was no longer the work only of Islamists or the far-right but of “loners” and “misfits” of all backgrounds, common only in their sadism and “desperat[ion] for notoriety”. 

And yet, in the Southport case and no doubt many others, by the time the killer’s background and likely motive finally became clear, the horse had already bolted.  

In that particular case, the reaction was especially extreme, with mosques and refugee hotels attacked as part of widespread rioting. But even when there are no riots after such an attack, there can surely be little doubt that the minds of the wider British public will have been impacted in some way by the news. 

For some, perhaps the primary response will be increased fear - in general but also perhaps especially of those different from themselves. For others, on top of fear, might they also feel increased hatred, or at least mistrust? 

And such feelings will surely only increase with every new reported attack, especially when the perpetrator appears to be someone new to these shores, and even more so, it would seem, if it is an asylum-seeker. 

To ignore the reality that many attacks have been carried out by asylum-seekers in recent years is to ignore reality. But for those of us desperate not only to prevent the further polarisation of our society but also to protect the many legitimate refugees who wouldn’t dream of committing such attacks, what can be done? 

Perhaps it’s only because I’m a journalist, but in my opinion one major thing I think could help arrest the current trend would be for us to rethink the way in which we do news in general.  

Not in order to mislead the public or pull the wool over their eyes - if bad things keep happening, they must be reported, as must the identities of the perpetrators, as well as any trends in this regard - but by way of providing the necessary balance and context.  

For example, by looking into what percentage of attacks - here or elsewhere - have been committed by Islamists, foreigners, or asylum-seekers; or considering what percentage of the total population of such groups the attackers represent, and how this compares to statistics regarding other groups. 

The question we journalists - and those who read our words - need most to ask is whether we are doing a good job of informing the public about the world they live in. 

Might it also be helpful to undertake a general reconsideration of what constitutes news? Does, for example, bad news always have to reign supreme in the minds of those who curate our news cycle?  

A decade ago, I had it in mind to create a new app or perhaps even news service dedicated to rebalancing the news, such that bad news stories wouldn’t outnumber the good. Many others have had similar ideas in recent years, and several platforms have been launched, dedicated to the promotion of “good news” stories. And yet one could argue that such platforms risk being as unrepresentative of reality as those that tell only bad-news tales. Can’t a compromise be found? 

One of the first things you learn as a journalist, other than that sex sells, is that greater numbers of deaths, and especially those of children, always constitutes headline material. And one needs only to flick through today’s major news outlets to see that this practice remains almost universally upheld. But does it have to be so?  

And why is it that some conflicts and injustices will make our headlines, while others won’t?  

Take, for example, the Sudanese civil war or the recent beheading of 70 Christians in the Democratic Republic of the Congo. Why is it that these horrors don’t make our headlines, while tragedies in Ukraine or Gaza do? Who makes the call, and for what reasons?  

Another long-established principle in journalism is to consider first and foremost who your audience is. So, for example, when writing for a British audience, to consider what might be of most interest to Brits. Are Ukraine and Gaza, for example, simply more relevant to British interests - in both senses of the word - than what is happening in the Global South? And even were that to be true, just because such principles of journalism are long-established, must they remain unchallenged? 

At its core, journalism is about informing, so in my opinion the question we journalists - and those who read our words - need most to ask is whether we are doing a good job of informing the public about the world they live in.  

And in my view, while a lot of good journalism is of course being done, the question of whether the public are receiving a representative picture of their environment is less clear.  

Whether or not the best approach to redress the balance is to dedicate whole news services to telling good-news stories, there’s surely little doubt that such stories are chronically underreported.  

And if our duty is not only to inform but also, by virtue of that, not to mislead, mightn’t it be argued that in failing to sufficiently well inform society about the real state of our world, we are in fact misleading them? 

No-one wants to end up in a Soviet-style “paradise” in which murders are simply denied in order to maintain the status quo, but nor, surely, do we want to live in a world in which people become unnecessarily fearful and hateful towards others, in part because of the news we feed them. 

Join with us - Behind the Seen

Seen & Unseen is free for everyone and is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Alongside other benefits (book discounts etc.), you’ll receive an extra fortnightly email from me sharing what I’m reading and my reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief