Article
AI - Artificial Intelligence
Attention
Culture
5 min read

Will AI’s attentions amplify or suffocate us?

Keeping attention on the right things has always been a problem.

Mark is a research mathematician who writes on ethics, human identity and the nature of intelligence.

A cute-looking robot with big eyes stares up at the viewer.
Robots - always cuter than AI.
Alex Knight on Unsplash.

Taking inspiration from human attention has made AI vastly more powerful. Can this focus our minds on why attention really matters? 

Artificial intelligence has been developing at a dizzying rate. Chatbots like ChatGPT and Copilot can automate everyday tasks and can effortlessly summarise information. Photorealistic images and videos can be generated from a couple of words and medical AI promises to revolutionise both drug discovery and healthcare. The technology (or at least the hype around it) gives an impression of boundless acceleration. 

So far, 2025 has been the year AI has become a real big-ticket political item. The new Trump administration has promised half a trillion dollars for AI infrastructure and UK prime minister Keir Starmer plans to ‘turbocharge’ AI in the UK. Predictions of our future with this new technology range from doom-laden apocalypse to techno-utopian superabundance. The only certainty is that it will lead to dramatic personal and social change. 

This technological impact feels even more dramatic given the relative simplicity of its components. Huge volumes of text, image and videos are converted into vast arrays of numbers. These grids are then pushed through repeated processes of addition, multiplication and comparison. As more data is fed into this process, the numbers (or weights) in the system are updated and the AI ‘learns’ from the data. With enough data, meaningful relationships between words are internalised and the model becomes capable of generating useful answers to questions. 

So why have these algorithms become so much more powerful over the past few years? One major driver has been to take inspiration from human attention. An ‘attention mechanism’ allows very distant parts of texts or images to be associated together. This means that when processing a passage of conversation in a novel, the system is able to take cues on the mood of the characters from earlier in the chapter. This ability to attend to the broader context of the text has allowed the success of the current wave of ‘large language models’ or ‘generative AI’. In fact, these models with the technical name ‘Transformer’ were developed by removing other features and concentrating only on the attention mechanisms. This was first published in the memorably named ‘Attention is All You Need’ paper written by scientists working at Google in 2017. 

If you’re wondering whether this machine replication of human attention has much to do with the real thing, you might be right to be sceptical. That said, this attention-imitating technology has profound effects on how we attend to the world. On the one hand, it has shown the ability to focus and amplify our attention, but on the other, to distract and suffocate it. 

Attention is a moral act, directed towards care for others.

A radiologist acts with professional care for her patients. Armed with a lifetime of knowledge and expertise, she diligently checks scans for evidence of malignant tumours. Using new AI tools can amplify her expertise and attention. These can automatically detect suspicious patterns in the image including very fine detail that a human eye could miss. These additional pairs of eyes can free her professional attention to other aspects of the scan or other aspects of the job. 

Meanwhile, a government acts with obligations to keep its spending down. It decides to automate welfare claim handling using a “state of the art” AI system. The system flags more claimants as being overpaid than the human employees used to. The politicians and senior bureaucrats congratulate themselves on the system’s efficiency and they resolve to extend it to other types of payments. Meanwhile, hundreds of thousands are being forced to pay non-existent debts. With echoes of the British Post Office Horizon Scandal, the 2017-2020 the Australian Robo-debt scandal was due to flaws in the algorithm used to calculate the debts. To have a properly functioning welfare safety net, there needs to be public scrutiny, and a misplaced deference to machines and algorithms suffocated the attention that was needed.   

These examples illustrate the interplay between AI and our attention, but they also show that human attention has a broader meaning than just being the efficient channelling of information. In both cases, attention is a moral act, directed towards care for others. There are many other ways algorithms interact with our attention – how social media is optimised to keep us scrolling, how chatbots are being touted as a solution to loneliness among the elderly, but also how translation apps help break language barriers. 

Algorithms are not the first thing to get in the way of our attention, and keeping our attention on the right things has always been a problem. One of the best stories about attention and noticing other people is Jesus’ parable of the Good Samaritan. A man lies badly beaten on the side of the road after a robbery. Several respectable people walk past without attending to the man. A stranger stops. His people and the injured man’s people are bitter enemies. Despite this, he generously attends to the wounded stranger. He risks the danger of stopping – perhaps the injured man will attack him? He then tends the man’s wounds and uses his money to pay for an indefinite stay in a hotel. 

This is the true model of attention. Risky, loving “noticing” which is action as much as intellect. A model of attention better than even the best neuroscientist or programmer could come up with, one modelled by God himself. In this story, the stranger, the Good Samaritan, is Jesus, and we all sit wounded and in need of attention. 

But not only this, we are born to imitate the Good Samaritan’s attention to others. Just as we can receive God’s love, we can also attend to the needs of others. This mirrors our relationship to artificial intelligence, just as our AI toys are conduits of our attention, we can be conduits of God’s perfect loving attention. This is what our attention is really for, and if we remember this while being prudent about the dangers of technology, then we might succeed in elevating our attention-inspired tools to make AI an amplifier of real attention. 

Join with us - Behind the Seen

Seen & Unseen is free for everyone and is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Alongside other benefits (book discounts etc.), you’ll receive an extra fortnightly email from me sharing what I’m reading and my reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief

Column
Books
Culture
Music
Space
6 min read

Magnificent or mundane: how do you react to the overview effect?

Creators of a book, an album and a game, can’t agree.
A small white space capsule orbits around the earth.
A SpaceX Dragon capsule orbits above Earth.
NASA.

As I write this, two Nasa astronauts – Suni Williams and Butch Wilmore (possibly the most USA-sounding name imaginable) – are preparing to leave the International Space Station to return to Earth. They were supposed to stay on the space station for eight days, but a technical problem with their spacecraft meant they’ve been stranded in space for nine months.  

Nine. Months.  

It sounds like the premise for a horror film. Two stranded astronauts slowly descend into madness as they become increasingly isolated and cut off from humanity. Written and directed by M. Night Shyamalan, probably. 

That’s a lot of time to be stuck orbiting Earth, gazing at the pale blue dot, contemplating our little corner of the universe. There’s a phenomenon called the overview effect: a shift in thinking astronauts go through when they see Earth from space. Putting the planet into the wider context of the entire cosmos leads observers to rethink humanity’s place in the universe, and what it means to be human.  I imagine Suni and Butch have had quite a bit of time to do just that in recent months.  

And the overview effect is currently having a bit of a moment in wider culture, too.  

If you went into any bookshop in the weeks before Christmas, you likely saw stacks of Samantha Harvey’s novel Orbital. It tells the story – although there’s not much by way of traditional ‘story’ in Orbital – of six astronauts on the International Space Station, pondering the nature of humanity from their lofty vantage point. 

Having won the booker prize, booksellers were keen to encourage readers to buy Oribtal. Praised by the Booker Prize judges for its “beauty and ambition”, I was looking forward to reading it, when I could. (And, let’s be honest, it’s a short book, which probably helped sales. Who has the time to read Ulysses or Infinite Jest in between school runs and weekly shops?) 

When I finally read it in January, I was left disappointed. I found a surprising lack of humanity in Orbital. With the exception of one astronaut – who spends her time mourning her recently deceased mother some 250 miles up in the sky – the characters feel somewhat paper thin; barely human. As the story meanders from person to person, never really settling on one character long enough to really develop them, it feels a bit … insubstantial?  

Maybe it’s a victim of its own hype. Maybe the not-quite-humanness of the astronauts and the listless quality of the narrative are intentional, designed to capture the ungrounded nature of life in space in both form and content. Maybe that’s being generous. Either way, I was left closing the book and shrugging my shoulders. If Orbital was supposed to offer a glimpse into that overview effect, it left me nonplussed. 

By coincidence, Steven Wilson has just released his eighth solo album: The Overview. Who is Steven Wilson, you ask? Only “probably the most successful British artist you've never heard of” according to The Daily Telegraph. With Wilson’s album currently sitting at #1 in the UK album charts, it doesn’t seem an unwarranted title.  

In The Overview, Wilson explores the overview effect across just two lengthy pieces of music. In the first, Wilson contrasts the mundanities of life on Earth with the chaos of space, calling us to attend to miracle that is humanity, thanks to lyrics written by the annoyingly talented Andy Partridge of XTC: 

“And there in an ordinary street  

A car isn't where it would normally be  

The driver in tears, about his payment arrears 

 Still, nobody hears whеn a sun disappears in a galaxy afar.” 

With Partridge’s help, Wilson manages to capture that humanity so sorely lacking in Orbital. Amid a sea of seemingly barren space, there is life here on this small, pokey planet, and the dramas and stresses of a man fretting about his debts don’t seem out of place, even when compared to the implosion of a star on the other side of the universe.  

All this makes a recent interview with Wilson all the more odd.  

When speaking about the overview effect, Wilson says “Your life is futile, it’s meaningless – and isn’t that a wonderful thing?” before doubling down: “And I do mean that. We spend so much of our time anxious, stressed, worried about things that sometimes we just need an injection of perspective.” 

For Wilson, this perspective – this overview effect – is liberating. It allows to stop navel-gazing, to pick our heads up and to realise our freedom to do whatever we want. After all, everything’s just matter in varying different arrangements:  

“The clouds have no history 

And the sea feels no sorrow 

The oxygen recycled 

And the atoms are just borrowed,”  

At the climax of the album’s second epic, Wilson sings – with more glee than it warrants –  

“There's no reason for anything  

 Just a beautiful infinity 

 No design and no onе at the wheel.” 

 Cheery stuff. 

It's easy to see why, in the same interview, Wilson rails against the concept of religion: “Religion is a classic manifestation of cosmic vertigo … To even understand even the very simplest, most basic facts about space, should be enough to disabuse anyone of the notion of God. But apparently it doesn’t.” 

It all sounds a bit like an angsty teenager encountering the New Atheists for the first time. And this edge to Wilson’s work jars uncomfortably with the humanitarian streak that runs through his music. Wilson wants (rightly) to celebrate the mundane, the ordinary, and the human. And simultaneously wants to tell us that we’re just … stuff. Just atoms arranged in one way or another. Wilson pays lip-service to the humanity missing from Orbital, but it’s superficial.  

And all this reminds me of my favourite video game ever: 2019’s The Outer Wilds. (Not to be confused with 2019’s also-space-based-but-decidedly-mediocre The Outer Worlds). In The Outer Wilds, you play as an alien with a ramshackle spaceship who sets off to explore their solar system. Except every 22 minutes, the sun explodes. When it does, you wake up on your home planet and start again. 

You use these 22-minute loops to explore the solar system, flying manually from planet to planet, and exploring every nook and cranny of them in the process. You see awe-inspiring sights and are confronting with the absolute otherness and horror of the vastness of space.  

And yet. As you explore, you come across notes left by long-forgotten civilizations. Mundane lists and frustrated exchanges between colleagues. You come across life, in other words, even if you don’t meet many other actual people. I can’t say much more than this without ruining the game: The Outer Wilds depends on your real-world knowledge to progress, and so, the more I tell you, the more I ruin.  

But, suffice it to say that this is exactly what is missing from Harvey and Wilson’s work. While they both ostensibly want to remind us of the value and the miracle of humanity, both leave me feeling cold. Both leave me with the impression that life is little more than atoms arranged one way and not the other. Just stuff.  

But in The Outer Wilds, the sun’s implosion – and all that is lost with it – is a genuine heartbreak every single time. I think about all the stories I’ve read, and the people I’ve met, and how it’s all about to be lost as a bright supernova washes over me. And then I wake up again at the start of the cycle, relieved that all is not lost.  

If you can, you should play The Outer Wilds. It’s beautiful. Really, really beautiful. More so than Orbital or The Overview. Our place in the universe can be overwhelming; we’re small, and the universe is strange and scary. But we’re not just insignificant stuff. Our stories and the people we share them with matter. And Outer Wilds captures this tension impeccably. Only it captures life’s miraculous nature in the way it deserves. 

Celebrate our 2nd birthday!

Since March 2023, our readers have enjoyed over 1,000 articles. All for free. This is made possible through the generosity of our amazing community of supporters.

If you’re enjoying Seen & Unseen, would you consider making a gift towards our work?

Do so by joining Behind The Seen. Alongside other benefits, you’ll receive an extra fortnightly email from me sharing my reading and reflections on the ideas that are shaping our times.

Graham Tomlin

Editor-in-Chief