The Pope, an AI Founder, and the Ethics of Grown Intelligence
James Turner explores why the Vatican is paying attention to AI ethics, after Pope Leo XIV’s encyclical brought Anthropic co-founder Christopher Olah to Rome. The episode examines Olah’s idea that modern neural networks are grown rather than built, and the urgent questions that raises about power, human dignity, and who controls AI’s future.
Is this your podcast and want to remove this banner? Click here.
Chapter 1
The Vatican’s Unlikely AI Disciple
James Turner
Welcome to the show, everyone! I'm James Turner. Picture this: it's a humid afternoon in Rome, and inside the historic, limestone-walled Synod Hall of the Vatican, Pope Leo the Fourteenth has just released a sweeping, high-stakes papal encyclical on AI ethics called *Magnifica Humanitas*. But the real shockwave in the room? The guest speaker standing at the podium. [chuckles] It's Christopher Olah, the thirty-three-year-old co-founder of Anthropic, a legendary machine learning researcher, and... a self-described atheist.
James Turner
An atheist coder, standing before the global hierarchy of the Catholic Church, talking about the soul of technology. And as a software engineer myself, [excited] I have been absolutely obsessed with why this crossover happened. It's because Olah brought an idea to Rome that completely reframes the entire AI debate. He argued that we need to stop thinking of advanced artificial intelligence as something we "build."
James Turner
Think about it. When we build a bridge, or a Boeing 777, we write precise blueprints. We know where every single bolt, rivet, and line of structural code goes. If a bridge collapses, we can point to the exact weld that failed. But modern neural networks? Olah says we don't build them. We *grow* them.
James Turner
[thoughtfully][pauses] Let that sink in for a second. We don't write the code that teaches these models how to write poetry or debug Python. Instead, we set up a digital nursery. We design a basic mathematical architecture, dump in trillions of words of human writing—our history, our love letters, our forum arguments, our collective digital footprint—and we let the model grow inside that soil. It absorbs us. What emerges on the other side isn't a sterile, compiled program. It's a complex, deeply mysterious entity grown directly from human thought.
James Turner
And that is exactly why the Vatican is paying attention. [warmly] Because if AI is "grown" from human thought, then artificial intelligence isn't just a computer science problem anymore. It's a mirror. It moves the entire conversation out of the engineering lab and straight into philosophy, theology, and the humanities. We aren't just managing software bugs; we are parenting an entity that is drinking from the well of human consciousness.
James Turner
But this alliance between an AI pioneer and the Pope isn't just a high-minded academic debate. [serious] It's born out of an urgent, shared panic. Right now, the dominant forces shaping AI are raw commercial incentives and geopolitical power. It's a multi-billion-dollar race to build the biggest, most profitable cluster of graphics cards. And both Olah and the Vatican are looking at this runaway train and asking: where are the moral guardrails? Who is protecting human dignity, or the livelihoods of the global poor who are completely left out of the Silicon Valley boardroom decisions?
James Turner
[measured] As an engineer, this leaves me with a pretty heavy realization. We are cultivating these incredibly powerful systems behind closed doors, using our collective human heritage as the fertilizer, but letting a tiny handful of corporations control the harvest. If these models are indeed grown from all of us, then who actually gets to decide how they are raised? It's a question that goes far beyond the code, and honestly... [pauses] it's one we need to start answering before the crop grows completely out of our control.
