Neural Networks Are Cryptography in Reverse - Reiner Pope
Reiner Pope draws a conceptual parallel between cryptography and neural networks, arguing they are essentially inverse processes. Cryptography obscures structured information into randomness, while neural networks extract structure from seemingly random data. A key connection is that gradient-based attacks on ciphers (differential cryptanalysis) mirror the differentiability that makes neural networks trainable.
Summary
In this short clip, Reiner Pope presents a thought-provoking analogy between cryptographic systems and neural networks, framing them as conceptually opposite endeavors that share similar high-level mechanisms.
Pope begins by contrasting their goals: cryptographic protocols take structured information and transform it to appear indistinguishable from randomness, while neural networks do the reverse — they take apparently random or garbled inputs (such as protein sequences, DNA, or text) and extract meaningful higher-level structure from them.
He then makes an interesting observation about randomly initialized neural networks, suggesting that before training, a neural network might actually function as a reasonable cipher, since the random weights would jumble information in a complex way. What distinguishes a trained neural network from a cipher, he argues, is the process of gradient descent — the ability to differentiate the network and obtain meaningful derivatives.
Finally, Pope draws a direct technical parallel between neural network training and a major class of attacks on cryptographic ciphers known as differential cryptanalysis. This attack exploits the relationship between small differences in inputs and the resulting differences in outputs. A well-designed cipher is specifically engineered to prevent small input differences from producing predictably small output differences — the very property that makes gradient-based learning difficult to apply to ciphers, and conversely, what makes neural networks vulnerable to being 'understood' through differentiation.
Key Insights
- Pope argues that cryptography and neural networks are attempting to do opposite things: cryptography takes structured information and makes it look like randomness, while neural networks take seemingly random data and extract higher-level structure from it.
- Pope claims that a randomly initialized neural network could plausibly function as a reasonable cipher, because the random weights would jumble information in a sufficiently complex way.
- Pope asserts that what separates a neural network from a cipher is gradient descent — the fact that you can differentiate a neural network and obtain a meaningful derivative.
- Pope draws a direct parallel between neural network training and differential cryptanalysis, one of the most significant attacks against cryptographic ciphers, noting both rely on analyzing how differences in inputs propagate to outputs.
- Pope states that a well-designed cipher's core job is to ensure that small differences in input produce large and unpredictable differences in output — the exact property that resists gradient-based analysis.
Topics
Transcript
[0:00] Cryptographic protocols are trying to take information which has structure and make it look indistinguishable from randomness and neural networks are trying to take things which look like random protein sequences DNA garble text and extract higher level structure from it. So they have similar highle mechanisms but they're actually kind of trying to do the opposite things. If you just randomly initialize a neural network actually maybe it's a reasonable cipher as well because like the random initialization is going to jumble stuff in a complicated way. The thing that makes it interpretable is the gradient descent. So you can differentiate a neural network and get a meaningful derivative. One of the biggest attacks [0:31] against cryptographic ciphers…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Dwarkesh Patel
The Army Sent to Stop Cortés Joined Him Instead - Si Sheppard
Spanish conquistador Cortés faced a threat from Governor Velázquez of Cuba, who sent Don Narvaez with a larger force to arrest him for exceeding his authority. Rather than being defeated, Cortés defeated Narvaez in battle and persuaded the expeditionary force to join him by promising shared wealth from the empire, turning potential enemies into reinforcements.
How 168 Men Captured the Inca Emperor - Si Sheppard
Francisco Pizarro, with only 168 men, captured the Inca Emperor Atahualpa in 1532 at Cajamarca by using psychological tactics with horses and an ambush strategy. Despite Atahualpa's show of dominance and his large army, Pizarro's surprise attack and capture of the emperor allowed him to control the entire Inca social hierarchy.
The Myth of the Helpless Aztecs and Inca - Si Sheppard
Si Sheppard argues that the Aztecs and Incas were not helpless victims but actively developed countermeasures and adaptive strategies against Spanish conquistadors, including terrain manipulation, weapon improvisation, and tactical learning—though they lacked sufficient time to fully master foreign technologies.
How Conquistadors Conquered the Aztecs - Si Sheppard
Conquistador success against the Aztecs relied primarily on steel weapons, horses, and psychological tactics rather than firearms. Steel armor and swords proved far more effective than indigenous weapons made of wood, stone, and obsidian, while horses—animals unknown to the Aztecs—provided decisive military and logistical advantages.
How did a few hundred Spanish soldiers topple two empires? – Si Sheppard
Military historian Si Sheppard explains how a few hundred Spanish conquistadors were able to conquer the Aztec and Inca Empires within just a few years through a combination of technological advantages (horses, steel weapons), psychological warfare, diplomatic manipulation of existing divisions among indigenous peoples, and the catastrophic impact of disease. The conquests were contingent on individual leadership decisions and geographic factors, but were fundamentally enabled by the conquistadors' ability to exploit internal rifts within empires that appeared monolithic from the outside.