Search FQXi


Georgina Woodward: "Compare: "Wild', existentially free particle, unmeasured, unperturbed, in..." in Quantum Physics and the...

Georgina Woodward: "1. The 'magic rabbit' does not come into being, upon the photo being seen...." in Quantum Physics and the...

Deserdi Chapas: "Report on ongoing Holographic Physics work at As humanity has..." in Alternative Models of...

umair zaheer: "Travel is the movement of people between distant geographical locations...." in Anatomy of spacetime and...

robin 435: "rsvsfascxseaczcfadv" in Anatomy of spacetime and...

David Vognar: "Electron Doping? by David Vognar I think it helps to visualize physics so..." in The Present State of...

Nick Fury: "Hi, when you get older there is not a single part of your body that is..." in Quantum Measurement and...

Lady Zecharia: "Can physics address - at least in principle - the truly deep questions of..." in The Present State of...

click titles to read articles

The Entropic Price of Building the Perfect Clock: Q&A with Natalia Ares
Experiments investigating the thermodynamics of clocks can teach us about the origin of time's arrow.

Schrödinger’s A.I. Could Test the Foundations of Reality
Physicists lay out blueprints for running a 'Wigner's Friend' experiment using an artificial intelligence, built on a quantum computer, as an 'observer.'

Expanding the Mind (Literally): Q&A with Karim Jerbi and Jordan O'Byrne
Using a brain-computer interface to create a consciousness 'add-on' to help test Integrated Information Theory.

Quanthoven's Fifth
A quantum computer composes chart-topping music, programmed by physicists striving to understand consciousness.

The Math of Consciousness: Q&A with Kobi Kremnitzer
A meditating mathematician is developing a theory of conscious experience to help understand the boundary between the quantum and classical world.

December 6, 2022

Inferring the Limits on Reality (that Even the Gods Must Obey)
The fuzziness of the quantum realm could arise from mathematical restrictions on what can ever be known.
by Anil Ananthaswamy
FQXi Awardees: David Wolpert
June 24, 2015
Bookmark and Share

David Wolpert
Santa Fe Institute
David Wolpert has his tongue mostly in his cheek when he says that his theory puts limits on religions. "There cannot be two gods, both of which can perfectly observe everything, or both of which can make anything happen that they want," he says. In fact, there cannot even be two gods who both have perfect memory. In short, it is mathematically impossible to have a polytheistic universe with all-knowing gods.

Such statements (made with "very heavy air quotes") are the consequence of limits that Wolpert has derived on the ability of any so-called "inference device" (a machine which can observe and/or control the world around itself). Rather than analyzing various pantheons, Wolpert is interested in the mathematical restrictions on what information a device can have concerning a system and the implications those restrictions have for the laws of physics. He has discovered constraints that look remarkably similar to those that physicists have long been familiar with from quantum theory, for instance, Heisenberg’s Uncertainty Principle. Wolpert’s findings could help physicists finally understand the origin of this famous fuzziness in the quantum realm. It could as arise from unavoidable formal restrictions on what can be known.

Wolpert’s fascination with foundational questions began when he was studying for a PhD in physics at the University of California, Santa Barbara. "Probably everybody, as a grad student in physics, has this dream that they will figure out the ultimate theory of everything," says Wolpert, who is now at the Santa Fe Institute in New Mexico.

In 1998, while still a graduate student, Wolpert attended a workshop on complex systems at Santa Fe, where he met John Wheeler, an eminent physicist at Princeton University, who had already championed the idea of linking information with the quantum. In his just published autobiography, Wheeler had said, "I suggest that we may never understand this strange thing, the quantum, until we understand how information may underlie reality." Despite his formidable stature as a physicist, Wheeler was interested in what Wolpert had to say. "I was sort of taken aback that he wanted to go on a walk and know more about what I, a grad student, thought about these things," says Wolpert.

Inference Devices

Wolpert can’t recall exactly what he told Wheeler—but it was likely about his early attempts to understand how we can make predictions about physical reality. Wolpert realized that any attempt to "know" reality involves either observing physical quantities, remembering past values of such quantities and/or predicting or controlling their future values. He found that all these processes—different ways of having "semantic information" about the state of the universe—share some common mathematical features. He called any device that implements those features an "inference device" (Physica D 237:1257-1281, 2008).

Inference devices are physical machines that obey the normal rules of mathematics and logic. The only a priori restriction on them is that they exist in the same physical universe as the system they want to know about. In Wolpert’s model, for an inference device to know something about the state of a system they must be able to correctly answer YES or NO to any binary question concerning the state of that system. The question could be something as simple as: Are there clouds in the sky? If its answer is always correct, no matter what the actual state of clouds in the sky, then the device knows whether there are indeed clouds in the sky.

Wolpert proved that it’s impossible for one inference device (device A) to both know its own answer to an arbitrary question and to also know the answer to the same question by a different inference device B. The same holds true for B. This limitation holds no matter what the laws of physics actually are—the limits apply in any universe.

Are there clouds in the sky?
You may think you know the answer, but can you know someone else’s answer
to the same question?

Credit: Wiki Commons
Surprisingly, when this and similar limitations are expressed in terms of probability distributions, they offer intriguing connections to quantum mechanics, the theory that governs the atomic realm, and which appears to impose laws that strain our everyday sense of logic. For instance, according to Heisenberg’s uncertainty principle, it is impossible to precisely measure pairs of certain properties of a quantum particle—its position and momentum, say—simultaneously. Formally, this is very similar to limitations on how accurately inference devices A and B can simultaneously know one another’s states.

To understand this connection between inference devices and quantum rules, suppose that two inference devices A and B are both asked a question about the state of one another, as before. But instead of analyzing whether the precise answers A and B give are always correct, instead calculate,"What is the probability that A is correct?" and "What is the probability that B is correct?"

One can take this kind of analysis one step further and calculate the best possible values of the probabilities of A knowing B’s answer and B knowing A’s answer, simultaneously. "You can actually prove that that product of probabilities obeys something that looks very much like the uncertainty principle of quantum mechanics," says Wolpert.

In other words, there’s a limit to how well A can know B’s answer and B can know A’s answer simultaneously (just think of A and B as gods, and you have your argument against a polytheistic universe).

Physicist Philippe Binder of the University of Hawaii in Hilo says that Wolpert’s work is "very good and of foundational importance." Writing in the journal Nature soon after Wolpert published his work on inference devices, Binder said that Wolpert’s results "slam the door" on scientific determinism, as first articulated by Pierre Simon Laplace in the nineteenth century.

Destroying Demons

Laplace introduced the idea of a hypothetical super-intelligent ’demon’ that can predict the future state of the universe if it has complete knowledge of the current state. But, by using Wolpert’s framework, one can model the current avatar of any such demon as an inference device, while the future avatar of the demon must be regarded as another inference device. (This is because the state of the universe changes from one moment to another and inference devices can only be defined within the context of one given state of the universe.) Wolpert’s work shows that the current avatar of the demon cannot know with absolute certainty the future avatar’s knowledge about the state of the universe. In other words, Laplace’s demon cannot predict without uncertainty. (This is true even if one assumes a classical, finite, non-chaotic universe, as Laplace did.)

Wolpert’s results “slam the door”
on scientific determinism
- Philippe Binder
The work has implications for our ability to come up with the kind of theory of everything that Wolpert longed for as a graduate student. As Binder pointed out in his essay, Wolpert’s work suggests that "the entire physical Universe cannot be fully understood by any single inference system that exists within it"—including any particular human. So, at best we can hope to a have a "theory of almost everything."

FQXi member Paul Davies, of the Arizona State University in Tempe, Arizona, says that Wolpert tackles the question of how something that is a part of the universe can understand the whole. "It is getting one level deeper to the nature of reality," says Davies.

Wolpert is now using a $50,000 FQXi grant to investigate whether the intriguing connection he uncovered between inference devices and the uncertainty principle in quantum mechanics can be tightened and even extended. If it can, that would help physicists understand the origin of one of the basic principles that governs reality.

Inference devices could also help to reveal the links between Claude Shannon’s theory of "syntactic information" and thermodynamics. The best example of that relationship is the Landauer principle—due to physicist Rolf Landauer—which says that you cannot reset even a single bit of information (whether it is a 0 or a 1) without releasing heat. In separate work, Wolpert has extended that work beyond just erasing a bit, but an arbitrary stochastic process evolving a system forward in time. Now he wants to figure out whether this result has any bearing on his work on inference devices, which involves semantic rather than syntactic information. "Information has ultimately got to involve both," says Wolpert.

But even a monotheistic God may have to accept some limitations when it comes to such information. With his tongue back in his cheek, Wolpert says that God can get the universe rolling, but can’t interfere with its functioning afterwards. "Or, after someone else gets the universe going, you can interfere, but you can’t do both," says Wolpert. Deism is allowed, he says, but not the traditional Abrahamic God.

Comment on this Article

Please read the important Introduction that governs your participation in this community. Inappropriate language will not be tolerated and posts containing such language will be deleted. Otherwise, this is a free speech Forum and all are welcome!
  • Please enter the text of your post, then click the "Submit New Post" button below. You may also optionally add file attachments below before submitting your edits.

  • HTML tags are not permitted in posts, and will automatically be stripped out. Links to other web sites are permitted. For instructions on how to add links, please read the link help page.

  • You may use superscript (10100) and subscript (A2) using [sup]...[/sup] and [sub]...[/sub] tags.

  • You may use bold (important) and italics (emphasize) using [b]...[/b] and [i]...[/i] tags.

  • You may also include LateX equations into your post.

Insert LaTeX Equation [hide]

LaTeX equations may be displayed in FQXi Forum posts by including them within [equation]...[/equation] tags. You may type your equation directly into your post, or use the LaTeX Equation Preview feature below to see how your equation will render (this is recommended).

For more help on LaTeX, please see the LaTeX Project Home Page.

LaTeX Equation Preview

preview equation
clear equation
insert equation into post at cursor

Your name: (optional)

Recent Comments

Which is inertial mass of Higgs boson? Idea that Higgs boson is giving inertial mass to particles (photos and gluons excluded) open question which is inertial mass of the Higgs boson itself. Right answer will be awarded by 100.000 Euro by Foundation of Physics Institute - FOPI.

Why it reminds me Gödel’s incompleteness principles?

I was surprised that interference machine is needed to have memory because this is most often avoided to be mentioned. On this line, any entity (interference machine also) has its own states’ history (“syntactic” and “semantic”) always available within its own inheritance. This implies that its whole previous history (that incorporates also Universe’s history) is precisely “known” to it, without any uncertainty....

"too many times is God absent"

In actuality he is nowhere absent. S is distributed over S. This is how the self is S, and since nowhere is S absent, He must be in me. And He is therefore "I" as spirit and non-"I", or "God" and non-"God" merged to become the one that distributes over the one. Reality being defined according to God. As I already explained, evil does not exist, it is the absence of God in man's hearts, God is love, consciousness, and good, therefore a flicker of that candle...

read all article comments

Please enter your e-mail address:
Note: Joining the FQXi mailing list does not give you a login account or constitute membership in the organization.