Quantum Mechanics
I worry that we don't really understand quantum phenomena. We have a successful theory—quantum mechanics, which has passed every experimental test since it was formulated in 1926 and which is the foundation for our understanding of all of physics—except gravity. It is the basis of new technologies of quantum information and computation which are presently under intensive development. Still, I don't believe quantum mechanics gives a complete description of nature. I strongly believe there is another, truer description, waiting to be discovered.
A large part of the reason is that quantum mechanics only gives probabilistic predictions for the results of experiments. Atoms and molecules come in discrete states, with distinct energies. These distinct states are the basis for our understanding of chemistry. When an atom or molecule transitions between these states, they emit or absorb photons to make up the jump in energy. Quantum mechanics provides probabilities for these different transitions to occur. These probabilities can be compared with rates measured by experiments done on many systems at a time.
But consider a particular individual atom which decays at a particular instant from one excited state to a lower energy state. Quantum mechanics provides no precise prediction as to when that instant will be, nor does it provide any basis for an explanation of why it happens when it does. I believe there must be a reason why every individual event happens, and that if we understood it we could make a theory to predict in principle when each atom transitions. That is to say, I want a theory of quantum phenomena that goes beyond quantum mechanics.
The people who originally formulated quantum mechanics did not claim it gave a complete description of physical reality. Bohr, Heisenberg and their followers explained that there were two kinds of processes in nature—ordinary processes and measurement processes. To distinguish them they divided the world in two. On one side of the divide is the quantum system we want to describe. On the other side is our world, populated by people, measuring instruments and clocks. These are to be described by old fashion Newtonian physics. A measurement process happens when the two worlds interact and the probabilities describe outcomes of these interactions. Quantum mechanics, they argued, gives no description or account of what goes on in the purely quantum world. It is a tool for discussing the probabilities for different outcomes of interventions we make on a quantum system.
But surely we and our measuring systems are made of atoms and so are part of the quantum world. In that case, shouldn't it be possible to put everything into the quantum side of the division and treat ourselves and our tools as quantum systems? When we try to do this we get no account of experiments giving definite results and no predictions of probabilities for those results. To make sense of this is called the measurement problem and it has been under contention for eight decades.
One response is the many worlds interpretation which claims that reality is vastly bigger than the world we observe and contains an infinitude of histories, one for every sequence of outcomes for which quantum mechanics predicts probabilities. The world we experience is only one of these histories.
I do not believe in this vast expansion of reality. I believe there is only one real world in which there are definite outcomes of experiments, in which only one history is realized of the may possible.
Many other resolutions have been offered to account for the fact that quantum mechanics does not give an account of individual phenomena. Perhaps logic could be changed so that it becomes no longer possible to express our perplexity. Perhaps quantum mechanics describes, not nature, but only the information that an observer may gather about a physical system by doing experiments.
But there is another possibility: that quantum mechanics does not provide an explanation for what happens in individual phenomena because it is incomplete, because it simply leaves out aspects of nature needed for a true description. This is what Einstein believed and it is also what de Broglie and Schroedinger, who made key steps formulating the theory, believed. This is what I believe and my lifelong worry has been how to discover that more complete theory.
A completion of quantum mechanics which allows a full description of individual phenomena is called a hidden variables theory. Several have been invented; one which has been much studied was invented by de Broglie in 1928 and reinvented by David Bohm in the 1950s. This shows its possible, now what we need to do is find the right theory. The best way to do that would be to discover a theory that agreed with all past tests of quantum mechanics but disagreed about the outcomes of experiments with large, complex quantum devices now under development.
We know that such a theory must be radically non-local, in the sense that once two particles interact and separate, their properties are entangled even if they travel far from each other. This implies that information as to the precise outcomes of experiments they may be each subject to has to be able to travel faster than light.
This means that a complete theory of quantum phenomena must contain a theory of space and time. As a result I've long believed that the task of completing quantum mechanics and the challenge of unifying quantum mechanics with spacetime are one and the same problem. I also see the problem of extending our understanding of physics at the cosmological scale to be the same as discovering the world behind quantum mechanics.
Many physicists accept quantum mechanics as a final theory and attempt to solve the open problems in physics and cosmology, such as unification and quantum gravity, within the existing framework of quantum physics. I worry that this is wrong and cannot succeed, because quantum mechanics itself must be radically deepened and completed to make further progress in our understanding of nature.
