Abstract Toward the end of the nineteenth century Lord Kelvin, one of the best known and most respected physicists at that time, commented that “only two small clouds” remained on the horizon of knowledge in physics. In other words, there were, in Kelvin’s view, only two sources of confusion in our otherwise complete understanding of material reality. The two clouds were the results of the Michelson-Morley experiment, which failed to detect the existence of a hypothetical substance called the ether, and the inability of electromagnetic theory to predict the distribution of radiant energy at different frequencies emitted by an idealized “radiator” called the black body. These problems seemed so small that some established physicists were encouraging those contemplating graduate study in physics to select other fields of scientific study where there was more opportunity to make original contributions to knowledge. What Lord Kelvin could not have anticipated was that efforts to resolve these two anomalies would lead to relativity theory and quantum theory, or to what came to be called the new physics.
Abstract Toward the end of the nineteenth century Lord Kelvin, one of the best known and most respected physicists at that time, commented that “only two small clouds” remained on the horizon of knowledge in physics. In other words, there were, in Kelvin’s view, only two sources of confusion in our otherwise complete understanding of material reality. The two clouds were the results of the Michelson-Morley experiment, which failed to detect the existence of a hypothetical substance called the ether, and the inability of electromagnetic theory to predict the distribution of radiant energy at different frequencies emitted by an idealized “radiator” called the black body. These problems seemed so small that some established physicists were encouraging those contemplating graduate study in physics to select other fields of scientific study where there was more opportunity to make original contributions to knowledge. What Lord Kelvin could not have anticipated was that efforts to resolve these two anomalies would lead to relativity theory and quantum theory, or to what came to be called the new physics.
Abstract Six years after Kelvin made this claim, he hedged: “Physics is essentially complete: There are just two dark clouds on the horizon.” He picked the right clouds: One hid relativity; the other, quantum mechanics. But before we look behind those clouds, we tell a bit more of the nineteenth-century physics we today call “classical.” We will describe the phenomenon of “interference,” which demonstrates something to be a widely extended wave. We will need the concept of electric field. Light is a rapidly varying electric field, and it is with light that the quantum enigma first arose. We will also talk of energy and its “conservation,” its unchanging totality. And we will briefly tell of Einstein’s theory of relativity. Its well-confirmed but hard-to-believe predictions are good psychological practice for the “impossible-to-believe” implications of quantum theory. There’s somewhat more in this chapter than you actually need to know in order to understand the quantum enigma. But it’s good background.
In 1903 the physicist Albert Michelson made an astonishing pronouncement. Confident of the advances made by the great physicists of the Victorian era, such as Lord Kelvin, James Clark Maxwell and Thomas Edison, he declared that ‘the most important fundamental laws and facts of physical science have all been discovered, and these are now so firmly established that the possibility of their ever being supplemented in consequence of new discoveries is exceedingly remote’.1 In so doing he followed what appeared to be a long-established tradition that eminent physicists should make bold and far-reaching statements on the nature of the universe and its physical laws.2 Unfortunately, Michelson’s timing could not be worse as early twentieth-century physicists were about to make a string of discoveries that would fundamentally alter our perceptions of the universe. The world as Michelson understood it was about to be turned on its head by the work of three men: Max Planck, Albert Einstein and Ernest Rutherford. The first, Planck, was a respected German physicist who had done work on entropy, but had done little to distinguish himself. Then in 1900 he developed his ‘quantum theory’ which posited that energy did not flow as a stream or wave as had been imagined before, but rather was carried by packets or quanta. This seemingly simple, yet deceptively complex, thesis was to have a profound effect upon our understanding of the physical universe. Planck’s thesis proved to be the foundation for the modern discipline of quantum physics, a discipline that first came to the attention of the wider public when in 1905 a young Swiss patents clerk called Albert Einstein wrote five papers for the Annalen der Physik. Three of these papers are widely accepted to be among the best in the history of physics and examined photoelectric effects by applying Planck’s new quantum theory, Brownian Motion and a ‘Special Theory of Relativity’. As Bill Bryson notes in his Short History of Nearly Everything, ‘the first won its author a Nobel Prize and explained the nature of light (and also helped make television possible among other things). The Second provided proof that atoms do indeed exist – a fact that had surprisingly, been in some dispute. The third merely changed the world’.3 Thus within two years of Michelson’s pronouncement much of our understanding of the physical universe had been turned on its head by this new development; but for Michelson worse was to follow. In 1895, a young South African named Ernest Rutherford had won a scholarship to the world famous Cavendish Laboratory at the University of Cambridge. By 1911, Rutherford had become obsessed with the nature of atoms, the basic building blocks that form the constituent parts of the universe. That year he proposed his ‘theory of atomic nuclei’, which suggested that all the positive charge and most of the mass of an atom must be contained in a tiny nucleus at the atom’s centre, with the negatively charged electrons ‘in orbit’ about this nucleus. To prove his thesis Rutherford had to ‘split’ the atom to prove that he could release matter from this nucleus, something which he finally succeeded in doing in 1919 when he showed that by firing alpha-particles into nitrogen gas a small amount of hydrogen could be produced. In so doing he also established that energy could be released from the nucleus of an atom, thereby proving an essential part of Albert Einstein’s Special Theory of Relativity: the unification of energy and mass, usually represented by the famous equation E=mc2.4 With Rutherford providing the link between quantum theory and nuclear physics the Newtonian view of the universe, which was at the heart of Michelson’s beliefs, had been rewritten in less that 20 years.
Science has developed through a variety of investigations more or less over the time scale of human existence. On this scale, quantum mechanics is an extremely young field, existing essentially for only just over a century. Even our understanding of classical mechanics has existed for a comparatively long period—roughly having been formalized with Newton's equations published in his Principia Mathematica , in April 1686 (1687). Up until the very end of the nineteenth century, mechanics in the form of Newton's laws were comfortable, being understood and accepted by all who dealt with the motion of reasonable bodies. With the turn of the new century, however, mechanics would be shaken to its roots. The change began already on December 14, 1900, when Planck (1900) presented his new theory of black-body radiation to the German Physical Society, and this change would affect mechanics in physically small structures (and lead to quantum mechanics). Mechanics of large bodies would similarly be changed in 1905 with the arrival of Albert Einstein's (1905a) relativity theory. In this book, we will deal with only the first of these two great breakthroughs.
Toward the end of the nineteenth century, it became clear that some experiments cannot be explained on the basis of known physics, now referred to as classical physics. In 1900, Max Planck was able to correctly describe the distribution of blackbody radiation energy as a function of wavelength λ or frequency ν = c/λ. He had to accept the existence of energy packets (quanta) with energy E = hν. A few years later, Albert Einstein found that this unexpected relation between energy and frequency is also necessary in order to understand photoemission from metallic surfaces. A decade later, Niels Bohr arrived at the correct equation for the electronic spectrum of the hydrogen atom by applying “quantum conditions” on the motion of the electron around the nucleus and the Planck’s relation E = hν on the energy difference between the energy levels (1916). A decade later, Heisenberg, Born, and Jordan introduced “quantum mechanics” and de Broglie and Schrödinger (1925-1926) introduced “wave mechanics.”
By the end of the nineteenth century all the important elements of classical physics were fully mature. Newton's Laws had been applied with success to everything from industrial machines to planetary orbits. Classical thermodynamics had extended energy conservation arguments into thermal processes, and scientists including J. Willard Gibbs and Ludwig Boltzmann had developed the statistical interpretation of entropy. James Clerk Maxwell had explained all electromagnetic phenomena, from AC generators/motors to light, with the four Maxwell's equations and three material-dependent constitutive relations. There was serious discussion that physics was on the verge of being “finished” – becoming a closed system of knowledge like classical geometry with only essentially routine tasks left of determining how the known laws could be applied to engineering problems. Yet by 1930 the foundations of mechanics, electromagnetics, and atomic-scale systems had been shaken to the core by the new revolutions in the Theory of Relativity, the photon picture of light, and quantum physics. We are still reaping the benefits of the application of these new scientific paradigms in our technology today, including semiconductor electronic devices, lasers, and GPS systems. But the description of reality that these theories provide is still deeply anti-intuitive and disturbing. Nevertheless, quantum physics is one of the most extensively experimentally verified theories that we know. Even when quantum theory and common sense seem to diverge, quantum theory gives the right answers when tested by experiment. In the next chapter we will develop the framework of quantum theory that has been so successful when people “shut up and calculate,” as one scientist suggested as the way through the philosophical thicket of quantum physics. But in this chapter, we will spend a brief time considering the historical development and continuing paradoxical implications of quantum theory. The photoelectric effect and photons In 1905, Albert Einstein, who was a key figure in the revolution of modern physics, was working as a clerk in the patent office in Zurich, Switzerland. Einstein had finished his studies in physics, but had not obtained a coveted position as a university professor. He was intensely interested in the latest developments in classical physics and was aware of a few of the remaining loose ends that were resisting explanation in the classical model.
‘God’, said Albert Einstein, ‘does not play dice’. This famous remark by the author of the theory of relativity was not intended as an analysis of the recreational habits of a supreme being but expressed his reaction to the new scientific ideas, developed in the first quarter of the twentieth century, which are now known as quantum physics. Before we can fully appreciate why one of the greatest scientists of modern times should have been led to make such a comment, we must first try to understand the context of scientific and philosophical thought that had become established by the end of the nineteenth century and what it was about the ‘new physics’ that presented such a radical challenge to this consensus. What is often thought of as the modern scientific age began in the sixteenth century, when Nicholas Copernicus proposed that the motion of the stars and planets should be described on the assumption that it is the sun, rather than the earth, which is the centre of the solar system. The opposition, not to say persecution, that this idea encountered from much of the establishment of that time is well known, but this was unable to prevent a revolution in thinking whose influence has continued to the present day. From that time on, the accepted test of scientific truth has increasingly been observation and experiment rather than religious or philosophical dogma.