Abstract Deep neural networks have demonstrated remarkable efficacy in extracting meaningful representations from complex datasets. This has propelled representation learning as a compelling area of research across diverse fields. One interesting open question is how beneficial representation learning can be for quantum many-body physics, with its notoriously high-dimensional state space. In this work, we showcase the capacity of a neural network that was trained on a subset of physical observables of a many-body system to partially acquire an implicit representation of the wave function. We illustrate this by demonstrating the effectiveness of reusing the representation learned by the neural network to enhance the learning process of another quantity derived from the quantum state. In particular, we focus on how the pre-trained neural network can enhance the learning of entanglement entropy. This is of particular interest as directly measuring the entanglement in a many-body system is very challenging, while a subset of physical observables can be easily measured in experiments. We show the pre-trained neural network learns the dynamics of entropy with fewer resources and higher precision in comparison with direct training on the entanglement entropy.
Abstract Deep neural networks have demonstrated remarkable efficacy in extracting meaningful representations from complex datasets. This has propelled representation learning as a compelling area of research across diverse fields. One interesting open question is how beneficial representation learning can be for quantum many-body physics, with its notoriously high-dimensional state space. In this work, we showcase the capacity of a neural network that was trained on a subset of physical observables of a many-body system to partially acquire an implicit representation of the wave function. We illustrate this by demonstrating the effectiveness of reusing the representation learned by the neural network to enhance the learning process of another quantity derived from the quantum state. In particular, we focus on how the pre-trained neural network can enhance the learning of entanglement entropy. This is of particular interest as directly measuring the entanglement in a many-body system is very challenging, while a subset of physical observables can be easily measured in experiments. We show the pre-trained neural network learns the dynamics of entropy with fewer resources and higher precision in comparison with direct training on the entanglement entropy.
Abstract Part of the challenge for quantum many-body problems comes from the difficulty of representing large-scale quantum states, which in general requires an exponentially large number of parameters. Neural networks provide a powerful tool to represent quantum many-body states. An important open question is what characterizes the representational power of deep and shallow neural networks, which is of fundamental interest due to the popularity of deep learning methods. Here, we give a proof that, assuming a widely believed computational complexity conjecture, a deep neural network can efficiently represent most physical states, including the ground states of many-body Hamiltonians and states generated by quantum dynamics, while a shallow network representation with a restricted Boltzmann machine cannot efficiently represent some of those states.
Machine learning has shown significant breakthroughs in quantum science, where in particular deep neural networks exhibited remarkable power in modeling quantum many-body systems. Here, we explore how the capacity of data-driven deep neural networks in learning the dynamics of physical observables is correlated with the scrambling of quantum information. We train a neural network to find a mapping from the parameters of a model to the evolution of observables in random quantum circuits for various regimes of quantum scrambling and test its generalization and extrapolation capabilities in applying it to unseen circuits. Our results show that a particular type of recurrent neural network is extremely powerful in generalizing its predictions within the system size and time window that it has been trained on for both, localized and scrambled regimes. These include regimes where classical learning approaches are known to fail in sampling from a representation of the full wave function. Moreover, the considered neural network succeeds in extrapolating its predictions beyond the time window and system size that it has been trained on for models that show localization, but not in scrambled regimes.
Part of the challenge for quantum many-body problems comes from the difficulty of representing large-scale quantum states, which in general requires an exponentially large number of parameters. Neural networks provide a powerful tool to represent quantum many-body states. An important open question is what characterizes the representational power of deep and shallow neural networks, which is of fundamental interest due to the popularity of deep learning methods. Here, we give a proof that, assuming a widely believed computational complexity conjecture, a deep neural network can efficiently represent most physical states, including the ground states of many-body Hamiltonians and states generated by quantum dynamics, while a shallow network representation with a restricted Boltzmann machine cannot efficiently represent some of those states.One of the challenges in studies of quantum many-body physics is finding an efficient way to record the large system wavefunctions. Here the authors present an analysis of the capabilities of recently-proposed neural network representations for storing physically accessible quantum states.
Neural networks have emerged as a powerful way to approach many practical problems in quantum physics. In this work, we illustrate the power of deep learning to predict the dynamics of a quantum many-body system, where the training is based purely on monitoring expectation values of observables under random driving . The trained recurrent network is able to produce accurate predictions for driving trajectories entirely different than those observed during training. As a proof of principle, here we train the network on numerical data generated from spin models, showing that it can learn the dynamics of observables of interest without needing information about the full quantum state. This allows our approach to be applied eventually to actual experimental data generated from a quantum many-body system that might be open, noisy, or disordered, without any need for a detailed understanding of the system. This scheme provides considerable speedup for rapid explorations and pulse optimization. Remarkably, we show the network is able to extrapolate the dynamics to times longer than those it has been trained on, as well as to the infinite-system-size limit.
One of the main reasons why the physics of quantum many-body systems is hard \nlies in the curse of dimensionality: \nThe number of states of such systems increases exponentially with the number of degrees of freedom involved. \nAs a result, computations for realistic systems become intractable, \nand even numerical methods are limited to comparably small system sizes. \nMany efforts in modern physics research are therefore concerned with \nfinding efficient representations of quantum states and \nclever approximations schemes that would allow them to characterize physical systems of interest. \n \nMeanwhile, Deep Learning (DL) has solved many non-scientific problems \nthat have been unaccessible to conventional methods for a similar reason. \nThe concept underlying DL is to extract knowledge from data \nby identifying patterns and regularities. \nThe remarkable success of DL has excited many physicists about \nthe prospect of leveraging its power to solve intractable problems in physics. \nAt the same time, DL turned out to be an interesting complex many-body \nproblem in itself. \nIn contrast to its widespread empirical applications, \nthe theoretical foundation of DL is strongly underdeveloped. \nIn particular, as long as its decision-making process and result interpretability remain opaque, \nDL can not claim the status of a scientific tool. \n \nIn this thesis, I explore the interface between DL and quantum many-body physics, \nand investigate DL both as a tool and as a subject of study. \nThe first project presented here is a theory-based study of \na fundamental open question about the role of width and the number of parameters in deep neural networks. \nIn this work, we consider a DL setup for the image recognition task on standard benchmarking datasets. \nWe combine controlled experiments with a theoretical analysis, including analytical calculations for a toy model. \nThe other three works focus on the application of Restricted Boltzmann Machines as generative models \nfor the task of wavefunction reconstruction from measurement data on a quantum many-body system. \nFirst, we implement this approach as a software package, making it available as a tool for experimentalists. \nFollowing the idea that physics problems can be used to characterize DL tools, \nwe then use our extensive knowledge of this setup to conduct a systematic study of \nhow the RBM complexity scales with the complexity of the physical system. \nFinally, in a follow-up study we focus on the effects of parameter pruning techniques \non the RBM and its scaling behavior.
Entanglement, which quantifies nonlocal correlations in quantum mechanics, is the fascinating concept behind much of the aspiration towards quantum technologies. Nevertheless, directly measuring the entanglement of a many-particle system is very challenging. Here, we show that via supervised machine learning using a convolutional neural network, we can infer the entanglement from a measurable observable for a disordered interacting quantum many-particle system. Several structures of neural networks were tested and a convolutional neural network akin to structures used for image and speech recognition performed the best. After training on a set of 500 realizations of disorder, the network was applied to 200 new realizations and its results for the entanglement entropy were compared to a direct computation of the entanglement entropy. Excellent agreement was found, except for several rare regions which in a previous study were identified as belonging to an inclusion of a Griffiths-like quantum phase. Training the network on a test set with different parameters (in the same phase) also works quite well.