Analog computing using bosonic computational states is a leading approach to surpassing the computational speed and energy limitations of von Neumann architectures. But the challenges of manufacturing large-scale photonic integrated circuits (PIC) has led to hybrid solutions that integrate optical analog and electronic digital components. A notable example is the coherent Ising machine (CIM), that was primarily invented for solving quadratic binary optimization problems. In this paper, we focus on a mean-field interpretation of the dynamics of optical pulses in the CIM as solutions to Langevin dynamics, a stochastic differential equation (SDE) that plays a key role in non-convex optimization and generative AI. This interpretation establishes a computational framework for understanding the system's operation, the computational role of each component, and its performance, strengths, and limitations. We then infer that the CIM is inherently a continuous state machine, capable of integrating a broad range of SDEs, in particular for solving a continuous global (or mildly constrained) optimization problems. Nevertheless, we observe that the iterative digital-to-analog and analog-to-digital conversions within the protocol create a bottleneck for the low power and high speed of optics to shine. This observation underscores the need for major advances in PIC technologies as we envision that fully analog opto-electronic realizations of such experiments can open doors for broader applications, and orders of magnitude improvements in speed and energy consumption.
Analog computing using bosonic computational states is a leading approach to surpassing the computational speed and energy limitations of von Neumann architectures. But the challenges of manufacturing large-scale photonic integrated circuits (PIC) has led to hybrid solutions that integrate optical analog and electronic digital components. A notable example is the coherent Ising machine (CIM), that was primarily invented for solving quadratic binary optimization problems. In this paper, we focus on a mean-field interpretation of the dynamics of optical pulses in the CIM as solutions to Langevin dynamics, a stochastic differential equation (SDE) that plays a key role in non-convex optimization and generative AI. This interpretation establishes a computational framework for understanding the system's operation, the computational role of each component, and its performance, strengths, and limitations. We then infer that the CIM is inherently a continuous state machine, capable of integrating a broad range of SDEs, in particular for solving a continuous global (or mildly constrained) optimization problems. Nevertheless, we observe that the iterative digital-to-analog and analog-to-digital conversions within the protocol create a bottleneck for the low power and high speed of optics to shine. This observation underscores the need for major advances in PIC technologies as we envision that fully analog opto-electronic realizations of such experiments can open doors for broader applications, and orders of magnitude improvements in speed and energy consumption.
Abstract A Coherent Ising machine (CIM) is an oscillator-network-based analog computing system to circumvent the bottleneck in von Neumann digital computing architectures. The CIM consists of a network of degenerate optical parametric oscillators (DOPOs) and is designed to find a ground state or perform Boltzmann sampling for all degenerate ground states and low-energy excited states in combinatorial optimization problems. A nonlinear measurement feedback scheme, called chaotic amplitude control (CAC), has recently been proposed to correct pulse amplitude inhomogeneity and thereby faithfully map the Ising Hamiltonian to the loss landscape of the DOPO network. However, the quantum limit of the CIM-CAC performance is not fully explored yet. This work clarifies how the quantum noise squeezing and the measurement-induced state shift in repeated indirect quantum measurements improve the system performance. From the numerical simulation on the Ising model with the Zeeman terms, obtained from combinatorial clustering problems formulated as constrained optimization problems, it is revealed that the CIM-CAC operating in a single photon per pulse regime dramatically outperforms the standard CIM-CAC with a large photon number per pulse. This is because the standard CIM-CAC is often trapped in a periodic trajectory and cannot escape from there. On the other hand, the significant improvement is brought by the noise-induced amplitude jump in the single photon CIM-CAC.
With the growing demand for efficient computing to tackle complex real-world challenges like combinatorial optimization, both academia and industry are exploring alternative computing paradigms. The Ising machine (IM) is one such approach, solving optimization problems by mapping their cost functions onto the Ising model. In this framework, finding the optimal solution equates to determining the Ising spin configuration corresponding to the ground state of the Ising Hamiltonian. Analog IMs, relying on artificial spins that can take analogue rather than binary values, have shown great potential in reaching this ground at high speeds. Optical implementations, such as the opto-electronic IM developed within our research group, are particularly promising due to their higher bandwidth, energy efficiency, and lower latency compared to electronic IMs. However, scaling remains a challenge for large problems. To overcome this, we propose a novel analog optical IM utilizing a spatial light modulator (SLM). Our design differs from other IMs relying on SLMs by employing analog spin variables instead of binary ones and leveraging gradient descent-based feedback rather than a computer-driven Metropolis–Hastings sampling process. By exploiting the inherent parallelism of light, this SLM-based IM is expected to efficiently handle optimization problems with millions of spins while still maintaining high energy efficiency. At the conference, we will also offer more insight into the performance of these analogue IMs and will delve deeper in the bit resolution required for the different optical components such as the employed SLM. Based on the dynamical evolution of the IM, we will discuss strategies to further improve the problem-solving capacity and speed of these optical IMs.
The demand for efficient solvers of complicated combinatorial optimization problems, especially those classified as NP-complete or NP-hard, has recently led to increased exploration of novel computing architectures. One prominent collective state computing paradigm embodied in the so-called Ising machines has recently attracted considerable research attention due to its ability to optimize complex problems with large numbers of interacting variables. Ising model-inspired solvers, thus named due to mathematical similarities to the well-known model from solid-state physics, represent a promising alternative to traditional von Neumann computer architectures due to their high degree of inherent parallelism. While there are many possible physical realizations of Ising solvers, just as there are many possible implementations of any binary computer, photonic Ising machines (PIMs) use primarily optical components for computation, taking advantage of features like lower power consumption, fast calculation speeds, the leveraging of physical optics to perform the calculations themselves, possessing decent scalability and noise tolerance. Photonic computing in the form of PIMs may offer certain computational advantages that are not easily achieved with non-photonic approaches and is nonetheless an altogether fascinating application of photonics to computing. In this review, we provide an overview of Ising machines generally, introducing why they are useful, what types of problems they can tackle, and how different Ising solvers can be compared and benchmarked. We delineate their various operational mechanisms, advantages, and limitations vis-à-vis non-photonic Ising machines. We describe their scalability, interconnectivity, performance, and physical dimensions. As research in PIMs continues to progress, there is a potential that photonic computing could well emerge as a way to handle large and challenging optimization problems across diverse domains. This review serves as a comprehensive resource for researchers and practitioners interested in understanding capabilities and potential of PIMs in addressing such complex optimization problems.
Coherent Ising machines (CIMs) constitute a promising approach to solve computationally hard optimization problems by mapping them to ground state searches of the Ising model and implementing them with optical artificial spin-networks. However, while CIMs promise speed-ups over conventional digital computers, they are still challenging to build and operate. Here, we propose and test a concept for a fully programmable CIM, which is based on opto-electronic oscillators subjected to self-feedback. Contrary to current CIM designs, the artificial spins are generated in a feedback induced bifurcation and encoded in the intensity of coherent states. This removes the necessity for nonlinear optical processes or large external cavities and offers significant advantages regarding stability, size and cost. We demonstrate a compact setup for solving MAXCUT optimization problems on regular and frustrated graphs with 100 spins and can report similar or better performance compared to CIMs based on degenerate optical parametric oscillators.
Ising machines are purported to be better at solving large-scale combinatorial optimisation problems better than conventional von Neumann computers. However, these Ising machines are widely believed to be heuristics, whose promise is observed empirically rather than obtained theoretically. We bridge this gap by considering an opto-electronic oscillator based coherent Ising machine, and providing the first analytical proof that under reasonable assumptions, the OEO-CIM is not a heuristic approach. We find and prove bounds on its performance in terms of the expected difference between the objective value at the final iteration and the optimal one, and on the number of iterations required by it. In the process, we emphasise on some of its limitations such as the inability to handle asymmetric coupling between spins, and the absence of external magnetic field applied on them (both of which are necessary in many optimisation problems), along with some issues in its convergence. We overcome these limitations by proposing suitable adjustments and prove that the improved architecture is guaranteed to converge to the optimum of the relaxed objective function.
Coherent Ising Machines (CIMs) are an emerging class of computational architectures that embed hard combinatorial optimization problems in the continuous dynamics of a physical system with analog degrees of freedom. While crisp theoretical results on the ultimate performance and scaling of such architectures are lacking, large-scale experimental prototypes have begun to exhibit promising results in practice. Our team at Stanford has begun to study the fundamental properties of CIM dynamics using a combination of techniques from statistical physics, random matrices, and dynamical systems theory. Many connections to recent work in neuroscience and deep learning are noted. Our work focuses specifically on CIMs that utilize the nonlinear threshold behavior of optical parametric oscillators to effect a soft (potentially glassy) transition between linear and binary dynamical regimes.