The Brain & Neural Networks

Quantum-inspired Black-box Optimization: Application to Machine Learning

Yuki Minamoto, Takahisa Todoroki

Published Jun 5, 2025• 0 citations

Abstract

近年，イジングマシンを活用した組合せ最適化の社会実装が進み始めており，特に2次2値最適化問題の高速解法として注目されている．その特性を活かし，実務レベルでの応用が広がる一方，目的関数がブラックボックスである問題にも対応可能な新たな最適化手法が提案されている．本記事では，その手法の特徴や実装例を詳しく解説し，機械学習における特徴量選択への応用を通じて，高次元の最適化問題にも有効であることを示す．さらに，材料科学や機械学習を超え，従来手法では困難だった高次元ブラックボックス最適化問題への適用可能性についても議論する．

DOI: 10.3902/jnns.32.90

Related papers

Black-box Optimization by Annealing Machines

Shu Tanaka, Masashi Yamashita, Yuya Seki

最適化計算の新技術としてアニーリングマシンが注目を集めている．本解説では，アニーリングマシンやブラックボックス最適化の一般論について見てから，アニーリングマシンを用いたブラックボックス最適化の解法ならびに適用事例について紹介する．

The Brain & Neural NetworksDec 5, 20222 citations

Quantum-Inspired Algorithms for Accelerating Machine Learning

Kei Majima, Naoko Koide‐Majima

量子コンピュータを使い，機械学習を高速化することは可能だろうか？量子コンピュータへの期待・関心が高まっている昨今，意外に感じる読者も多いかもしれないが，この問いに対する答えはまだでていない．そして，この問いに対する研究が進むにつれ，（ある意味副産物として）既存の古典コンピュータ用の機械学習アルゴリズムが改善され，量子コンピュータを使わずに高速化されるに至っている．本稿ではそのような経緯で2018年にEwin Tang氏によって発見された一連のアルゴリズム「量子インスパイアドアルゴリズム」について解説を試みる．

The Brain & Neural NetworksDec 5, 20222 citations

Black-box optimization using factorization and Ising machines

Ryo Tamura, Yuya Seki, Yuki Minamoto +4 more

Black-box optimization (BBO) is used in materials design, drug discovery, and hyperparameter tuning in machine learning. The world is experiencing several of these problems. In this review, a factorization machine with quantum annealing or with quadratic-optimization annealing (FMQA) algorithm to realize fast computations of BBO using Ising machines (IMs) is discussed. The FMQA algorithm uses a factorization machine (FM) as a surrogate model for BBO. The FM model can be directly transformed into a quadratic unconstrained binary optimization model that can be solved using IMs. This makes it possible to optimize the acquisition function in BBO, which is a difficult task using conventional methods without IMs. Consequently, it has the advantage of handling large BBO problems. To be able to perform BBO with the FMQA algorithm immediately, we introduce the FMQA algorithm along with Python packages to run it. In addition, we review examples of applications of the FMQA algorithm in various fields, including physics, chemistry, materials science, and social sciences. These successful examples include binary and integer optimization problems, as well as more general optimization problems involving graphs, networks, and strings, using a binary variational autoencoder. We believe that BBO using the FMQA algorithm will become a key technology in IMs, including quantum annealers.

arXiv:2507.18003Applied Physics ReviewsApr 14, 20265 citations

Ising Machines—Quantum-Inspired Machines for Combinatorial Optimization—

Hayato Goto

本稿では，近年国内外で活発に研究開発されているイジングマシンについて述べる．イジングマシンとは，イジング問題と呼ばれる組合せ最適化問題に特化した専用計算機である．世界初の商用量子コンピュータである量子アニーラがイジングマシンの一種であり，それをGoogleとNASAが創設した量子人工知能研究所が購入したことをきっかけに，イジングマシンが注目を集めるようになった．現在では，超伝導や光といった特殊なハードウェアだけでなく，従来の半導体デジタル計算機を利用して実用性を高めたものも多く，ドメイン指向コンピューティングの新たな潮流となっている．後者は主にアルゴリズムに特徴があり，中には量子計算にインスパイアされて発見されたものもある．そもそも量子アニーラに端を発した研究という経緯もあり，メディアはこれらを「疑似量子コンピュータ」と呼ぶことがある．イジングマシンと似たものとして，ホップフィールドニューラルネットワークをご存じの読者は多いだろう．実際，ホップフィールドニューラルネットワークの派生物であるボルツマンマシンなどは，現在のイジングマシンとの関係が深い．そこで，本稿の前半では，特殊ハードウェアから疑似量子コンピュータまで，現在開発中の多種多様なイジングマシンをホップフィールドニューラルネットワークやその派生物との類似に触れながら紹介する．後半は，筆者が提案し，現在も研究開発中である疑似量子コンピュータ，シミュレーテッド分岐マシンについて解説する．

The Brain & Neural NetworksDec 5, 20220 citations

Black-box optimization for integer-variable problems using Ising machines and factorization machines

Yuya Seki, Ryo Tamura, Shu Tanaka

Black-box optimization has potential in numerous applications such as hyperparameter optimization in machine learning and optimization in design of experiments. Ising machines are useful for binary optimization problems because variables can be represented by a single binary variable of Ising machines. However, conventional approaches using an Ising machine cannot handle black-box optimization problems with non-binary values. To overcome this limitation, we propose an approach for integer-variable black-box optimization problems by using Ising/annealing machines and factorization machines in cooperation with three different integer-encoding methods. The performance of our approach is numerically evaluated with different encoding methods using a simple problem of calculating the energy of the hydrogen molecule in the most stable state. The proposed approach can calculate the energy using any of the integer-encoding methods. However, one-hot encoding is useful for problems with a small size.

arXiv:2209.01016Sep 1, 20226 citations

Application of QUBO solver using black-box optimization to structural design for resonance avoidance

Tadayoshi MATSUMORI, Masato Taki, Tadashi Kadowaki

Quadratic unconstrained binary optimization (QUBO) solvers can be applied to design an optimal structure to avoid resonance. QUBO algorithms that work on a classical or quantum device have succeeded in some industrial applications. However, their applications are still limited due to the difficulty of transforming from the original optimization problem to QUBO. Recently, black-box optimization (BBO) methods have been proposed to tackle this issue using a machine learning technique and a Bayesian treatment for combinatorial optimization. We propose a BBO method based on factorization machine to design a printed circuit board for resonance avoidance. This design problem is formulated to maximize natural frequency and simultaneously minimize the number of mounting points. The natural frequency, which is the bottleneck for the QUBO formulation, is approximated to a quadratic model in the BBO method. For the efficient approximation around the optimum solution, in the proposed method, we probabilistically generate the neighbors of the optimized solution of the current model and update the model. We demonstrated that the proposed method can find the optimum mounting point positions in shorter calculation time and higher success probability of finding the optimal solution than a conventional BBO method. Our results can open up QUBO solvers' potential for other applications in structural designs.

arXiv:2204.04906Scientific ReportsJul 15, 202240 citations