Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2605.10348 · Journal of Chemical Theory and Computation

Learning to Rank for Selected Configuration Interaction

Wan Nie, Songwei Liu, Yingying Yu, Zhiwen Wang, And Jun Yang

Published Aug 20, 2026• 0 citations
arXivHTMLPDF

Abstract

Accurate description of electron correlation is a central challenge in computational chemistry, with selected configuration interaction (SCI) emerging as a powerful tool to approach the full CI limit. While recent machine learning (ML) integrations have accelerated determinant selection, existing regression and classification approaches suffer from a fundamental objective-loss mismatch: they evaluate the importance of determinants in isolation without explicitly accounting for their relative importance ranking. Here, we introduce ranking configuration interaction (RCI), a novel ML-supported SCI framework that reframes determinant selection as a pairwise ranking problem. Building upon a Transformer-based architecture to capture complex, nonlocal orbital dependencies, RCI progressively optimizes the partial ordering of determinants. By doing so, RCI aligns the training objective more closely with the intrinsic ranking nature of SCI. Extensive benchmarks across both plane-wave and Gaussian basis sets, including the molecules N2, CO, H2O, NH3, and C2, demonstrate the efficiency of RCI. Compared to previously reported classification baselines, RCI consistently accelerates convergence─reducing overall computational time by 23% to over 50% depending on the system and requiring only 55% of the determinant count in representative cases such as N2 and CO. Furthermore, RCI exhibits robust performance and reaches chemical accuracy on the highly challenging iron-sulfur cluster using only 12% of the full CI space. Notably, RCI outperforms recent regression-based SCI methods by delivering a more than 15% improvement in accuracy at comparable determinant counts. RCI also demonstrates higher efficiency than heat-bath CI on the strongly correlated chromium dimer, yielding a compact and accurate wave function. This pairwise learning-to-rank model provides a lightweight and modular plugin that can be seamlessly incorporated into other supervised learning frameworks.

DOI
10.1021/acs.jctc.6c00937

Related papers

Accelerating Many-Body Quantum Chemistry via Generative Transformer-Enhanced Configuration Interaction

Bowen Kan, Honghui Shang

Quantum many-body calculations are fundamentally limited by the exponential growth of the configuration space, making accurate treatment of strongly correlated systems computationally prohibitive. Here we present the Generative Transformer Neural Network Selected Configuration Interaction (GTNN-SCI), a Transformer-based machine learning approach that generatively samples important configurations to accelerate many-body quantum chemistry calculations. By leveraging the Transformer architecture’s self-attention mechanism to capture long-range electron correlations, GTNN-SCI achieves up to 10× speedup compared to state-of-the-art neural network methods while maintaining high accuracy. We demonstrate the efficacy of GTNN-SCI by calculating correlation and binding energies for representative molecules including N 2, H 2 O, and C 2 using both Gaussian (cc-pVDZ) and plane-wave basis sets, achieving faster convergence and lower energies than previously reported neural network-based selected CI techniques. Most significantly, our generative approach identifies higher-order excitations missed by conventional coupling schemes, yielding lower variational energies than established methods including heat-bath CI. This capability enables GTNN-SCI to accurately treat the strongly correlated [Fe 2 S 2 (SCH 3 ) 4 ] 2– ([2Fe–2S]) cluster system, achieving ground-state energies within chemical accuracy of DMRG benchmarks, whereas conventional selected CI methods have failed on this system. The GTNN-SCI method thus combines modern deep learning with high-performance electronic structure computation, providing an efficient and precise avenue for solving the electronic Schrödinger equation in challenging molecular systems.

Journal of Chemical Theory and Computation•Nov 24, 2025•2 citations

Hamiltonian-Guided Autoregressive Selected-Configuration Interaction Achieves Chemical Accuracy in Strongly Correlated Systems

Hao Zhang, Xiongzhi Zeng, Zhenyu Li +1 more

High Resolution Image Download MS PowerPoint Slide Strongly correlated molecules remain out of reach for most electronic-structure solvers because the exact wave function spans a determinant space that grows exponentially with the number of orbitals. State-of-the-art selected-CI (e.g., CIPSI and HCI) and ML-CI methods mitigate search by exploiting Hamiltonian sparsity and learned prescreening. Nonetheless, in strongly multireference regimes, the excitation-based candidate lists can grow rapidly, which may increase memory and screening costs. We present the Hamiltonian-guided autoregressive selected-configuration interaction (HAAR-SCI), a learn–sample–compress workflow that runs on a single GPU. A gated Transformer samples determinants autoregressively; Gumbel Top-K noise encourages exploration, and GPU min-heap kernels keep only configurations with the largest Hamiltonian couplings. The network is retrained after each expansion, and iterations stop when successive energies differ by ≤1 mHa. Across an 18-molecule benchmark set reaching 116 spin–orbitals, HAAR-SCI attains a mean absolute error of 0.51 mHa while using much fewer determinants than heat-bath CI. It traces the entire N 2 dissociation curve within 0.67 mHa and achieves HCI accuracy for the 40-spin-orbital [Fe 2 S 2 (SCH 3 ) 4 ] 2– cluster with a determinant reduction of 72%, demonstrating its power on systems considered intractable for conventional selected-CI solvers. A final probability-mass pruning compresses typical wave functions by a further 10–50×, retaining <0.01% of the Hilbert space yet still capturing >99.9% of the correlation energy. HAAR-SCI thus offers a compact and truly scalable route to chemical-accuracy quantum chemistry on commodity hardware.

Journal of Chemical Theory and Computation•Dec 8, 2025•1 citation

Machine Learning Assisted Selective Configuration Interaction for Accurate Ground and Excited State Calculations

Bastien Casier, Maissa El Hamdi, Basile Herzog

In this work, we introduce a perturbative Selective Configuration Interaction (SCI) approach guided by a binary machine-learning classifier. The method leverages a lightweight feedforward neural network (FNN), purposefully designed for fast and efficient training. Within this framework, we show that our model attains the accuracy of the state-of-the-art SCI method CIPSI (Configuration Interaction using a Perturbative Selection done Iteratively). Across all tested configuration-space sizes, our approach reliably identifies the most important Slater determinants using a binary cross-entropy metric, achieving FCI/CASCI-level accuracy within 10 –4 Hartree for both ground and excited states. Finally, the method remains robust for strained geometries and conformational changes, successfully classifying Slater determinants across multiple points of potential energy curves and surfaces. This capability opens the door to new regression-based strategies for molecular electronic structure and the construction of machine-learning-driven potential energy surfaces.

Journal of Chemical Theory and Computation•Jan 31, 2026•2 citations

Selected Coupled Cluster Guided by Selected Configuration Interaction

Minsik Cho, Troy Van Voorhis

Coupled Cluster (CC) theory is one of the most popular correlated wavefunction methods, yet the steep computational cost scaling of CC truncated at higher rank limits its application. Modern Selected Configuration Interaction (SCI) methods successfully exploit the sparsity of ground-state wavefunctions in the determinant space, motivating an analogous approach with the exponential CC ansatz. In this work, we introduce Selected Coupled Cluster (SCC), an arbitrary-order sparse CC method that explicitly solves the CC residual equations within a compact amplitude space guided by an SCI wavefunction. SCC optimizes the CC amplitudes in the sparse amplitude space. Using a pilot Just-in-Time (JIT) compiled implementation, we benchmark SCC against SCI, SCI+PT2, standard rank-truncated dense CC (CCSD, CCSDT), and DMRG across various chemical systems. We demonstrate that SCC exhibits fast, monotonic convergence with the SCI variational threshold, outperforming SCI and surpassing SCI+PT2 in the tight-threshold regime. SCC also provides accurate energies for high-dimensional topologies, where DMRG typically converges slowly with bond dimension. SCC thus presents an efficient drop-in enhancement for modern SCI workflows.

physics.chem-phCross-listedarXiv:2609.10829•Sep 11, 2026•0 citations

Selected Configuration Interaction in a Basis of Cluster State Tensor Products

Vibin Abraham, Nicholas J. Mayhall

Selected configuration interaction (SCI) methods are currently enjoying a resurgence due to several recent developments which improve either the overall computational efficiency or the compactness of the resulting SCI vector. These recent advances have made it possible to get full CI (FCI) quality results for much larger orbital active spaces compared to conventional approaches. However, due to the starting assumption that the FCI vector has only a small number of significant Slater determinants, SCI becomes intractable for systems with strong correlation. This paper introduces a method for developing SCI algorithms in a way which exploits local molecular structure to significantly reduce the number of SCI variables. The proposed method is defined by first grouping the orbitals into clusters over which we can define many-particle cluster states. We then directly perform the SCI algorithm in a basis of tensor products of cluster states instead of Slater determinants. While the approach is general for arbitrarily defined cluster states, we find significantly improved performance by defining cluster states through a Tucker decomposition of the global (and sparse) SCI vector. To demonstrate the potential of this method, called tensor product selected configuration interaction (TPSCI), we present numerical results for a diverse set of examples: (1) modified Hubbard model with different inter- and intracluster hopping terms, (2) less obviously clusterable cases of bond breaking in N 2 and F 2, and (3) ground state energies of large planar π-conjugated systems with active spaces of up to 42 electrons in 42 orbitals. These numerical results show that TPSCI can be used to significantly reduce the number of SCI variables in the variational space, thus paving a path for extending these deterministic and variational SCI approaches to a wider range of physical systems.

arXiv:2002.03107•Journal of Chemical Theory and Computation•Aug 26, 2020•65 citations

Enhancing quantum-classical configuration interaction methods using a neural-network classifier

Severino Zeni, Giovanni Varutti, Jacopo Nespolo +1 more

Selected configuration interaction methods achieve near-exact electronic structure calculations by iteratively constructing compact variational spaces, but their efficiency depends critically on the heuristics used to identify important determinants. Here, we introduce a data-driven selection framework that recasts determinant importance as a binary classification task and integrates a neural-network classifier into the iterative CI workflow through an active-learning loop. At each iteration, a random subset of candidate determinants is labelled via temporary diagonalisation, and the trained classifier guides selection of the remaining configurations. We demonstrate the utility of this framework for both classical and quantum CI methods by calculating the ground-state energy of a diatomic molecule. Our method achieves result parity with traditional configuration interaction methods at substantially lower computational cost: roughly a $\times 5$ reduction in memory and per-iteration cost for the classical cHCI variant, and convergence in markedly fewer iterations for the quantum-classical cSQD variant. These results establish classifier-assisted determinant selection as a lightweight, method-agnostic tool for compressing variational spaces and accelerating both classical and hybrid quantum-classical configuration interaction algorithms.

physics.chem-phCross-listedarXiv:2606.24332•Jun 24, 2026•0 citations
Accurate description of electron correlation is a central challenge in computational chemistry, with selected configuration interaction (SCI) emerging as a powerful tool to approach the full CI limit. While recent machine learning (ML) integrations have accelerated determinant selection, existing regression and classification approaches suffer from a fundamental objective-loss mismatch: they evaluate the importance of determinants in isolation without explicitly accounting for their relative importance ranking. Here, we introduce ranking configuration interaction (RCI), a novel ML-supported SCI framework that reframes determinant selection as a pairwise ranking problem. Building upon a Transformer-based architecture to capture complex, nonlocal orbital dependencies, RCI progressively optimizes the partial ordering of determinants. By doing so, RCI aligns the training objective more closely with the intrinsic ranking nature of SCI. Extensive benchmarks across both plane-wave and Gaussian basis sets, including the molecules N2, CO, H2O, NH3, and C2, demonstrate the efficiency of RCI. Compared to previously reported classification baselines, RCI consistently accelerates convergence─reducing overall computational time by 23% to over 50% depending on the system and requiring only 55% of the determinant count in representative cases such as N2 and CO. Furthermore, RCI exhibits robust performance and reaches chemical accuracy on the highly challenging iron-sulfur cluster using only 12% of the full CI space. Notably, RCI outperforms recent regression-based SCI methods by delivering a more than 15% improvement in accuracy at comparable determinant counts. RCI also demonstrates higher efficiency than heat-bath CI on the strongly correlated chromium dimer, yielding a compact and accurate wave function. This pairwise learning-to-rank model provides a lightweight and modular plugin that can be seamlessly incorporated into other supervised learning frameworks.
Quantum many-body calculations are fundamentally limited by the exponential growth of the configuration space, making accurate treatment of strongly correlated systems computationally prohibitive. Here we present the Generative Transformer Neural Network Selected Configuration Interaction (GTNN-SCI), a Transformer-based machine learning approach that generatively samples important configurations to accelerate many-body quantum chemistry calculations. By leveraging the Transformer architecture’s self-attention mechanism to capture long-range electron correlations, GTNN-SCI achieves up to 10× speedup compared to state-of-the-art neural network methods while maintaining high accuracy. We demonstrate the efficacy of GTNN-SCI by calculating correlation and binding energies for representative molecules including N 2, H 2 O, and C 2 using both Gaussian (cc-pVDZ) and plane-wave basis sets, achieving faster convergence and lower energies than previously reported neural network-based selected CI techniques. Most significantly, our generative approach identifies higher-order excitations missed by conventional coupling schemes, yielding lower variational energies than established methods including heat-bath CI. This capability enables GTNN-SCI to accurately treat the strongly correlated [Fe 2 S 2 (SCH 3 ) 4 ] 2– ([2Fe–2S]) cluster system, achieving ground-state energies within chemical accuracy of DMRG benchmarks, whereas conventional selected CI methods have failed on this system. The GTNN-SCI method thus combines modern deep learning with high-performance electronic structure computation, providing an efficient and precise avenue for solving the electronic Schrödinger equation in challenging molecular systems.
High Resolution Image Download MS PowerPoint Slide Strongly correlated molecules remain out of reach for most electronic-structure solvers because the exact wave function spans a determinant space that grows exponentially with the number of orbitals. State-of-the-art selected-CI (e.g., CIPSI and HCI) and ML-CI methods mitigate search by exploiting Hamiltonian sparsity and learned prescreening. Nonetheless, in strongly multireference regimes, the excitation-based candidate lists can grow rapidly, which may increase memory and screening costs. We present the Hamiltonian-guided autoregressive selected-configuration interaction (HAAR-SCI), a learn–sample–compress workflow that runs on a single GPU. A gated Transformer samples determinants autoregressively; Gumbel Top-K noise encourages exploration, and GPU min-heap kernels keep only configurations with the largest Hamiltonian couplings. The network is retrained after each expansion, and iterations stop when successive energies differ by ≤1 mHa. Across an 18-molecule benchmark set reaching 116 spin–orbitals, HAAR-SCI attains a mean absolute error of 0.51 mHa while using much fewer determinants than heat-bath CI. It traces the entire N 2 dissociation curve within 0.67 mHa and achieves HCI accuracy for the 40-spin-orbital [Fe 2 S 2 (SCH 3 ) 4 ] 2– cluster with a determinant reduction of 72%, demonstrating its power on systems considered intractable for conventional selected-CI solvers. A final probability-mass pruning compresses typical wave functions by a further 10–50×, retaining <0.01% of the Hilbert space yet still capturing >99.9% of the correlation energy. HAAR-SCI thus offers a compact and truly scalable route to chemical-accuracy quantum chemistry on commodity hardware.
In this work, we introduce a perturbative Selective Configuration Interaction (SCI) approach guided by a binary machine-learning classifier. The method leverages a lightweight feedforward neural network (FNN), purposefully designed for fast and efficient training. Within this framework, we show that our model attains the accuracy of the state-of-the-art SCI method CIPSI (Configuration Interaction using a Perturbative Selection done Iteratively). Across all tested configuration-space sizes, our approach reliably identifies the most important Slater determinants using a binary cross-entropy metric, achieving FCI/CASCI-level accuracy within 10 –4 Hartree for both ground and excited states. Finally, the method remains robust for strained geometries and conformational changes, successfully classifying Slater determinants across multiple points of potential energy curves and surfaces. This capability opens the door to new regression-based strategies for molecular electronic structure and the construction of machine-learning-driven potential energy surfaces.
Coupled Cluster (CC) theory is one of the most popular correlated wavefunction methods, yet the steep computational cost scaling of CC truncated at higher rank limits its application. Modern Selected Configuration Interaction (SCI) methods successfully exploit the sparsity of ground-state wavefunctions in the determinant space, motivating an analogous approach with the exponential CC ansatz. In this work, we introduce Selected Coupled Cluster (SCC), an arbitrary-order sparse CC method that explicitly solves the CC residual equations within a compact amplitude space guided by an SCI wavefunction. SCC optimizes the CC amplitudes in the sparse amplitude space. Using a pilot Just-in-Time (JIT) compiled implementation, we benchmark SCC against SCI, SCI+PT2, standard rank-truncated dense CC (CCSD, CCSDT), and DMRG across various chemical systems. We demonstrate that SCC exhibits fast, monotonic convergence with the SCI variational threshold, outperforming SCI and surpassing SCI+PT2 in the tight-threshold regime. SCC also provides accurate energies for high-dimensional topologies, where DMRG typically converges slowly with bond dimension. SCC thus presents an efficient drop-in enhancement for modern SCI workflows.
Selected configuration interaction (SCI) methods are currently enjoying a resurgence due to several recent developments which improve either the overall computational efficiency or the compactness of the resulting SCI vector. These recent advances have made it possible to get full CI (FCI) quality results for much larger orbital active spaces compared to conventional approaches. However, due to the starting assumption that the FCI vector has only a small number of significant Slater determinants, SCI becomes intractable for systems with strong correlation. This paper introduces a method for developing SCI algorithms in a way which exploits local molecular structure to significantly reduce the number of SCI variables. The proposed method is defined by first grouping the orbitals into clusters over which we can define many-particle cluster states. We then directly perform the SCI algorithm in a basis of tensor products of cluster states instead of Slater determinants. While the approach is general for arbitrarily defined cluster states, we find significantly improved performance by defining cluster states through a Tucker decomposition of the global (and sparse) SCI vector. To demonstrate the potential of this method, called tensor product selected configuration interaction (TPSCI), we present numerical results for a diverse set of examples: (1) modified Hubbard model with different inter- and intracluster hopping terms, (2) less obviously clusterable cases of bond breaking in N 2 and F 2, and (3) ground state energies of large planar π-conjugated systems with active spaces of up to 42 electrons in 42 orbitals. These numerical results show that TPSCI can be used to significantly reduce the number of SCI variables in the variational space, thus paving a path for extending these deterministic and variational SCI approaches to a wider range of physical systems.
Selected configuration interaction methods achieve near-exact electronic structure calculations by iteratively constructing compact variational spaces, but their efficiency depends critically on the heuristics used to identify important determinants. Here, we introduce a data-driven selection framework that recasts determinant importance as a binary classification task and integrates a neural-network classifier into the iterative CI workflow through an active-learning loop. At each iteration, a random subset of candidate determinants is labelled via temporary diagonalisation, and the trained classifier guides selection of the remaining configurations. We demonstrate the utility of this framework for both classical and quantum CI methods by calculating the ground-state energy of a diatomic molecule. Our method achieves result parity with traditional configuration interaction methods at substantially lower computational cost: roughly a ×5\times 5×5 reduction in memory and per-iteration cost for the classical cHCI variant, and convergence in markedly fewer iterations for the quantum-classical cSQD variant. These results establish classifier-assisted determinant selection as a lightweight, method-agnostic tool for compressing variational spaces and accelerating both classical and hybrid quantum-classical configuration interaction algorithms.