Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

The Journal of Physical Chemistry Letters

Handling Ensemble N-Representability Constraint in Explicit-by-Implicit Manner

Yifan Yao, Wei‐Hai Fang, Neil Qiang Su

Published Jul 16, 2021• 22 citations
Publisher

Abstract

The convergence issues caused by the improper treatment of the ensemble N -representability constraint have severely affected the applicability and reproducibility of reduced density matrix functional theory (RDMFT). Unlike the commonly used Lagrange methods explicitly bringing the constraint into the objective functions, we present a different idea to handle the constraint in an implicit manner, which is achieved by introducing implicit functions to exactly consider the nonlinear unclear connection embedded in the explicit constraint. This explicit-by-implicit idea, denoted as EBI, thus transforms the constrained optimization problem into an unconstrained minimization problem. The tests on different systems, initial guesses, and functionals demonstrate the superiority of EBI in the treatment of the ensemble N -representability constraint. Therefore, EBI solves the convergence issues of the Lagrange methods, which is essential for further development and application of RDMFT. Besides, the idea of EBI is helpful for the treatment of different constrained problems in modern physics and chemistry.

DOI
10.1021/acs.jpclett.1c01835

Related papers

Communication: Relating the pure and ensemble density matrix functional

Christian Schilling

A crucial theorem in Reduced Density Matrix Functional Theory (RDMFT) suggests that the universal pure and ensemble functionals coincide on their common domain of pure N-representable one-matrices. We refute this by a comprehensive analysis of the geometric picture underlying Levy’s constrained search. Moreover, we then show that the ensemble functional follows instead as the lower convex envelop of the pure functional. It is particularly remarkable that the pure functional determines the ensemble functional even outside its own domain of pure N-representable one-matrices. From a general perspective, this demonstrates that relaxing pure RDMFT to ensemble RDMFT does not necessarily circumvent the complexity of the one-body pure N-representability conditions (generalized Pauli constraints). Instead, the complexity may simply be transferred from the underlying space of pure N-representable one-matrices to the structure of the universal one-matrix functional.

arXiv:1812.09291•The Journal of Chemical Physics•Dec 21, 2018•62 citations

Computational Aspects of the One Body Reduced Density Matrix Functional Theory

Nicolas G. Cartier

From drug design to material science, computational chemistry has become a valuable tool for many fields of applications in the past decades. Quantum chemistry in particular, can provide accurate descriptions of molecules and solids by relying on principles of quantum mechanics with the Schrödinger equation at its core. Unfortunately this equation becomes prohibitively expensive to solve for systems made of more than a few electrons and one has to rely on other approaches. Among the most popular is Density Functional Theory, relatively inexpensive and exact in principle. One has, however, to introduce approximations in practice, deteriorating its accuracy for challenging, so-called strongly correlated, systems. On the contrary, other methods like CASSCF remain reliable for these systems, but although cheaper than the solution of the Schrödinger equation, remain too expensive for extended systems. There is therefore room for methods in between, that could handle large correlated systems with reasonable accuracy. One such method is the One Body Reduced Density Matrix (1-RDM) Functional Theory (RDMFT), based on the fact that an electronic system can, in principle exactly, be described by its 1-RDM only. Although its theory dates back to the 1970s, computational hindrances have prevented this method from shining so far. Indeed, computations in RDMFT rely on a constrained optimization of the eigenvalues and eigenvectors of the 1-RDM, that can be reformulated as an unconstrained optimization by parameterizing the latter but in both cases suffers from convergence problems. In this thesis, the role of this parametrization is analyzed and motivates a now second order optimization algorithm, which improves the convergence speed by two orders of magnitude w.r.t. the state of the art algorithm. This understanding of the problem also inspires an alternative approach with the 1-RDM as the optimization variable. This however requires the development of new approximations and a first investigation in that direction, based on Machine Learning is performed. Lastly, a generalization of the method to excited states is attempted, highlighting some key computational challenges.

•Feb 22, 2026•0 citations

Iterative minimization in reduced density matrix functional theory for periodic systems

Kai Luo, Jingang Han, Peize Lin +3 more

Reduced density matrix functional theory (RDMFT) offers a route beyond Kohn-Sham density functional theory for strongly correlated systems, yet practical calculations for periodic solids are still out of reach. We formulate RDMFT for extended systems in a basis-independent way and present a planewave implementation using iterative minimization for periodic solids, evaluating nonlocal exchange-correlation functionals through the existing adaptive compressed exchange machinery. Natural occupations are optimized under N-representability constraints with a spectral projected gradient (SPG) method or an first-order explicit-by-implicit (EBI) map, while natural orbitals are updated by Riemannian optimization on the complex Stiefel manifolds. Benchmarks on typical systems of \ce{H2}, silicon, and sodium with the Hartree-Fock functional show that SPG reproduces converged hybrid references, whereas EBI can stall when occupations approach $0$ or $1$. With the power and Müller functionals, SPG yields lower energies and more stable convergence than EBI. Applications to fractionally charged \ce{LiH}, dissociating \ce{H2} and \ce{N2} molecules, and equation of state of silicon show that the algorithm presented in this implementation is reliable and robust.

arXiv:2607.27679•Jul 30, 2026•0 citations

Ensemble Reduced Density Matrix Functional Theory for Excited States and Hierarchical Generalization of Pauli’s Exclusion Principle

Christian Schilling, Stefano Pittalis

We propose and work out a reduced density matrix functional theory (RDMFT) for calculating energies of eigenstates of interacting many-electron systems beyond the ground state. Various obstacles which historically have doomed such an approach to be unfeasible are overcome. First, we resort to a generalization of the Ritz variational principle to ensemble states with fixed weights. This in combination with the constrained search formalism allows us to establish a universal functional of the one-particle reduced density matrix. Second, we employ tools from convex analysis to circumvent the too involved N-representability constraints. Remarkably, this identifies Valone's pioneering work on RDMFT as a special case of convex relaxation and reveals that crucial information about the excitation structure is contained in the functional's domain. Third, to determine the crucial latter object, a methodology is developed which eventually leads to a generalized exclusion principle. The corresponding linear constraints are calculated for systems of arbitrary size.

arXiv:2106.02560•Physical Review Letters•Jul 7, 2021•48 citations

Unbiased evaluation and development of Green's-function-based density-matrix functionals

Ebad Kamil

Ab-initio calculations are dominated by density functional theory (DFT), which provides an efficient and accurate description of the electronic structure for most materials. For materials with strong correlations, however, many of the available density functionals yield poor results. Most well known is the case of transition metal oxides, for which most density functionals produce a qualitatively incorrect description. There is a quest to improve the description by borrowing from methods specifically designed for strongly correlated materials. One of the method which is widely used to study strongly correlated electron system in the thermodynamic limit is the dynamical mean-field theory (DMFT). For calculations pertaining to real materials, hybrid approaches like DFT+DMFT are commonly used. We consider reduced density-matrix functional theory (rDMFT) to be a useful framework for a rigorous formulation of such hybrid theories. The link from rDMFT to many-particle wave functions has been established by Levy's constrained-search algorithm on the one hand. The link to many-body perturbation theory and Green's function, on the other hand, has been provided via the Luttinger-Ward functional. The development in the field of rDMFT proceeded analogously to the development of DFT. In order to avoid the full complexity of an explicit many-body description, most density-matrix functionals are not extracted from the exact expressions i.e. via Levy's constrained-search or Green's function based methods . Rather, one proceeds analogously to the development of density functionals, namely by searching models for the density-matrix functional, that capture the most essential physical effects while having an algebraic dependence on the density matrix. Among such models, the most prominent ones are the Müller functional, Sharma functional and Marques-Lathiotakis functional. One of the major arguments in favor of density-matrix functionals is that one of the most simple functionals, the Müller functional, seems to provide a correct description of the bond-dissociation problem, for which common density functionals fail. Despite the successes, the common density-matrix functionals also reproduce a number of features in a qualitatively incorrect manner. Several such discrepancies of the standard state of the art density-matrix functionals are discussed in details in this thesis. The objective of this thesis is to study the performance of the class of commonly used model density-matrix functionals and to set the stage for the desire to develop the framework for an approximate scheme to evaluate new class of functionals from exact Green's function based method.

•Jan 1, 2016•0 citations

Geometry of Generalized Density Functional Theories

Chih-Chun Wang

Density functional theory (DFT) is an indispensable ab initio method in both quantum chemistry and condensed matter physics. Based on recent advancements in reduced density matrix functional theory (RDMFT), a variant of DFT that is believed to be better suited for strongly correlated systems, we construct a mathematical framework generalizing all ground state functional theories, which in particular applies to fermionic, bosonic, and spin systems. Within the special class of such functional theories where the space of external potentials forms the Lie algebra of a compact Lie group, the $N$-representability problem is readily solved by applying techniques from the study of momentum maps in symplectic geometry, an approach complementary to Klyachko's famous solution to the quantum marginal problem. The ``boundary force'', a diverging repulsive force from the boundary of the functional's domain observed in previous works but only qualitatively understood in isolated systems, is studied quantitatively and extensively in our work. Specifically, we present a formula capturing the exact behavior of the functional close to the boundary. In the case where the Lie algebra is abelian, a completely rigorous proof of the boundary force formula based on Levy-Lieb constrained search is given. Our formula is a first step towards developing more accurate functional approximations, with the potential of improving current RDMFT approximate functionals such as the Piris natural orbital functionals (NOFs). All key concepts and ideas of our work are demonstrated in translation invariant bosonic lattice systems.

quant-pharXiv:2511.14822•Nov 19, 2025•0 citations
The convergence issues caused by the improper treatment of the ensemble N -representability constraint have severely affected the applicability and reproducibility of reduced density matrix functional theory (RDMFT). Unlike the commonly used Lagrange methods explicitly bringing the constraint into the objective functions, we present a different idea to handle the constraint in an implicit manner, which is achieved by introducing implicit functions to exactly consider the nonlinear unclear connection embedded in the explicit constraint. This explicit-by-implicit idea, denoted as EBI, thus transforms the constrained optimization problem into an unconstrained minimization problem. The tests on different systems, initial guesses, and functionals demonstrate the superiority of EBI in the treatment of the ensemble N -representability constraint. Therefore, EBI solves the convergence issues of the Lagrange methods, which is essential for further development and application of RDMFT. Besides, the idea of EBI is helpful for the treatment of different constrained problems in modern physics and chemistry.
A crucial theorem in Reduced Density Matrix Functional Theory (RDMFT) suggests that the universal pure and ensemble functionals coincide on their common domain of pure N-representable one-matrices. We refute this by a comprehensive analysis of the geometric picture underlying Levy’s constrained search. Moreover, we then show that the ensemble functional follows instead as the lower convex envelop of the pure functional. It is particularly remarkable that the pure functional determines the ensemble functional even outside its own domain of pure N-representable one-matrices. From a general perspective, this demonstrates that relaxing pure RDMFT to ensemble RDMFT does not necessarily circumvent the complexity of the one-body pure N-representability conditions (generalized Pauli constraints). Instead, the complexity may simply be transferred from the underlying space of pure N-representable one-matrices to the structure of the universal one-matrix functional.
From drug design to material science, computational chemistry has become a valuable tool for many fields of applications in the past decades. Quantum chemistry in particular, can provide accurate descriptions of molecules and solids by relying on principles of quantum mechanics with the Schrödinger equation at its core. Unfortunately this equation becomes prohibitively expensive to solve for systems made of more than a few electrons and one has to rely on other approaches. Among the most popular is Density Functional Theory, relatively inexpensive and exact in principle. One has, however, to introduce approximations in practice, deteriorating its accuracy for challenging, so-called strongly correlated, systems. On the contrary, other methods like CASSCF remain reliable for these systems, but although cheaper than the solution of the Schrödinger equation, remain too expensive for extended systems. There is therefore room for methods in between, that could handle large correlated systems with reasonable accuracy. One such method is the One Body Reduced Density Matrix (1-RDM) Functional Theory (RDMFT), based on the fact that an electronic system can, in principle exactly, be described by its 1-RDM only. Although its theory dates back to the 1970s, computational hindrances have prevented this method from shining so far. Indeed, computations in RDMFT rely on a constrained optimization of the eigenvalues and eigenvectors of the 1-RDM, that can be reformulated as an unconstrained optimization by parameterizing the latter but in both cases suffers from convergence problems. In this thesis, the role of this parametrization is analyzed and motivates a now second order optimization algorithm, which improves the convergence speed by two orders of magnitude w.r.t. the state of the art algorithm. This understanding of the problem also inspires an alternative approach with the 1-RDM as the optimization variable. This however requires the development of new approximations and a first investigation in that direction, based on Machine Learning is performed. Lastly, a generalization of the method to excited states is attempted, highlighting some key computational challenges.
Reduced density matrix functional theory (RDMFT) offers a route beyond Kohn-Sham density functional theory for strongly correlated systems, yet practical calculations for periodic solids are still out of reach. We formulate RDMFT for extended systems in a basis-independent way and present a planewave implementation using iterative minimization for periodic solids, evaluating nonlocal exchange-correlation functionals through the existing adaptive compressed exchange machinery. Natural occupations are optimized under N-representability constraints with a spectral projected gradient (SPG) method or an first-order explicit-by-implicit (EBI) map, while natural orbitals are updated by Riemannian optimization on the complex Stiefel manifolds. Benchmarks on typical systems of \ce{H2}, silicon, and sodium with the Hartree-Fock functional show that SPG reproduces converged hybrid references, whereas EBI can stall when occupations approach 000 or 111. With the power and Müller functionals, SPG yields lower energies and more stable convergence than EBI. Applications to fractionally charged \ce{LiH}, dissociating \ce{H2} and \ce{N2} molecules, and equation of state of silicon show that the algorithm presented in this implementation is reliable and robust.
We propose and work out a reduced density matrix functional theory (RDMFT) for calculating energies of eigenstates of interacting many-electron systems beyond the ground state. Various obstacles which historically have doomed such an approach to be unfeasible are overcome. First, we resort to a generalization of the Ritz variational principle to ensemble states with fixed weights. This in combination with the constrained search formalism allows us to establish a universal functional of the one-particle reduced density matrix. Second, we employ tools from convex analysis to circumvent the too involved N-representability constraints. Remarkably, this identifies Valone's pioneering work on RDMFT as a special case of convex relaxation and reveals that crucial information about the excitation structure is contained in the functional's domain. Third, to determine the crucial latter object, a methodology is developed which eventually leads to a generalized exclusion principle. The corresponding linear constraints are calculated for systems of arbitrary size.
Ab-initio calculations are dominated by density functional theory (DFT), which provides an efficient and accurate description of the electronic structure for most materials. For materials with strong correlations, however, many of the available density functionals yield poor results. Most well known is the case of transition metal oxides, for which most density functionals produce a qualitatively incorrect description. There is a quest to improve the description by borrowing from methods specifically designed for strongly correlated materials. One of the method which is widely used to study strongly correlated electron system in the thermodynamic limit is the dynamical mean-field theory (DMFT). For calculations pertaining to real materials, hybrid approaches like DFT+DMFT are commonly used. We consider reduced density-matrix functional theory (rDMFT) to be a useful framework for a rigorous formulation of such hybrid theories. The link from rDMFT to many-particle wave functions has been established by Levy's constrained-search algorithm on the one hand. The link to many-body perturbation theory and Green's function, on the other hand, has been provided via the Luttinger-Ward functional. The development in the field of rDMFT proceeded analogously to the development of DFT. In order to avoid the full complexity of an explicit many-body description, most density-matrix functionals are not extracted from the exact expressions i.e. via Levy's constrained-search or Green's function based methods . Rather, one proceeds analogously to the development of density functionals, namely by searching models for the density-matrix functional, that capture the most essential physical effects while having an algebraic dependence on the density matrix. Among such models, the most prominent ones are the Müller functional, Sharma functional and Marques-Lathiotakis functional. One of the major arguments in favor of density-matrix functionals is that one of the most simple functionals, the Müller functional, seems to provide a correct description of the bond-dissociation problem, for which common density functionals fail. Despite the successes, the common density-matrix functionals also reproduce a number of features in a qualitatively incorrect manner. Several such discrepancies of the standard state of the art density-matrix functionals are discussed in details in this thesis. The objective of this thesis is to study the performance of the class of commonly used model density-matrix functionals and to set the stage for the desire to develop the framework for an approximate scheme to evaluate new class of functionals from exact Green's function based method.
Density functional theory (DFT) is an indispensable ab initio method in both quantum chemistry and condensed matter physics. Based on recent advancements in reduced density matrix functional theory (RDMFT), a variant of DFT that is believed to be better suited for strongly correlated systems, we construct a mathematical framework generalizing all ground state functional theories, which in particular applies to fermionic, bosonic, and spin systems. Within the special class of such functional theories where the space of external potentials forms the Lie algebra of a compact Lie group, the NNN-representability problem is readily solved by applying techniques from the study of momentum maps in symplectic geometry, an approach complementary to Klyachko's famous solution to the quantum marginal problem. The ``boundary force'', a diverging repulsive force from the boundary of the functional's domain observed in previous works but only qualitatively understood in isolated systems, is studied quantitatively and extensively in our work. Specifically, we present a formula capturing the exact behavior of the functional close to the boundary. In the case where the Lie algebra is abelian, a completely rigorous proof of the boundary force formula based on Levy-Lieb constrained search is given. Our formula is a first step towards developing more accurate functional approximations, with the potential of improving current RDMFT approximate functionals such as the Piris natural orbital functionals (NOFs). All key concepts and ideas of our work are demonstrated in translation invariant bosonic lattice systems.