We present a formal analysis of nonlinear response functions in terms of correlation functions in real- and imaginary-time domains. In particular, we show that causal nonlinear response functions, expressed in terms of nested commutators in real time, can be obtained from the analytic continuation of time-ordered response functions, which are more easily amenable to diagrammatic calculation. This generalizes the well-known result of linear response theory. We then use gauge invariance arguments to derive exact relations between second-order response functions in density and current channels. These identities, which are non-perturbative in the strength of inter-particle interactions, allow us to establish exact connections between nonlinear optics calculations done in different electromagnetic gauges.
Motivated by the recent developments in terahertz spectroscopy using pump-probe setups, we develop the theory of finite frequency nonlinear electro-optical responses in centrosymmetric metals starting from basic time dependent perturbation theory. We express the nonlinear current kernel as a sum of several causal response functions. These functions cannot be evaluated using perturbative field theory methods. Consequently, we associate each response function with an imaginary time ordered current correlation function, which can be factorized using Wick's theorem. The mapping between the response functions and the correlation functions, suitably analytically continued to real frequencies, is proven exactly. We derive constraints satisfied by the nonlinear current kernel and we prove a generalized
f-sum rule for the nonlinear conductivity, all of which are consequences of particle number conservation. We apply the theory to compute the gauge invariant nonlinear conductivity of a system of noninteracting electrons in the presence of weak disorder. As special cases of this generalized nonlinear response, we discuss its third harmonic and its instantaneous terahertz Kerr signals. Our formalism can be used to compute the nonlinear conductivity in symmetry broken phases such as density waves and nematic states.
Nonlinear response functions, formulated as multipoint correlation functions or Volterra kernels, encode the dynamical and spectroscopic properties of physical systems and underpin a wide range of nonlinear transport and optical phenomena. However, their evaluation rapidly becomes prohibitive at high orders because of combinatorial (often factorial) scaling or severe numerical errors. Here, we establish a systematic and efficient framework to compute nonlinear response functions directly from real-time dynamics, without explicitly constructing multipoint correlators or relying on numerically unstable finite-difference methods for order-resolved extraction. Our approach is based on the Gateaux derivative with respect to the external field in function space, which yields a closed hierarchy of tangent equations of motion (TEOM). Propagating the TEOM alongside the original dynamics isolates each perturbative order with high accuracy, providing a term-by-term decomposition of physical contributions. The computational cost scales exponentially with response order in the fully general setting and reduces to polynomial complexity when all perturbation directions are identical; both regimes avoid the factorial scaling of explicit multipoint-correlator evaluations. We demonstrate the power of TEOM by computing frequency-resolved fifth-order response functions for a solid-state electron model and by obtaining nonlinear response functions up to the 49th order with controlled accuracy in a classical Duffing oscillator. We further show that our time-evolution formulation allows optical conductivities to be evaluated directly while remaining numerically stable even near zero frequency. TEOM can be incorporated seamlessly into existing real-time evolution methods, yielding a general framework for computing nonlinear response functions in quantum and classical dynamical systems.