Variational Monte Carlo Explained

In computational physics, variational Monte Carlo (VMC) is a quantum Monte Carlo method that applies the variational method to approximate the ground state of a quantum system.^[1]

|\Psi(a)\rangle

depending on some parameters

. The optimal values of the parameters

is then found upon minimizing the total energy of the system.

l{H}

, and denoting with

a many-body configuration, the expectation value of the energy can be written as:^[2]

$E(a) = \frac = \frac .$

Following the Monte Carlo method for evaluating integrals, we can interpret

	\|\Psi(X,a)\|²
	\int\|\Psi(X,a)\|²dX

as a probability distribution function, sample it, and evaluate the energy expectation value

E(a)

as the average of the so-called local energy

E_rm{loc

}(X) = \frac . Once

E(a)

is known for a given set of variational parameters

, then optimization is performed in order to minimize the energy and obtain the best possible representation of the ground-state wave-function.

VMC is no different from any other variational method, except that the many-dimensional integrals are evaluated numerically. Monte Carlo integration is particularly crucial in this problem since the dimension of the many-body Hilbert space, comprising all the possible values of the configurations

, typically grows exponentially with the size of the physical system. Other approaches to the numerical evaluation of the energy expectation values would therefore, in general, limit applications to much smaller systems than those analyzable thanks to the Monte Carlo approach.

The accuracy of the method then largely depends on the choice of the variational state. The simplest choice typically corresponds to a mean-field form, where the state

\Psi

is written as a factorization over the Hilbert space. This particularly simple form is typically not very accurate since it neglects many-body effects. One of the largest gains in accuracy over writing the wave function separably comes from the introduction of the so-called Jastrow factor. In this case the wave function is written as

\Psi(X) = \exp(\sum)

, where

r_ij

is the distance between a pair of quantum particles and

u(r)

is a variational function to be determined. With this factor, we can explicitly account for particle-particle correlation, but the many-body integral becomes unseparable, so Monte Carlo is the only way to evaluate it efficiently. In chemical systems, slightly more sophisticated versions of this factor can obtain 80 - 90% of the correlation energy (see electronic correlation) with less than 30 parameters. In comparison, a configuration interaction calculation may require around 50,000 parameters to reach that accuracy, although it depends greatly on the particular case being considered. In addition, VMC usually scales as a small power of the number of particles in the simulation, usually something like N^2-4 for calculation of the energy expectation value, depending on the form of the wave function.

Wave function optimization in VMC

QMC calculations crucially depend on the quality of the trial-function, and so it is essential to have an optimized wave-function as close as possible to the ground state.The problem of function optimization is a very important research topic in numerical simulation. In QMC, in addition to the usual difficulties to find the minimum of multidimensional parametric function, the statistical noise is present in the estimate of the cost function (usually the energy), and its derivatives, required for an efficient optimization.

Different cost functions and different strategies were used to optimize a many-body trial-function. Usually three cost functions were used in QMC optimization energy, variance or a linear combination of them. The variance optimization method has the advantage that the exact wavefunction's variance is known. (Because the exact wavefunction is an eigenfunction of the Hamiltonian, the variance of the local energy is zero). This means that variance optimization is ideal in that it is bounded from below, it is positive defined and its minimum is known. Energy minimization may ultimately prove more effective, however, as different authors recently showed that the energy optimization is more effective than the variance one.

There are different motivations for this: first, usually one is interested in the lowest energy rather than in the lowest variance in both variational and diffusion Monte Carlo; second, variance optimization takes many iterations to optimize determinant parameters and often the optimization can get stuck in multiple local minimum and it suffers of the "false convergence" problem; third energy-minimized wave functions on average yield more accurate values of other expectation values than variance minimized wave functions do.

The optimization strategies can be divided into three categories. The first strategy is based on correlated sampling together with deterministic optimization methods. Even if this idea yielded very accurate results for the first-row atoms, this procedure can have problems if parameters affect the nodes, and moreover density ratio of the current and initial trial-function increases exponentially with the size of the system. In the second strategy one use a large bin to evaluate the cost function and its derivatives in such way that the noise can be neglected and deterministic methods can be used.

The third approach, is based on an iterative technique to handle directly with noise functions. The first example of these methods is the so-called Stochastic Gradient Approximation (SGA), that was used also for structure optimization. Recently an improved and faster approach of this kind was proposed the so-called Stochastic Reconfiguration (SR) method.

VMC and deep learning

In 2017, Giuseppe Carleo and Matthias Troyer^[3] used a VMC objective function to train an artificial neural network to find the ground state of a quantum mechanical system. More generally, artificial neural networks are being used as a wave function ansatz (known as neural network quantum states) in VMC frameworks for finding ground states of quantum mechanical systems. The use of neural network ansatzes for VMC has been extended to fermions, enabling electronic structure calculations that are significantly more accurate than VMC calculations which do not use neural networks.^[4] ^[5] ^[6]

References

Book: Scherer, Philipp O.J.. Computational Physics. 2017. Springer International Publishing. 978-3-319-61087-0. Graduate Texts in Physics. Cham. 10.1007/978-3-319-61088-7.
Book: Monte Carlo Methods in Quantum Problems. 1984. Springer Netherlands. 978-94-009-6386-3. Kalos. Malvin H.. Dordrecht. 10.1007/978-94-009-6384-9.
Carleo . Giuseppe . Troyer . Matthias . Solving the Quantum Many-Body Problem with Artificial Neural Networks . Science . 2017 . 355 . 6325 . 602–606 . 10.1126/science.aag2302. 28183973 . 1606.02318 . 2017Sci...355..602C . 206651104 .
Pfau . David . Spencer . James . Matthews . Alexander G. de G. . Foulkes . W. M. C. . Ab-initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks . Physical Review Research . 2020 . 2 . 3 . 033429 . 10.1103/PhysRevResearch.2.033429. 1909.02487 . 2020PhRvR...2c3429P . 202120723 .
Hermann . Jan . Schätzle . Zeno . Noé . Frank . Deep Neural Network Solution of the Electronic Schrödinger Equation . Nature Chemistry . 2020 . 12 . 10 . 891–897 . 10.1038/s41557-020-0544-y. 32968231 . 1909.08423 . 2020NatCh..12..891H . 202660909 .
Choo . Kenny . Mezzacapo . Antonio . Carleo . Giuseppe . Fermionic Neural-Network States for Ab-initio Electronic Structure . Nature Communications . 2020 . 11 . 1 . 2368 . 10.1038/s41467-020-15724-9. 32398658 . 7217823. 1909.12852 . 2020NatCo..11.2368C .

Variational Monte Carlo Explained

Wave function optimization in VMC

VMC and deep learning

See also

Further reading

General

Wave-function optimization in VMC

References