Laplace's method


Laplace's method is a technique used to approximate integrals of the form

abeMf(x) dx\int_{a}^{b}e^{Mf(x)}\ dx

where MM is a large constant and f(x)f(x) is a twice-differentiable function with a unique global maximum. aa and bb may be infinite.

Laplace's method can be generalized to work on path integrals over the complex plane. This generalization is known as the saddle point method.

Theory

Call x0x_{0} the global maximum of f(x)f(x). We can Taylor expand f(x)f(x) around that point and stop at the second order

f(x)f(x0)+f(x0)(xx0)+12f(x0)(xx0)2f(x)\simeq f(x_{0})+f'(x_{0})(x-x_{0})+ \frac{1}{2}f''(x_{0})(x-x_{0})^{2}

but since x0x_{0} is a stationary point, f(x0)=0f'(x_{0})=0, so we get

f(x)f(x0)+12f(x0)(xx0)2f(x)\simeq f(x_{0})+ \frac{1}{2}f''(x_{0})(x-x_{0})^{2}

Since x0x_{0} is a maximum, in that point we have f(x0)0f''(x_{0})\leq 0. For points in the neighborhood of x0x_{0}, we can approximately state

f(x)f(x0)12f(x0)(xx0)2f(x)\simeq f(x_{0})- \frac{1}{2}|f''(x_{0})|(x-x_{0})^{2}

If we plug this in the integral we get

abeMf(x) dxeMf(x0)abe12Mf(x0)(xx0)2 dx\int_{a}^{b}e^{Mf(x)}\ dx\simeq e^{Mf(x_{0})}\int_{a}^{b}e^{- \frac{1}{2}M|f''(x_{0})|(x-x_{0})^{2}}\ dx

If we replace aa and bb with -\infty and ++\infty (if they weren't already) as if MM is large, the integral far from x0x_{0} is almost zero, so there is little difference. Doing so makes it into a Gaussian integral (an integral of a function like ex2e^{-x^{2}}), which can be solved as

abeMf(x) dx2πMf(x0)eMf(x0)\boxed{\int_{a}^{b}e^{Mf(x)}\ dx\simeq \sqrt{ \frac{2\pi}{M|f''(x_{0})|} }e^{Mf(x_{0})}}

which becomes more and more precise as MM\to \infty.