Introductory definitions and concepts#

Mathematics for Scientists and Engineers 2

Partial differential equations (PDEs) arise everywhere in Physics

Partial differentiation#

Let us quickly recall some important concepts in partial differentiation.

Given a function of \(n\) variables \(f(x_1, x_2, \dots , x_n)\), its total differential is given by

\[ df = \frac{\partial f}{\partial x_1} dx_1 + \frac{\partial f}{\partial x_2} dx_2 + \cdots + \frac{\partial f}{\partial x_n} dx_n \]

Assume that now \(x\) and \(y\) are functions of another variable, say \(t\). Dividing the above by \(dt\) we get

\[ \frac{df}{dt} = \frac{\partial f}{\partial x_1} \frac{dx_1}{dt} + \frac{\partial f}{\partial x_2} \frac{dx_2}{dt} + \cdots + \frac{\partial f}{\partial x_n} \frac{dx_n}{dt} \]

which is the chain rule for partial differentiation and is how we calculate the total derivative of \(f\) w.r.t. \(t\).

Auxiliary conditions#

Initial conditions

Boundary conditions:

  • Dirichlet

Well-posedness#

A well posed problem is a problem consisting of a PDE in a domain together with the necessary auxiliary conditions such that:

  1. Existence: the solution exists

  2. Uniqueness: the solution is unique

  3. Stability: the solution depends on the auxiliary conditions in a continuous manner. This means that a small change in the auxiliary conditions produces a small change in the solution

Elliptic, parabolic and hyperbolic PDEs#

When dealing with second-order PDEs, we will want to know whether they are an elliptic, parabolic or hyperbolic type. As we get more experience with solving PDEs, knowing which of the three types it belongs to will guide us in the choice of solution method and how we expect it to behave.

A general linear PDE is of the form

\[ \mathcal{L}[u] = f, \]

where \(\mathcal{L}\) is a linear differential operator and \(f\) is some function. If there are \(n\) independent variables \(x_1, x_2, \dots, x_n\), a general second-order linear PDE is of the form

(134)#\[ \mathcal{L}[u] = \sum_{i,j=1}^n a_{ij} u_{x_i x_j} + \text{lower-order terms} = 0 \]

where \(A = A[a_{ij}]\) is a symmetric \(n \times n\) matrix of coefficients of the second derivatives. For example, a general second-order linear equation in two independent variables \(\mathbf{x} = (x, y)\) then has the form:

\[ a_{11}u_{xx} + a_{12}u_{xy} + a_{22}u_{yy} + \cdots = 0 \]

and since \(u_{xy} = u_{yx}\), the symmetric coefficient matrix \(A\) is then

(135)#\[\begin{split} A = \begin{pmatrix} a_{11} & \frac{a_{12}}{2} \\ \frac{a_{12}}{2} & a_{22} \end{pmatrix} \end{split}\]

Going back to the general \(n\)-dimensional case (134), we classify second-order PDEs based on the eigenvalues of \(A\):

  1. ELLIPTIC: all \(n\) eigenvalues are all positive or all negative

  2. PARABOLIC: 1 eigenvalue is zero and \(n-1\) eigenvalues are all positive or all negative

  3. HYPERBOLIC: 1 eigenvalue is negative and \(n-1\) eigenvalues are all positive, or vice versa

As a simple example, let us find the eigenvalues of the 2-D coefficient matrix (135):

\[\begin{split} \left | \begin{array}{cc} a_{11} - \lambda & \frac{a_{12}}{2} \\ \frac{a_{12}}{2} & a_{22} - \lambda \end{array} \right | = (a_{11} - \lambda)(a_{22} - \lambda) - \frac{a_{12}^2}{4} \end{split}\]
\[ \lambda^2 - (a_{11} + a_{22})\lambda + a_{11}a_{22} - \frac{a_{12}^2}{4} = 0 \]

Vieta’s formula:

\[ \lambda_1 \lambda_2 = a_{11}a_{22} - \frac{a_{12}^2}{4} \]

Therefore, if the equation is elliptic and \(\lambda_1\) and \(\lambda_2\) are both positive or negative, then \(a_{11}a_{22} - \frac{a_{12}^2}{4} > 0\). If one is positive and the other is negative, then \(a_{11}a_{22} - \frac{a_{12}^2}{4} < 0\) and the equation is hyperbolic. And if one eigenvalue is zero, \(a_{11}a_{22} - \frac{a_{12}^2}{4} = 0\) and the equation is parabolic.

Let us see three very important examples.

  1. Laplace’s equation \(\nabla^2 u = 0\)

Let us write it in the above form

\[ \frac{\partial^2 u}{\partial x^2} + \frac{\partial^2 u}{\partial y^2} + \frac{\partial^2 u}{\partial z^2} = 0 \]

Here \(A_{ij}\) is the diagonal matrix \(A\) = diag\((1, 1, 1)\). Recall that the eigenvalues of diagonal matrices are the diagonal entries themselves, so the eigenvalues of \(A\) are \(1, 1, 1\). Since all 3 are positive, Laplace’s equation is elliptic.

  1. Heat (diffusion) equation \(u_t - k \nabla^2 u = 0, \quad k > 0\)

Note that now \(n = 4\) as we have 1 + 3 dimensions (1 temporal and 3 spatial). Rewritten as

\[ -k \frac{\partial^2 u}{\partial x^2} -k \frac{\partial^2 u}{\partial y^2} -k \frac{\partial^2 u}{\partial z^2} + u_t = 0 \]

we easily see that \(A_{ij} =\) diag\((0, -k, -k, -k)\) because we have \(0 \times u_{tt}\). The heat equation is parabolic.

  1. Wave equation \(u_{tt} - c^2 \nabla^2 u = 0\)

Now the time derivative is second-order as well, so the coefficient matrix \(A_{ij} =\) diag\((1, -c^2, -c^2, -c^2)\). We have 1 positive eigenvalue and all 3 other eigenvalues are negative, so the wave equation is hyperbolic.

Important

A PDE can change type in different parts of the domain if \(a_{ij}\) are functions of \(x_i\). However, the local type (at any given position) is invariant under coordinate transformations.

Expected behaviour of solutions#

Copied from MM4 lecture 3. TODO: change

  • Elliptic. Solutions are “smooth”, i.e. they vary in a sedate manner. The level of smoothness is partly dictated by the coefficients in the PDE. Solutions may be rough at boundaries. If one of the independent variables is time, then solutions will tend to become smoother with time. If both of the independent variables are space coordinates, then the solution will tend to be increasingly smooth in the interior of the region away from the boundaries.

  • Parabolic. Parabolic equations can always be transformed into a form equivalent to the diffusion equation by a suitable change of variables. In this form, the solutions always become smoother as the transformed time variable increases.

  • Hyperbolic. Solutions do not get smoother with time. Instead discontinuities in the initial conditions tend to propagate across space and time. Hyperbolic equations are often difficult to deal with because at large times and distances their solutions are still complicated.