Basics & Definitions
What is a Differential Equation?
A differential equation is an equation containing derivatives of a dependent variable \(y\) with respect to one or more independent variables.
Ordinary Differential Equations (ODE)
Equations with one independent variable.
Partial Differential Equations (PDE)
Equations with two or more independent variables.
Order and Degree
Order: The order of a differential equation is the order of the highest derivative appearing in the equation.
Degree: The degree is the power of the highest order derivative when the equation is polynomial in derivatives.
Linearity
An ODE is linear if it can be written as:
where \(y\) and all its derivatives appear to the first power only, and there are no products of \(y\) and its derivatives.
- Homogeneous: If \(b(x) = 0\)
- Nonhomogeneous: If \(b(x) \neq 0\)
First Order Differential Equations
Method 1 Separable Equations
If the equation can be written as:
Then separate variables and integrate:
Method 2 Homogeneous Equations
If \(M(x,y)dx + N(x,y)dy = 0\) where \(M\) and \(N\) are homogeneous of the same degree:
Substitution: Let \(y = vx\), so \(dy = v\,dx + x\,dv\)
Method 3 Exact Equations
The equation \(M(x,y)dx + N(x,y)dy = 0\) is exact if:
Solution: Find \(F(x,y)\) such that:
Then \(F(x,y) = C\) is the solution.
Method 4 Integrating Factors
If not exact, multiply by integrating factor \(\mu(x)\) or \(\mu(y)\):
(if the expression depends only on \(x\))
Method 5 Linear First Order
Standard form:
Integrating Factor: \(\mu(x) = e^{\int P(x)dx}\)
Solution:
Method 6 Bernoulli Equations
Form: \(\frac{dy}{dx} + P(x)y = Q(x)y^n\)
Substitution: Let \(v = y^{1-n}\), which transforms it into a linear equation.
Method 7 Clairaut's Equation
Form: \(y = xy' + f(y')\)
General Solution: \(y = Cx + f(C)\)
Singular Solution: Eliminate \(p = y'\) from \(y = xp + f(p)\) and \(\frac{dy}{dp} = 0\).
Second Order Linear Equations
General Form (Constant Coefficients)
where \(a, b, c\) are constants.
Case 1 Homogeneous Equations
When \(f(x) = 0\):
Characteristic Equation:
| Roots | General Solution |
|---|---|
| Real & Distinct: \(m_1, m_2\) | \(y = C_1e^{m_1x} + C_2e^{m_2x}\) |
| Real & Repeated: \(m_1 = m_2 = r\) | \(y = C_1e^{rx} + C_2xe^{rx}\) |
| Complex: \(\alpha \pm i\beta\) | \(y = e^{\alpha x}(C_1\cos(\beta x) + C_2\sin(\beta x))\) |
Case 2 Nonhomogeneous Equations
General solution:
where \(y_h\) is the homogeneous solution and \(y_p\) is a particular solution.
Method of Undetermined Coefficients
| \(f(x)\) | Trial Solution \(y_p\) |
|---|---|
| \(ke^{ax}\) | \(Ae^{ax}\) |
| \(k\sin(ax)\) or \(k\cos(ax)\) | \(A\cos(ax) + B\sin(ax)\) |
| \(kx^n\) | \(A_nx^n + A_{n-1}x^{n-1} + \cdots + A_0\) |
| \(ke^{ax}\sin(bx)\) | \(e^{ax}(A\cos(bx) + B\sin(bx))\) |
Variation of Parameters
For \(y'' + p(x)y' + q(x)y = f(x)\), if \(y_1\) and \(y_2\) are solutions to the homogeneous equation:
where:
and \(W = y_1y_2' - y_1'y_2\) is the Wronskian.
Euler-Cauchy Equation
Form: \(ax^2y'' + bxy' + cy = 0\)
Substitution: Try \(y = x^m\), leading to:
Higher Order Linear Equations
nth Order Linear Homogeneous
Characteristic Equation:
- Real root \(m\): contributes \(Ce^{mx}\)
- Repeated root \(m\) (k times): contributes \(C_1e^{mx} + C_2xe^{mx} + \cdots + C_kx^{k-1}e^{mx}\)
- Complex roots \(\alpha \pm i\beta\): contribute \(e^{\alpha x}(C_1\cos(\beta x) + C_2\sin(\beta x))\)
Systems of Differential Equations
Linear Systems
Form: \(\mathbf{x}' = A\mathbf{x}\) where \(A\) is a constant matrix.
Solution via Eigenvalues:
- Find eigenvalues \(\lambda_i\) of matrix \(A\)
- Find corresponding eigenvectors \(\mathbf{v}_i\)
- Solution: \(\mathbf{x} = \sum C_i e^{\lambda_i t}\mathbf{v}_i\)
Phase Plane Analysis
For autonomous systems \(\frac{dx}{dt} = f(x,y)\), \(\frac{dy}{dt} = g(x,y)\):
- Critical Points: Solutions to \(f(x,y) = 0\) and \(g(x,y) = 0\)
- Stability: Determined by eigenvalues of the Jacobian matrix at critical points
Laplace Transforms
Definition
Common Laplace Transforms
| \(f(t)\) | \(\mathcal{L}\{f(t)\} = F(s)\) |
|---|---|
| \(1\) | \(\frac{1}{s}\) |
| \(t\) | \(\frac{1}{s^2}\) |
| \(t^n\) | \(\frac{n!}{s^{n+1}}\) |
| \(e^{at}\) | \(\frac{1}{s-a}\) |
| \(\sin(at)\) | \(\frac{a}{s^2+a^2}\) |
| \(\cos(at)\) | \(\frac{s}{s^2+a^2}\) |
| \(e^{at}\sin(bt)\) | \(\frac{b}{(s-a)^2+b^2}\) |
| \(e^{at}\cos(bt)\) | \(\frac{s-a}{(s-a)^2+b^2}\) |
Properties
| Property | Formula |
|---|---|
| Linearity | \(\mathcal{L}\{af + bg\} = a\mathcal{L}\{f\} + b\mathcal{L}\{g\}\) |
| First Derivative | \(\mathcal{L}\{f'\} = sF(s) - f(0)\) |
| Second Derivative | \(\mathcal{L}\{f''\} = s^2F(s) - sf(0) - f'(0)\) |
| nth Derivative | \(\mathcal{L}\{f^{(n)}\} = s^nF(s) - s^{n-1}f(0) - \cdots - f^{(n-1)}(0)\) |
| Integration | \(\mathcal{L}\left\{\int_0^t f(\tau)d\tau\right\} = \frac{F(s)}{s}\) |
| Translation (t-shift) | \(\mathcal{L}\{u(t-a)f(t-a)\} = e^{-as}F(s)\) |
| Translation (s-shift) | \(\mathcal{L}\{e^{at}f(t)\} = F(s-a)\) |
| Convolution | \(\mathcal{L}\{f * g\} = F(s)G(s)\) |
Solving ODEs with Laplace Transforms
- Take Laplace transform of both sides of the equation
- Use initial conditions to simplify
- Solve algebraically for \(Y(s) = \mathcal{L}\{y(t)\}\)
- Use inverse Laplace transform to find \(y(t)\)
Series Solutions
Power Series Method
For equations of the form \(y'' + P(x)y' + Q(x)y = 0\), assume solution:
Substitute into the equation and match coefficients to find recurrence relation for \(a_n\).
Frobenius Method
For equations with regular singular point at \(x = 0\), assume:
where \(r\) is determined by the indicial equation.
Indicial Equation:
Obtained by substituting the series and equating the coefficient of the lowest power of \(x\) to zero.
Special Functions
Bessel's Equation
Solutions: Bessel functions \(J_n(x)\) and \(Y_n(x)\)
Legendre's Equation
Solutions: Legendre polynomials \(P_n(x)\) and \(Q_n(x)\)
Hermite's Equation
Solutions: Hermite polynomials \(H_n(x)\)
Laguerre's Equation
Solutions: Laguerre polynomials \(L_n(x)\)
Partial Differential Equations
Classification of Second-Order Linear PDEs
General form:
| Type | Condition | Example |
|---|---|---|
| Elliptic | \(B^2 - 4AC < 0\) | Laplace: \(\nabla^2 u = 0\) |
| Parabolic | \(B^2 - 4AC = 0\) | Heat: \(\frac{\partial u}{\partial t} = k\nabla^2 u\) |
| Hyperbolic | \(B^2 - 4AC > 0\) | Wave: \(\frac{\partial^2 u}{\partial t^2} = c^2\nabla^2 u\) |
Heat Equation (Parabolic)
Physical Meaning: Describes heat diffusion in a material.
Solution Method: Separation of variables, Fourier series
Wave Equation (Hyperbolic)
Physical Meaning: Describes wave propagation (vibrating string, sound waves).
d'Alembert Solution (infinite domain):
Laplace Equation (Elliptic)
Physical Meaning: Steady-state heat distribution, electrostatic potential.
Solution Methods: Separation of variables, Green's functions, conformal mapping
Separation of Variables
Procedure:
- Assume \(u(x,t) = X(x)T(t)\) (or similar for other variables)
- Substitute into PDE and separate into two ODEs
- Solve each ODE subject to boundary conditions
- Combine solutions using superposition principle
Assuming \(u(x,t) = X(x)T(t)\) leads to:
\[\frac{T'}{kT} = \frac{X''}{X} = -\lambda\]This gives two ODEs: \(T' + k\lambda T = 0\) and \(X'' + \lambda X = 0\)
Fourier Series for PDEs
For boundary value problems on finite domains \([0, L]\):
where coefficients \(B_n\) are determined from initial conditions using:
Numerical Methods
Euler's Method
For \(y' = f(x,y)\) with \(y(x_0) = y_0\):
where \(h\) is the step size.
Improved Euler (Heun's Method)
Runge-Kutta Method (4th Order)
Stability and Existence Theory
Existence and Uniqueness Theorem
For the IVP \(y' = f(x,y)\), \(y(x_0) = y_0\):
If \(f\) and \(\frac{\partial f}{\partial y}\) are continuous in a region containing \((x_0, y_0)\), then there exists a unique solution in some interval around \(x_0\).
Stability of Equilibrium Points
For autonomous system \(\frac{dy}{dx} = f(y)\), an equilibrium point \(y_e\) (where \(f(y_e) = 0\)) is:
- Stable: if \(f'(y_e) < 0\)
- Unstable: if \(f'(y_e) > 0\)
- Semi-stable: if \(f'(y_e) = 0\)
Lyapunov Stability
An equilibrium point is stable if there exists a Lyapunov function \(V(x)\) such that:
- \(V(0) = 0\) and \(V(x) > 0\) for \(x \neq 0\)
- \(\frac{dV}{dt} \leq 0\) along trajectories
Applications
Population Growth
Exponential: \(\frac{dP}{dt} = kP\)
Logistic: \(\frac{dP}{dt} = kP(1 - P/M)\)
Radioactive Decay
\(\frac{dN}{dt} = -\lambda N\)
Solution: \(N(t) = N_0 e^{-\lambda t}\)
RLC Circuits
\(L\frac{d^2Q}{dt^2} + R\frac{dQ}{dt} + \frac{Q}{C} = E(t)\)
Spring-Mass Systems
\(m\frac{d^2x}{dt^2} + c\frac{dx}{dt} + kx = F(t)\)
Mixing Problems
\(\frac{dA}{dt} = \text{rate in} - \text{rate out}\)
Predator-Prey
Lotka-Volterra equations:
\(\frac{dx}{dt} = ax - bxy\)
\(\frac{dy}{dt} = -cy + dxy\)
Study Tips
- Always check initial/boundary conditions before solving
- Verify your solution by substituting back into the original equation
- For linear equations, check if superposition principle applies
- Draw phase portraits to understand system behavior
- Use dimensional analysis to verify physical solutions
- Remember: general solution = homogeneous solution + particular solution