Section 9 of 11 · Notes pages 73–83
Z-Transform and Linear Differential Equations
The z-transform and its properties for solving difference equations, then linear constant-coefficient differential equations, stability, and an RLC oscillator example.
The Z-Transform
The z-transform is a tool for analyzing and designing discrete-time systems. It is also very useful for solving difference equations, because it turns the difference equation into an algebraic equation.
Definition Given a sequence \(x[n]\), its z-transform \(\overline X(z)\) is the sum
defined for those values of \(z\) for which the sum converges. These values of \(z\) form the region of convergence, or ROC.
Two useful facts about convergence:
For a finite-length sequence, the z-transform converges for every \(z\), except possibly \(z=0\).
If the z-transform of a sequence converges at all, it converges for every \(|z|>r_0\), where \(r_0\) depends on the sequence.
Properties:
(i) Linearity. Suppose \(x_1[n]\overset{\mathcal Z}{\longleftrightarrow}\overline X_1(z)\) with region of convergence \(\mathrm{ROC}_1\), and \(x_2[n]\overset{\mathcal Z}{\longleftrightarrow}\overline X_2(z)\) with region of convergence \(\mathrm{ROC}_2\). Then, for any constants \(\alpha_1\) and \(\alpha_2\), \[\alpha_1x_1[n]+\alpha_2x_2[n]\longleftrightarrow\alpha_1\overline X_1(z)+\alpha_2\overline X_2(z),\] and the region of convergence contains the overlap, \(\mathrm{ROC}\supset\mathrm{ROC}_1\cap\mathrm{ROC}_2\).
Proof Split the sum into two sums: \begin{align*} \sum_{n=0}^{\infty}(\alpha_1x_1[n]+\alpha_2x_2[n])z^{-n}&=\sum_{n=0}^{\infty}(\alpha_1x_1[n]z^{-n}+\alpha_2x_2[n]z^{-n})\\ &=\alpha_1\underbrace{\sum_{n=0}^{\infty}x_1[n]z^{-n}}_{\overline X_1(z)}+\alpha_2\underbrace{\sum_{n=0}^{\infty}x_2[n]z^{-n}}_{\overline X_2(z)}\\ &=\alpha_1\overline X_1(z)+\alpha_2\overline X_2(z).\quad\blacksquare \end{align*}
(ii) Delay by one step. If \(x[n]\overset{\mathcal Z}{\longleftrightarrow}\overline X(z)\), then \[x[n-1]\overset{\mathcal Z}{\longleftrightarrow}z^{-1}\overline X(z)+x[-1].\] The extra term \(x[-1]\) is how the initial condition enters. Proof Substitute \(n'=n-1\) and pull one factor \(z^{-1}\) out of the sum: \begin{align*} \sum_{n=0}^{\infty}x[\underbrace{n-1}_{n'}]z^{-n}&=\sum_{n'=-1}^{\infty}x[n']z^{-(n'+1)}\\ &=\sum_{n'=0}^{\infty}x[n']z^{-1}z^{-n'}+x[-1]\\ &=z^{-1}\underbrace{\sum_{n'=0}^{\infty}x[n']z^{-n'}}_{\overline X(z)}+x[-1]\\ &=z^{-1}\overline X(z)+x[-1].\quad\blacksquare \end{align*} (iii) Delay by \(k\) steps. If \(x[n]\overset{\mathcal Z}{\longleftrightarrow}\overline X(z)\), then for \(k\ge1\) \[x[n-k]\longleftrightarrow z^{-k}\overline X(z)+z^{-k+1}x[-1]+z^{-k+2}x[-2]+\cdots+x[-k].\] Proof The same substitution \(n'=n-k\) gives \begin{align*} \sum_{n=0}^{\infty}x[\underbrace{n-k}_{n'}]z^{-n}&=\sum_{n'=-k}^{\infty}x[n']z^{-(n'+k)}\\ &=z^{-k}\sum_{n'=0}^{\infty}x[n']z^{-n'}+z^{-k}(x[-1]z+x[-2]z^2+\cdots+x[-k]z^k)\\ &=z^{-k}\overline X(z)+z^{-k+1}x[-1]+\cdots+x[-k]. \end{align*} (iv) The exponential sequence. For \(x[n]=a^n\), \(n\ge0\), the sum is a geometric series, which converges when \(|az^{-1}|<1\): \[\overline X(z)=\sum_{n=0}^{\infty}a^nz^{-n}=\sum_{n=0}^{\infty}(az^{-1})^n=\frac1{1-az^{-1}},\quad|az^{-1}|<1\Rightarrow\underbrace{|a|<|z|}_{\mathrm{ROC}}.\] (v) The sequence \(na^n\). For \(x[n]=na^n\), \(n\ge0\), differentiate the geometric series with respect to \(z\): \begin{align*} \overline X(z)&=\sum_{n=0}^{\infty}na^nz^{-n}=\left[\sum_{n=0}^{\infty}na^nz^{-(n+1)}\right]z=-\left(\frac{d}{dz}\sum_{n=0}^{\infty}a^nz^{-n}\right)z\\ &=-\left[\frac{d}{dz}\frac1{1-az^{-1}}\right]z\\ \overline X(z)&=\frac{az^{-1}}{(1-az^{-1})^2}.\quad\blacksquare \end{align*}
We can now solve difference equations by transforming them. The method is: apply the z-transform to both sides (the delay rules bring in the initial conditions), solve for \(\overline X(z)\) algebraically, expand it in partial fractions, and invert each term.
Example Solve \(x[n]=\dfrac56x[n-1]-\dfrac16x[n-2]\) with \(x[-1]=-4\) and \(x[-2]=-14\).
Transform both sides to the z-domain, using properties (ii) and (iii): \begin{align*} \overline X(z)&=\frac56(z^{-1}\overline X(z)+x[-1])-\frac16(z^{-2}\overline X(z)+z^{-1}x[-1]+x[-2])\\ \overline X(z)\left(1-\frac56z^{-1}+\frac16z^{-2}\right)&=-\frac{20}6+\frac46z^{-1}+\frac{14}6\\ &=\frac46z^{-1}-1. \end{align*} Solving for \(\overline X(z)\) and factoring the denominator, we write it as a sum of simple fractions: \begin{align*} \overline X(z)&=\frac{\frac46z^{-1}-1}{1-\frac56z^{-1}+\frac16z^{-2}}=\frac{\frac46z^{-1}-1}{(1-\frac12z^{-1})(1-\frac13z^{-1})}\\ &=\underbrace{\frac A{1-\frac12z^{-1}}+\frac B{1-\frac13z^{-1}}}_{\text{partial fraction expansion}}. \end{align*} To find \(A\), multiply by \((1-\frac12z^{-1})\) and set \(z=\frac12\); to find \(B\), multiply by \((1-\frac13z^{-1})\) and set \(z=\frac13\): \[A=\left.(1-\tfrac12z^{-1})\overline X(z)\right|_{z=1/2}=\frac{\frac46\cdot2-1}{1-\frac23}=\frac{1/3}{1/3}=1\] \[B=\left.(1-\tfrac13z^{-1})\overline X(z)\right|_{z=1/3}=\frac{\frac46\cdot3-1}{1-\frac12\cdot3}=\frac1{-1/2}=-2.\] Each fraction is of the form in property (iv), so we can invert it: \[\Rightarrow\overline X(z)=\frac1{1-\frac12z^{-1}}-\frac2{1-\frac13z^{-1}}\overset{\mathcal Z^{-1}}{\longleftrightarrow}x[n]=\left(\frac12\right)^n-2\left(\frac13\right)^n,\quad n\ge0.\] Example Solve \(x[n]=x[n-1]-\dfrac14x[n-2]\) with \(x[-1]=1\) and \(x[-2]=-1\).
Transform both sides to the z-domain: \begin{align*} \overline X(z)&=(z^{-1}\overline X(z)+x[-1])-\frac14(z^{-2}\overline X(z)+z^{-1}x[-1]+x[-2])\\ &=z^{-1}\overline X(z)+1-\frac14z^{-2}\overline X(z)-\frac14z^{-1}+\frac14.\\ \Rightarrow\overline X(z)\left(1-z^{-1}+\frac14z^{-2}\right)&=\frac54-\frac14z^{-1}. \end{align*} This time the denominator is a perfect square, \((1-\frac12z^{-1})^2\), so the partial fraction expansion contains a repeated factor: \[\Rightarrow\overline X(z)=\frac{\frac54-\frac14z^{-1}}{1-z^{-1}+\frac14z^{-2}}=\frac{\frac54-\frac14z^{-1}}{(1-\frac12z^{-1})^2}=\frac A{1-\frac12z^{-1}}+\frac B{(1-\frac12z^{-1})^2}.\]
Clearing denominators and comparing the constant terms and the coefficients of \(z^{-1}\): \[\Rightarrow\frac54-\frac14z^{-1}=A(1-\tfrac12z^{-1})+B=A+B-\frac A2z^{-1}.\] \[\Rightarrow\begin{gathered}A+B=5/4\\-A/2=-1/4\Rightarrow A=1/2\Rightarrow B=5/4-A=5/4-1/2=3/4.\end{gathered}\] Hence \[\overline X(z)=\frac12\frac1{1-\frac12z^{-1}}+\frac34\frac1{(1-\frac12z^{-1})^2}.\] To invert these we use two transform pairs. The first is property (iv). The second follows by multiplying the geometric series \(\sum_nw^n=\frac1{1-w}\) by itself with \(w=az^{-1}\), since \((\sum_nw^n)^2=\sum_n(n+1)w^n\): \[\frac1{1-az^{-1}}\overset{\mathcal Z^{-1}}{\longleftrightarrow}a^n,\qquad\frac1{(1-az^{-1})^2}\overset{\mathcal Z^{-1}}{\longleftrightarrow}(n+1)a^n,\qquad n\ge0.\] Therefore \[\overline X(z)\overset{\mathcal Z^{-1}}{\longleftrightarrow}x[n]=\frac12\left(\frac12\right)^n+\frac34(n+1)\left(\frac12\right)^n,\quad n\ge0,\] which simplifies to
Linear Constant Coefficient Differential Equations
(Chapter 3, sections 4 and 5 in the textbook.)
Differential equations describe continuous-time systems in the way that difference equations describe discrete-time ones. A homogeneous linear differential equation with constant coefficients of order \(n\) has the form \[\underbrace{\frac{d^ny}{dx^n}+a_1\frac{d^{n-1}y}{dx^{n-1}}+\cdots+a_{n-1}\frac{dy}{dx}+a_ny=0}_{\text{homogeneous $n^{\text{th}}$-order linear constant coefficient DE}}\] The simplest case is first order: \(\dfrac{dy}{dx}+a_1y=0\). Try a solution of the form \(y(x)=e^{\lambda x}\). Then \(\dfrac{dy}{dx}=\lambda e^{\lambda x}\), so \[\lambda e^{\lambda x}+a_1e^{\lambda x}=0\Rightarrow\lambda=-a_1.\] Hence the general solution is \(Ce^{-a_1x}\). To determine the constant \(C\) we need an initial condition such as \(y(0)\): \[y(0)=Ce^{-a_1\cdot0}=C\ \Rightarrow\ y(x)=y(0)e^{-a_1x}.\]
Example A second-order equation. Consider \[\frac{d^2y}{dx^2}+a_1\frac{dy}{dx}+a_2y=0\qquad\text{which is also written }y''+a_1y'+a_2y=0.\] We again try solutions of the form \(y(x)=e^{\lambda x}\). Each derivative just brings down another factor \(\lambda\): \[\Rightarrow\lambda^2e^{\lambda x}+a_1\lambda e^{\lambda x}+a_2e^{\lambda x}=0\] \[\Rightarrow(\lambda^2+a_1\lambda+a_2)e^{\lambda x}=0\Rightarrow\underbrace{\lambda^2+a_1\lambda+a_2=0}_{\text{characteristic equation}}.\] Since \(e^{\lambda x}\) is never zero, \(\lambda\) has to be a root of the characteristic equation: \[\lambda_1=\frac{-a_1+\sqrt{a_1^2-4a_2}}2,\quad\lambda_2=\frac{-a_1-\sqrt{a_1^2-4a_2}}2.\] For real \(a_1\) and \(a_2\) these are either two real roots or a pair of complex conjugate roots. The general solution is a combination of the two:
Given initial conditions \(y(0)\) and \(y'(0)\), the constants \(C_1\) and \(C_2\) are determined uniquely.
Example Real roots. Solve \(y''-9y=0\) with \(y(0)=4\) and \(y'(0)=-5\). The characteristic equation \(\lambda^2-9=0\) gives \(\lambda_1=3\) and \(\lambda_2=-3\), so \[y(x)=C_1e^{3x}+C_2e^{-3x}.\] The initial conditions give two equations for \(C_1\) and \(C_2\): \[\begin{gathered}4=C_1+C_2\\-5=3C_1-3C_2\end{gathered}\quad\Big\}\Rightarrow6C_1=7\Rightarrow C_1=\frac76,\qquad C_2=4-C_1=4-\frac76=\frac{17}6.\] \[\Rightarrow y(x)=\frac76e^{3x}+\frac{17}6e^{-3x}.\] Example Imaginary roots. Solve \(y''+9y=0\). The characteristic equation \(\lambda^2+9=0\) gives \(\lambda_1=j3\) and \(\lambda_2=-j3\), so \(y(x)=C_1e^{j3x}+C_2e^{-j3x}\). Complex exponentials are not convenient to read, so we rewrite the solution with sines and cosines, using Euler’s formula in the form \(\cos3x=\frac12(e^{j3x}+e^{-j3x})\) and \(\sin3x=\frac1{2j}(e^{j3x}-e^{-j3x})\): \begin{align*} \Rightarrow y(x)&=C_1e^{j3x}+C_2e^{-j3x}\\ &=\left(\frac{C_1+C_2}2+\frac{C_1-C_2}2\right)e^{j3x}+\left(\frac{C_2+C_1}2+\frac{C_2-C_1}2\right)e^{-j3x}\\ \Rightarrow y(x)&=\left(\frac{C_1+C_2}2\right)(e^{j3x}+e^{-j3x})+j\left(\frac{C_1-C_2}{2j}\right)(e^{j3x}-e^{-j3x})\\ &=(C_1+C_2)\cos3x+j(C_1-C_2)\sin3x\\ &=A\cos3x+B\sin3x\qquad\text{($A$ and $B$ can be real or complex)}. \end{align*}
Example Complex roots with a real part. Solve \(y''+4y'+7y=0\) with \(y(0)=1\) and \(y'(0)=0\). The characteristic equation is \(\lambda^2+4\lambda+7=0\), so \[\Rightarrow\lambda=\frac{-4\pm\sqrt{16-28}}2=\frac{-4\pm\sqrt{-12}}2=-2\pm j\sqrt3.\] The real part \(-2\) gives a decaying factor \(e^{-2x}\), and the imaginary part \(\pm\sqrt3\) gives oscillation: \begin{align*} \Rightarrow y(x)&=C_1e^{(-2+j\sqrt3)x}+C_2e^{(-2-j\sqrt3)x}\\ &=e^{-2x}(C_1e^{j\sqrt3x}+C_2e^{-j\sqrt3x})\\ &=e^{-2x}(A\cos\sqrt3x+B\sin\sqrt3x). \end{align*} Now apply the initial conditions. First, \(y(0)=1\) gives \(A=1\). Differentiating \(y\) and evaluating at \(x=0\), \[y'(0)=\left.\left[-2e^{-2x}(A\cos\sqrt3x+B\sin\sqrt3x)+e^{-2x}(-\sqrt3A\sin\sqrt3x+\sqrt3B\cos\sqrt3x)\right]\right|_{x=0}=-2A+\sqrt3B=0,\] so \(B=\dfrac2{\sqrt3}\) and \[\Rightarrow y(x)=e^{-2x}\left(\cos\sqrt3x+\frac2{\sqrt3}\sin\sqrt3x\right).\]
Theorem 3.4.1
Combining solutions as above only works if the exponentials \(e^{\lambda_ix}\) really are independent of each other. This is guaranteed when the roots are distinct.
If the characteristic equation of an \(n^{\text{th}}\)-order linear constant coefficient DE has \(n\) distinct roots \(\lambda_1,\ldots,\lambda_n\), then the set \(\{e^{\lambda_1x},\ldots,e^{\lambda_nx}\}\) is linearly independent on any interval \(I\subset\R\).
Proof Suppose, for contradiction, that they are linearly dependent. Then there are coefficients, not all zero, with \[\alpha_1e^{\lambda_1x}+\alpha_2e^{\lambda_2x}+\cdots+\alpha_ne^{\lambda_nx}=0,\quad\forall x\in I.\] Differentiating this identity repeatedly, each derivative multiplies the \(i^{\mathrm{th}}\) term by another \(\lambda_i\): \[\alpha_1\lambda_1e^{\lambda_1x}+\alpha_2\lambda_2e^{\lambda_2x}+\cdots+\alpha_n\lambda_ne^{\lambda_nx}=0\] \[\vdots\] \[\alpha_1\lambda_1^{n-1}e^{\lambda_1x}+\alpha_2\lambda_2^{n-1}e^{\lambda_2x}+\cdots+\alpha_n\lambda_n^{n-1}e^{\lambda_nx}=0.\] These \(n\) equations can be written as one matrix equation: \[\Rightarrow\underbrace{\col{1&1&\cdots&1\\\lambda_1&\lambda_2&\cdots&\lambda_n\\\vdots&&&\vdots\\\lambda_1^{n-1}&\lambda_2^{n-1}&\cdots&\lambda_n^{n-1}}}_{\text{a Vandermonde matrix, invertible because the }\lambda_i\text{ are distinct}}\col{\alpha_1e^{\lambda_1x}\\\alpha_2e^{\lambda_2x}\\\vdots\\\alpha_ne^{\lambda_nx}}=\nul\] \[\Rightarrow\col{\alpha_1e^{\lambda_1x}\\\vdots\\\alpha_ne^{\lambda_nx}}=\nul\Rightarrow\alpha_ie^{\lambda_ix}=0\Rightarrow\alpha_i=0.\] All the coefficients are zero, which contradicts the assumption. \(\blacksquare\)
Theorem 3.4.2 — Repeated Roots Case
If a root is repeated, we have fewer than \(n\) exponentials, so we need more solutions. The missing ones are obtained by multiplying by powers of \(x\).
If \(\lambda_1\) is a root of order \(k\) of the characteristic equation, then \(e^{\lambda_1x},xe^{\lambda_1x},\ldots,x^{k-1}e^{\lambda_1x}\) are linearly independent solutions of the differential equation.
Proof Write the equation in operator form as \(L[y]=0\), where \[L=\frac{d^n}{dx^n}+a_1\frac{d^{n-1}}{dx^{n-1}}+\cdots+a_{n-1}\frac d{dx}+a_n.\] Applying \(L\) to an exponential just multiplies it by the characteristic polynomial. Because \(\lambda_1\) is a root of multiplicity \(k\), the polynomial factors, with a leftover polynomial \(p(\lambda)\) of degree \(n-k\): \begin{align*} L[e^{\lambda x}]&=(\lambda^n+a_1\lambda^{n-1}+\cdots+a_{n-1}\lambda+a_n)e^{\lambda x}\\ &=(\lambda-\lambda_1)^kp(\lambda)e^{\lambda x}. \end{align*} At \(\lambda=\lambda_1\) this is zero, so \(L[e^{\lambda_1x}]=0\) and \(e^{\lambda_1x}\) is a solution.
To show that \(xe^{\lambda_1x}\) is also a solution, differentiate \(L[e^{\lambda x}]\) with respect to \(\lambda\): \begin{align*} \frac d{d\lambda}L[e^{\lambda x}]&=\frac d{d\lambda}[(\lambda-\lambda_1)^kp(\lambda)e^{\lambda x}]\\ &=k(\lambda-\lambda_1)^{k-1}p(\lambda)e^{\lambda x}+(\lambda-\lambda_1)^k\frac d{d\lambda}(p(\lambda)e^{\lambda x}). \end{align*} On the other hand, the derivative with respect to \(\lambda\) can be moved inside \(L\), which acts on \(x\): \[\frac d{d\lambda}L[e^{\lambda x}]=L\left[\frac d{d\lambda}e^{\lambda x}\right]=L[xe^{\lambda x}].\] Evaluate both expressions at \(\lambda=\lambda_1\). Both terms of the right-hand side contain a positive power of \((\lambda-\lambda_1)\) (this needs \(k\ge2\)), so they vanish: \[\left.L[xe^{\lambda x}]\right|_{\lambda=\lambda_1}=\left.\underbrace{\left[k(\lambda-\lambda_1)^{k-1}p(\lambda)e^{\lambda x}+(\lambda-\lambda_1)^k\frac d{d\lambda}(p(\lambda)e^{\lambda x})\right]}_{0}\right|_{\lambda=\lambda_1}.\] \[\Rightarrow L[xe^{\lambda_1x}]=0\Rightarrow xe^{\lambda_1x}\text{ is also a solution}.\] Differentiating more times with respect to \(\lambda\) in the same way shows that \(x^2e^{\lambda_1x},\ldots,x^{k-1}e^{\lambda_1x}\) are solutions too. \(\blacksquare\)
Example Solve \(y^{(iv)}-8y'''+26y''-40y'+25y=0\). The characteristic equation is \(\lambda^4-8\lambda^3+26\lambda^2-40\lambda+25=0\). It has repeated complex roots: \(\lambda_1=2+j\) with multiplicity \(2\) and \(\lambda_2=2-j\) with multiplicity \(2\). Each root contributes its exponential and \(x\) times its exponential, so the general solution is \begin{align*} y(x)&=(C_1+C_2x)e^{(2+j)x}+(C_3+C_4x)e^{(2-j)x}\\ &=e^{2x}(C_1e^{jx}+C_3e^{-jx}+x(C_2e^{jx}+C_4e^{-jx}))\\ &=e^{2x}((A\cos x+B\sin x)+x(C\cos x+D\sin x)). \end{align*}
Definition Stability: consider the homogeneous differential equation \[\frac{d^ny}{dt^n}+a_1\frac{d^{n-1}y}{dt^{n-1}}+\cdots+a_{n-1}\frac{dy}{dt}+a_ny=0\qquad(\mathrm{DE}_n)\] with general solution \(y(t)=C_1y_1(t)+\cdots+C_ny_n(t)\). It is called stable if all of its solutions stay bounded for \(t>0\), that is, \[|y_i(t)|<M_i<\infty,\quad1\le i\le n,\quad t>0.\]
Theorem 3.4.3
Stability is decided by where the roots of the characteristic equation lie in the complex plane.
\((\mathrm{DE}_n)\) is stable if and only if its characteristic equation has no roots to the right of the imaginary axis, and any roots on the imaginary axis are non-repeated.
Proof (i) Non-repeated roots. A non-repeated root \(\lambda=a+jb\) contributes a solution \(e^{\lambda t}=e^{at}e^{jbt}\). If \(a\le0\) this stays bounded: \[|e^{\lambda t}|=|e^{at}e^{jbt}|=|e^{at}|\underbrace{|e^{jbt}|}_{1}=e^{at}\le1,\quad t>0.\] (ii) Repeated roots. A repeated root \(\lambda=a+jb\) of order \(k\) contributes the \(k\) solutions \(e^{\lambda t},te^{\lambda t},\ldots,t^{k-1}e^{\lambda t}\). For \(a<0\) we show that all of them are bounded. For \(t>0\), \[|t^ie^{\lambda t}|=|t^i|\cdot|e^{at}\cdot e^{jbt}|=t^ie^{at}.\] Since \(t^ie^{at}\to0\) as \(t\to\infty\) when \(a<0\), and \(t^ie^{at}\) is finite on every bounded interval \(0<t<T\), the function \(t^ie^{at}\) is bounded for \(t>0\).
(iii) Instability. If a simple root has \(a>0\), or a repeated root has \(a\ge0\), the solutions it contributes grow without bound, so the system is unstable. \(\blacksquare\)
Theorem 3.4.4 — Coefficients of mixed sign
There is a quick necessary check for stability that needs no root finding: look at the signs of the coefficients.
If the coefficients of the characteristic equation are real and of mixed sign (at least one positive and at least one negative), then there is at least one root \(\lambda\) with \(\Re\{\lambda\}>0\), so the system is unstable.
Note that the theorem does not say that every unstable system has coefficients of mixed sign. It says only that mixed signs are enough to guarantee instability. (An example appears below.)
Proof We prove the contrapositive: if a system is stable, its characteristic polynomial cannot have coefficients of mixed sign. A stable system has all its roots in the closed left half of the complex plane, \(\Re\{\lambda\}\le0\). Since the coefficients are real, the complex roots come in conjugate pairs, so the monic characteristic polynomial factors into two kinds of factors:
a factor \((\lambda-\lambda_r)=\lambda+c\) for each real root \(\lambda_r=-c\le0\), which has non-negative coefficients \(1\) and \(c\);
a factor for each conjugate pair \(a\pm jb\) with \(a\le0\), \[(\lambda-(a+jb))(\lambda-(a-jb))=\lambda^2-2a\lambda+(a^2+b^2),\] which also has non-negative coefficients, because \(-2a\ge0\) and \(a^2+b^2\ge0\).
When two polynomials with non-negative coefficients are multiplied, every coefficient of the product is a sum of products of non-negative numbers, so it is non-negative too. Hence the characteristic polynomial of a stable system has only non-negative coefficients, and in particular its coefficients cannot be of mixed sign. \(\blacksquare\)
Conversely, a polynomial of mixed sign must have a root with a positive real part, which makes the system unstable. This is the statement of the theorem.
Now we see why the converse of the theorem fails: unstable roots do not always produce mixed signs. For an unstable real root \(\lambda_r>0\), multiplying a polynomial \(q(\lambda)\) with non-negative coefficients by \((\lambda-\lambda_r)\) gives a polynomial whose last non-zero coefficient is negative, so the signs do mix. But for an unstable pair of complex roots, \(a>0\), the factor \(\lambda^2-2a\lambda+(a^2+b^2)\) itself has mixed signs, and multiplying it by another polynomial may or may not leave the result with mixed signs.
Note that even if the added roots are unstable, \(p(\lambda)\) may have no sign mix. For example, take \[q(\lambda)=(\lambda+1),\quad\lambda^2-2a\lambda+(a^2+b^2)=\lambda^2-\epsilon\lambda+1,\quad\epsilon>0,\] which has the unstable pair \(a=\epsilon/2>0\). Then \begin{align*} p(\lambda)&=q(\lambda)\cdot(\lambda^2-2a\lambda+(a^2+b^2))=(\lambda+1)(\lambda^2-\epsilon\lambda+1)\\ &=\lambda^3+(1-\epsilon)\lambda^2+(1-\epsilon)\lambda+1. \end{align*} If \(0<\epsilon<1\), all the coefficients of \(p(\lambda)\) are positive, so the coefficients do not have mixed signs, even though the system is unstable.
Application Example: Oscillator Circuit
Here is a physical system described by a second-order differential equation: a resistor \(R\), an inductor \(L\) and a capacitor \(C\) connected in a loop to a voltage source \(E(t)\).
By Kirchhoff’s voltage law, the source voltage equals the sum of the voltages across the three elements. Each element has its own voltage–current law: \begin{align*} E(t)&=v_R(t)+v_L(t)+v_C(t)\\ v_R(t)&=Ri(t)\\ v_L(t)&=L\frac{di(t)}{dt}\\ i(t)&=C\frac{dv_C(t)}{dt}\Rightarrow v_C(t)=\frac1C\int_{-\infty}^ti(\tau)\,d\tau. \end{align*} Substituting these laws into the first one, and then differentiating once to remove the integral, gives a second-order differential equation for the current: \begin{align*} \Rightarrow E(t)&=Ri(t)+L\frac{di(t)}{dt}+\frac1C\int_{-\infty}^ti(\tau)\,d\tau\\ \Rightarrow E'(t)&=L\frac{d^2i(t)}{dt^2}+R\frac{di(t)}{dt}+\frac1Ci(t). \end{align*}
Consider the free oscillator, with no source, \(E(t)=0\). Dividing by \(L\), \[\frac{d^2i}{dt^2}+\frac RL\frac{di}{dt}+\frac1{LC}i=0,\qquad\text{characteristic equation: }\lambda^2+\frac RL\lambda+\frac1{LC}=0.\] \[\Rightarrow\lambda_1=\frac{-R/L+\sqrt{R^2/L^2-4/LC}}2,\quad\lambda_2=\frac{-R/L-\sqrt{R^2/L^2-4/LC}}2.\] The sign of the number under the square root decides the behavior, and it depends on the resistance \(R\).
(i) Large resistance. If \(\dfrac{R^2}{L^2}-\dfrac4{LC}>0\), which is equivalent to \(R^2C-4L>0\), that is, \[R>2\sqrt{\frac LC},\] then there are two real roots, both negative (the square root is smaller than \(R/L\)). The current is \[i(t)=C_1e^{\lambda_1t}+C_2e^{\lambda_2t},\quad\lambda_1<0,\quad\lambda_2<0.\] There is no oscillation: this is the overdamped case.
(ii) The borderline. If \(R=2\sqrt{L/C}\), then \(\lambda_1=\lambda_2=-\dfrac R{2L}\) and \[i(t)=C_1e^{\lambda_1t}+C_2te^{\lambda_1t}.\] There is again no oscillation: this is the critically damped case.
(iii) Small resistance. If \(R<2\sqrt{L/C}\), the roots are a complex conjugate pair, \[\lambda_1=\frac{-R/L+\sqrt{R^2/L^2-4/LC}}2=\frac{-R/L+j\sqrt{4/LC-R^2/L^2}}2=\lambda_2^*.\] The real part makes the oscillation decay, and the imaginary part sets its frequency: \[i(t)=\underbrace{e^{-\frac R{2L}t}}_{\text{decay envelope (time constant }2L/R)}(A\cos(\omega t)+B\sin(\omega t)),\quad\underbrace{\omega=\sqrt{\frac1{LC}-\frac{R^2}{4L^2}}}_{\text{damped natural frequency}}.\] These are underdamped oscillations. The constants \(A\) and \(B\) are determined from \(i(0)\) and \(i'(0)\).