Linear Time-Invariant Systems
Linear Time-Invariant Systems
(LTI Systems)
Linear Time-Invariant Systems
• A system is said to be Linear Time-Invariant (LTI) if it possesses the basic system properties of linearity and
time-invariance.
• The input-output relationship for LTI systems is described in terms of a convolution operation.
DT Signal Decomposition in terms of shifted unit impulses 𝑥𝑛 𝑦𝑛
𝑥𝑛 LTI System
𝑥2 𝑥2
𝑥 −1 𝑥 1 𝑥 −1 𝑥1
𝑥 −2 𝑥0
𝑥 −2 𝑥0
∙∙∙ + ∙∙∙
+ + +
−2 −1 0 1 2
−2 −1 0 1 2 𝑛 𝑥 −2 𝛿[𝑛 + 2] 𝑥 −1 𝛿[𝑛 + 1] 𝑥 0 𝛿[𝑛] 𝑥 1 𝛿[𝑛 − 1] 𝑥 2 𝛿[𝑛 − 2]
Amplitude (constant)
∞ Impulse (signal) 𝛽 𝛿 𝑛 − 𝑘 𝛽 ℎ 𝑛 − 𝑘
Convolution sum
𝑥𝑛 ℎ𝑛 𝑦𝑛
Convolution
∞
1
Convolution
Find output
∞ ∞ =
𝑦 𝑛 = 𝑥[𝑛] ∗ ℎ[𝑛] = 𝑥 𝑘 ℎ[𝑛 − 𝑘] = ℎ 𝑘 𝑥[𝑛 − 𝑘]
𝑘=−∞ 𝑘=−∞
There are only two non-zero values for the input
𝑦 𝑛 = 0 + 𝑥 0 ℎ 𝑛 − 0 + 𝑥 1 ℎ 𝑛 − 1 + 0 = 0.5ℎ 𝑛 + 2 ℎ 𝑛 − 1
Convolution 2
Example:
3 𝑛=0 3 𝑛=0
ℎ𝑛 = 2 𝑛=1
𝑥𝑛 = 1 𝑛=1
1 𝑛=2 2 𝑛=2
0 𝑒𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒 0 𝑒𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒
Length =3 Length =3
∞
Solution:
𝑦 𝑛 = 𝑥[𝑛] ∗ ℎ[𝑛] = 𝑥 𝑘 ℎ[𝑛 − 𝑘]
𝑘=−∞
9 𝑛=0
9 𝑛=1
11 𝑛=2
𝑦𝑛 = 𝑛=3
5
2 𝑛=4
0 𝑒𝑙𝑠𝑒𝑤ℎ𝑒𝑟𝑒
Convolution Length = 𝑁1 + 𝑁2 − 1 = 3 + 3 − 1 = 5
Convolution 3
Example: Find the output of an LTI system having a unit impulse response ℎ 𝑛 = 𝑢[𝑛], for the input 𝑥 𝑛 =∝𝑛 𝑢 𝑛
∞
𝑦 𝑛 = 𝑥 𝑘 ℎ[𝑛 − 𝑘]
𝑘=−∞
𝑛≥0
∝ 𝑘 0≤𝑘≤𝑛 𝑘 >𝑛 →ℎ 𝑛−𝑘 =0
𝑥 𝑘 ℎ[𝑛 − 𝑘] = ቊ 𝑘<0 →𝑥 𝑘 =0
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
𝑠 = ∝𝑘 = 1 +∝ +∝2 + ⋯ +∝𝑛
𝑛<0 𝑘=0
∝ 𝑠 = ∝ +∝2 + ⋯ +∝𝑛+1
(Shifting left) 𝑠 −∝ 𝑠 = 1−∝𝑛+1 Thus, for all 𝑛,
output 1−∝𝑛+1
Thus, for 𝑛 < 0, 𝑦 𝑛 = 0 𝑦𝑛 = 𝑢[𝑛]
1 −∝
The Representation of Continuous-Time Signals in Terms of Impulses
𝑥(𝑡) is approximated in
𝑥(𝑡) Defining:
terms of pulses or staircase
1ൗ 0≤𝑡≤Δ
𝛿Δ 𝑡 = ൝ Δ
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
𝑡 1 0≤𝑡≤Δ
Δ𝛿Δ 𝑡 = ቊ
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
𝑥ො 𝑡 : the approximation of 𝑥(𝑡)
Δ𝛿Δ 𝑡 has a unit amplitude
𝑥(0) 0 ≤ 𝑡 ≤ Δ
At 𝑡 = 0 𝑥ො 0 = 𝑥(0)Δ𝛿Δ 𝑡 = ቊ
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
The complete pulse/staircase approximation of
𝑥(𝑡)is the sum
At 𝑡 = Δ 𝑥(Δ) Δ ≤ 𝑡 ≤ 2Δ
𝑥ො Δ = 𝑥(Δ)Δ𝛿Δ 𝑡 − Δ = ቊ
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
𝑥ො 𝑡 =∙∙∙ +𝑥ො −Δ + 𝑥ො 0 + 𝑥ො Δ +∙∙∙
∞
In general At 𝑡 = 𝑘Δ 𝑥ො 𝑡 = 𝑥(𝑘Δ)𝛿Δ 𝑡 − 𝑘Δ Δ
𝑘=−∞
𝑥(𝑘Δ) 𝑘Δ ≤ 𝑡 ≤ (𝑘 + 1)Δ
𝑥ො 𝑘Δ = 𝑥(𝑘Δ)Δ𝛿Δ 𝑡 − 𝑘Δ = ቊ
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
The Representation of CT Signals in Terms of Impulses2
If we let Δ approach 0, 𝑥ො 𝑡 becomes closer and closer and equals 𝑥(𝑡) in the limit of 0
Δ → 0; 𝛿Δ 𝑡 → 𝛿(𝑡)
∞
∞ ∞
∙∙∙ Δ → න ∙∙∙ 𝑑𝜏 Consequently: 𝑥 𝑡 =න 𝑥 𝜏 𝛿 𝑡 − 𝜏 𝑑𝜏
𝜏=−∞ 𝜏=−∞
𝑘=−∞
Convolution integral
The Convolution Integral1
• The impulse response ℎ(𝑡) of a continuous-time LTI system 𝑆 𝛿(𝑡) ℎ(𝑡)
CT LTI System
ℎ 𝑡 = 𝑆{𝛿 𝑡 } Sum (Integral) of weighted shifted impulses
∞ linearity ∞
𝑦 𝑡 =𝑆 𝑥 𝑡 =𝑆 න 𝑥 𝜏 𝛿 𝑡 − 𝜏 𝑑𝜏 = න 𝑥 𝜏 𝑆{𝛿 𝑡 − 𝜏 } 𝑑𝜏
For the input 𝑥(𝑡): 𝜏=−∞ 𝜏=−∞
weight impulse
• Since the system is time-invariant: ∞
Time-invariance
𝑆 𝛿 𝑡−𝜏 = ℎ(𝑡 − 𝜏) 𝑦 𝑡 =න 𝑥 𝜏 ℎ 𝑡 − 𝜏 𝑑𝜏 = 𝑥(𝑡) ∗ ℎ(𝑡)
𝜏=−∞
Example 1
Let, the input 𝑥 𝑡 = 𝑒 −𝑎𝑡 𝑢(𝑡) for 𝑎 > 0 to an LTI system
with unit impulse response ℎ 𝑡 = 𝑢(𝑡). Find the output
𝑦 𝑡 of the system.
∞
𝑦 𝑡 = 𝑥(𝑡) ∗ ℎ(𝑡) = න 𝑥 𝜏 ℎ 𝑡 − 𝜏 𝑑𝜏 𝑥 𝑡 ≠ 0 𝑓𝑜𝑟 𝑡 ≥ 0
𝜏=−∞ 1 𝜏≤𝑡
𝑓𝑜𝑟 𝑡 < 0 No overlap 𝑦 𝑡 = 0 ℎ 𝑡−𝜏 =𝑢 𝑡−𝜏 =ቊ
0 𝜏>𝑡
𝑓𝑜𝑟 𝑡 ≥ 0 ∞ 𝑥 𝑡 ℎ 𝑡−𝜏 =ቊ
𝑥 𝑡 0<𝜏≤𝑡
0 𝜏>𝑡
𝑦 𝑡 = න 𝑒 −𝑎𝜏 ℎ 𝑡 − 𝜏 𝑑𝜏 𝑓𝑜𝑟 𝑡 > 0
0 Thus, for all t, we can write
𝑡
1 −𝑎𝜏 1
𝑡 1
=න𝑒 −𝑎𝜏
𝑑𝜏 = 𝑒 ቤ = 1 − 𝑒 −𝑎𝑡 𝑦 𝑡 = 1 − 𝑒 −𝑎𝑡 𝑢(𝑡)
−𝑎 𝑎 𝑎
0 0
The Convolution Integral2
𝑥 𝜏 = 𝑒 2𝑡 𝑢(−𝜏)
Example 2 ℎ 𝜏
𝑥 𝑡 = 𝑒 2𝑡 𝑢(−𝑡)
Find 𝑦 𝑡 = 𝑥(𝑡) ∗ ℎ(𝑡) , where
ℎ 𝑡 = 𝑢(𝑡 − 3)
∞
The system response is 𝑦 𝑡 = =𝜏−∞ 𝑥 𝜏 ℎ 𝑡 − 𝜏 𝑑𝜏
𝜏𝜏
these two signals have regions of nonzero overlap
For 𝒕 − 𝟑 ≤ 𝟎: nonzero overlap for −∞ ≤ 𝜏 ≤ 𝑡 − 3 ℎ 𝑡−𝜏
Flip and shift by t
𝑡−3 𝑡−3
1 2𝜏 1 2(𝑡−3)
𝑦 𝑡 =න 𝑒 2𝜏 𝑑𝜏 = 𝑒 ቤ = 𝑒 For 𝑡 ≤ 3
−∞ 2 −∞
2
0 0
1 1 𝑦 𝑡
𝑦 𝑡 =න 𝑒 2𝜏 𝑑𝜏 = 𝑒 2𝜏 ቤ = For 𝑡 ≥ 3
−∞ 2 −∞
2
1 2(𝑡−3)
𝑒 For 𝑡 ≤ 3
𝑦 𝑡 =൞ 2
1ൗ For 𝑡 ≥ 3 𝑡
2
𝑦 𝑡 =න
∞
𝑥 𝜏 ℎ 𝑡 − 𝜏 𝑑𝜏
The Convolution Integral3
𝜏=−∞
Convolution
Shift ℎ 𝑡 − 𝜏
𝒕<𝟎 No overlapping
𝑦 𝑡 =0
𝑡
𝑦 𝑡 = න 2 ∙ 1 𝑑𝜏 0<𝜏<𝑡
0 𝟎<𝒕<𝟐
𝟎<𝒕<𝟐 𝑡
𝑦 𝑡 = 2 𝜏ቚ
0
𝑦 𝑡 = 2𝑡
The Convolution Integral4
𝟐<𝒕<𝟒
𝟒<𝒕<𝟔
No-overlap 𝑦 𝑡 = 0
𝒕>𝟔
𝟎 𝟏 𝟐 𝟑 𝟒 𝟓 𝟔 𝟕
𝒕−𝟒 𝒕
Properties of LTI Systems
• The characteristics of an LTI system are completely determined by its impulse response ℎ 𝑛 . This property holds
in general only for LTI systems only.
• The unit impulse response of a nonlinear system does not completely characterize the behavior of the system.
If the system is LTI, we get the system output (by convolution): 𝑦 𝑛 = ℎ 𝑘 𝑥[𝑛 − 𝑘]
𝑘=−∞
There is only one such LTI system for the given h[n].
However, there are many nonlinear systems with the same response, h[n]. Two different Non-Linear systems
with same impulse response
2 1, 𝑛 = 0,1
ℎ 𝑛 = 𝛿 𝑛 +𝛿 𝑛−1 ℎ 𝑛 =ቊ
0, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
1, 𝑛 = 0,1
ℎ 𝑛 = 𝑀𝑎𝑥 𝛿 𝑛 , 𝛿 𝑛 − 1 ℎ 𝑛 =ቊ
0, 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
1 Commutative Property
Put 𝑟 = 𝑛 − 𝑘 ⇒ 𝑘 = 𝑛 − 𝑟
𝑥 𝑛 ∗ ℎ1 𝑛 + 𝑥 𝑛 ∗ ℎ2 𝑛
in continuous time
Example:
𝑢 𝑛 = 1, 𝑛 ≥ 0
and
x[n] in nonzero for entire n, so direct convolution is difficult. Therefore, we will use commutative property.
1𝑓𝑜𝑟 𝑘 ≥ 0 1𝑓𝑜𝑟 𝑘 ≤ 𝑛
𝑛 𝑘
1
=
2
𝑘=0
𝑙 = −𝑘 𝑙 𝑚 =𝑙+𝑛 𝑚−𝑛 𝑚
𝑛 ∞ 1 ∞ 1 ∞ 1 1
𝑘 𝑛
2 = = =2 = 2𝑛 = 2𝑛+1
𝑘=−∞ 𝑙=−𝑛 2 𝑚=0 2 𝑚=0 2 1
1−
2
1𝑓𝑜𝑟 𝑘 ≤0 1𝑓𝑜𝑟 𝑘 ≤ 𝑛
3 Associative Property
in continuous time
In discrete time
Proof:
4 LTI Systems With and Without Memory
system
A system is memory-less if its output at any time depends only on the value 𝑥[𝑛] 𝑦[𝑛]
of the input at that same time. ℎ[𝑛]
∞
Proof If ℎ t = 𝛿 𝑡 𝑦 𝑡 = න 𝑥 𝜏 𝛿 𝑡 − 𝜏 𝑑𝜏 = 𝑥(𝑡)
−∞
Example1 CTS:
𝑡0 > 0 delay
Consider the LTI system consisting of a pure time shift 𝑦 𝑡 = 𝑥(𝑡 − 𝑡0 )
𝑡0 < 0 advance
The impulse response for the system (for 𝑥 𝑡 = 𝛿(𝑡)): ℎ 𝑡 = 𝛿(𝑡 − 𝑡0 ) impulse response 𝑥(𝑡) = 𝛿(t)
To recover the input from the output (invert the system), all that is required is to shift the output back.
𝜏 = −1 𝜏 = 0 𝜏=5 𝜏=8
𝜏
The inverse system impulse response: ℎ1 𝑡 = 𝛿(𝑡 + 𝑡0 ) 𝛿 𝑡 0
∞ 0 0
then 𝛿 𝜏−5 𝛿 𝑡+5−𝜏 1 𝑡=0
𝑥 𝑡 ∗ ℎ 𝑡 = න 𝑥 𝜏 𝛿 𝑡 − 𝜏 𝑑𝜏 𝛿 𝑡 =ቊ
−∞ 0 𝑡≠0
1𝑓𝑜𝑟 𝜏 = 𝑡0
∞
ℎ 𝑡 ∗ ℎ1 𝑡 = 𝛿 𝑡 − 𝑡0 ∗ 𝛿 𝑡 + 𝑡0 = න 𝛿 𝜏 − 𝑡0 𝛿 𝑡 + 𝑡0 − 𝜏 𝑑𝜏 = 𝛿(𝑡) identity system (𝑦 𝑡 = 𝑥 𝑡 ∗ 𝛿 𝑡 = 𝑥(𝑡))
−∞
Invertibility of LTI Systems: Example2 DTS
Consider an LTI system with impulse response: ℎ 𝑛 = 𝑢[𝑛] 𝑢 𝑛 − 𝑘 = 0 𝑓𝑜𝑟 𝑘 > 𝑛
summer or accumulator
∞ 𝑛
Response of this system (convolution sum): 𝑦 𝑛 = 𝑥 𝑘 𝑢[𝑛 − 𝑘] 𝑦 𝑛 = 𝑥𝑘
𝑘=−∞ 𝑘=−∞
first difference equation
𝑛−1
Inverse system
𝑦 𝑛 =𝑥 𝑛 + 𝑥𝑘 𝑦 𝑛 = 𝑥 𝑛 + 𝑦[𝑛 − 1] 𝑥 𝑛 = 𝑦 𝑛 − 𝑦[𝑛 − 1] 𝑦 𝑛 = 𝑥 𝑛 − 𝑥[𝑛 − 1]
𝑘=−∞
Verification: ℎ 𝑛 ∗ ℎ1 𝑛 = 𝛿 𝑛
−2 −1 0 1 2 3 4 𝑛
𝑢 𝑛−1 1
ℎ 𝑛 ∗ ℎ1 𝑛 = 𝑢[𝑛] ∗ 𝛿 𝑛 − 𝛿[𝑛 − 1]
= 𝑢[𝑛] ∗ 𝛿 𝑛 − 𝑢[𝑛] ∗ 𝛿[𝑛 − 1] 𝑛
1 2 3 4
−2 −1 0
Causality for LTI system is equivalent to the condition of initial rest (output must be 0 before applying the input)
𝑓𝑜𝑟 𝑘 > 𝑛 ∶ ℎ 𝑛 − 𝑘 = 0 𝑓𝑜𝑟 𝑘 < 0 ∶ ℎ 𝑘 = 0
Suppose that we apply this to the LTI system with impulse response h[n].
We take max(𝑥 𝑛 ) = 𝐵 𝑎+𝑏 ≤ 𝑎 + 𝑏
Example:
Therefore, if
An LTI system with pure time shift is stable.
adder scaler
unit delay
Example:
Consider the causal system described Consider the causal continuous−time system
by the first-order difference equation described by a first−order differential equation
𝑦 𝑛 + 𝑎 𝑦 𝑛 − 1 = 𝑏 𝑥[𝑛] 𝑑𝑦 𝑡
+ 𝑎𝑦 𝑡 = 𝑏 𝑥(𝑡)
𝑦 𝑛 = 𝑏 𝑥[𝑛] − 𝑎 𝑦 𝑛 − 1 𝑑𝑡
𝑏 1 𝑑𝑦 𝑡
𝑦 𝑡 = 𝑥 𝑡 −
𝑎 𝑎 𝑑𝑡