02 Chapter Map - LTI System Properties & Time-Domain Convolution

Chapter 2 Overview & Map of Content (MOC)

Superposition linearity tests, graphical convolution, recursive differential difference equations, and feedback blocks.


📚 Study Notes Index

Read in order — each note assumes the previous one.

#NoteWhat it covers
2.002.00 LTI System Properties and Time-Domain Convolution CompaLTI Systems Compact Review, Convolution Formula Sheet
2.012.01 Systems Classification LTI Properties and StabilitySystem Properties, Linearity & Stability, BIBO Stability Proof
2.022.02 The Continuous Convolution IntegralConvolution Integral, Continuous Convolution, LTI Convolution
2.032.03 Properties of the Convolution IntegralConvolution Properties, Shifting Property of Convolution, Convolution Algebraic Theorems
2.042.04 Systems Described by Differential and Difference EquatiDifferential Equations, Difference Equations, LCCDE, Homogeneous Solution, Particular Solution
2.052.05 Block Diagram Representations and System InterconnectioBlock-Diagrams, System Realization, Direct Form I, Direct Form II, Canonic Realization, Cascade, Parallel

🎯 Exam Weight

ECE 2107 Exam Relevance

Master the core derivations, mathematical definitions, and problem-solving techniques. Refer to ECE 2107 - Signals and Systems for syllabus boundaries and past year questions.



← Chapter 1 Compact Review | Chapter 2 Map | Chapter 3 Compact Review →

Chapter 2: LTI System Properties & Time-Domain Convolution - Compact Review

This compact review card synthesizes all core concepts, mathematical definitions, final-line derivations, and architectural realization structures for continuous-time and discrete-time systems under Chapter 2: LTI System Properties & Time-Domain Convolution.


1. Systems Classification & Mathematical Operators

1.1 Linearity: Superposition & Homogeneity

*(Target: Theory Descriptive / Linearity Verification)*

  • Concept: A system is linear if and only if it simultaneously satisfies the principles of additivity (superposition) and homogeneity (scaling). A linear system has the property that a zero input strictly produces a zero output.
  • Governing Equations:
    • Additivity:
    • Homogeneity:
    • Unified Linearity Condition:

1.2 Time-Invariance (Shift-Invariance)

*(Target: Theory Descriptive / Time-Invariance Verification)*

  • Concept: A system is time-invariant if its internal parameters do not change over time. A time shift applied to the input signal must produce an identical time shift in the output response.
  • Governing Formula:
  • The Two-Step Verification Checklist:
    1. Step 1: Delay the system output by directly: .
    2. Step 2: Pass a delayed input through the operator: .
    3. Check: If , the system is Time-Invariant. If they are not equal, the system is Time-Variant.

1.3 Causality

*(Target: Theory Descriptive / Causality Boundary Check)*

  • Concept: A system is causal if its output at any instant depends strictly on current and past input values, but is completely independent of future input values. A continuous-time LTI system described by a differential equation is causal when it is initially relaxed {if input for , then output for }.
  • s-Domain/z-Domain Causal Boundary: The impulse response must satisfy:

1.4 Memory (Dynamic) vs. Memoryless (Static)

*(Target: Theory Descriptive / Memoryless Bound)*

  • Concept: A system is memoryless (static) if its output at any instant depends strictly on the input applied at that exact instant . If the output depends on inputs at other times (past or future), the system has memory (dynamic).
  • Memoryless LTI Bound: An LTI system is memoryless if and only if its impulse response is a scaled Dirac delta function:

1.5 Bounded-Input Bounded-Output (BIBO) Stability

*(Target: Theory Descriptive / Stability Test)*

  • Concept: A system is BIBO stable if every bounded input sequence produces a bounded output response.
  • Input-Output Bounded Limits:

2. Continuous-Time Convolution Integral

2.1 The Representation of Signals in Terms of Impulses

*(Target: Mathematical Proof / 5-Mark derivation)*

  • Concept: Any arbitrary continuous-time signal can be represented as a weighted superposition of infinite, shifted continuous impulse functions.
  • Governing Formula:

2.2 The Continuous Convolution Integral

*(Target: Numerical Solving / System Response)*

  • Concept: The continuous-time convolution operates on an input and system impulse response to calculate the exact time-domain system response .
  • Governing Formula:

2.3 Mathematical Properties of Continuous Convolution

*(Target: Theory Descriptive & Proofs)*

  • Commutative Property:
  • Distributive Property:
  • Associative Property:
  • Convolution with a Unit Impulse:
  • Convolution with Shifted / Delayed Inputs:
  • Convolution Time-Scaling Identity:

ight] \quad ext{for } a eq 0y(2t) = 2 \left[ x(2t) * h(2t) ight] \quad ext{(derivation)}$$

  • Differentiation Property of Convolution: rac{dy(t)}{dt} = rac{dx(t)}{dt} * h(t) = x(t) * rac{dh(t)}{dt} \quad ext{(derivation)}

3. Discrete-Time Convolution Sum

3.1 The Discrete Convolution Sum

*(Target: Numerical Solving / Sequence Inversion)*

  • Concept: The discrete counterpart of the convolution integral, evaluating the output sequence by summing the weighted and shifted impulse response sequences triggered by each input sample.
  • Governing Formula:

3.2 Sequence Length Theorem

*(Target: Numerical Solving)*

  • Concept: Convolving two finite-duration sequences of lengths and yields a resulting convolved sequence of a larger finite duration.
  • Governing Formula:

3.3 Periodic (Circular) vs. Linear Convolution

*(Target: Theory Descriptive / 5-Mark comparison)*

  • Concept: Linear convolution operates on infinite or finite aperiodic sequences. If signals and are periodic with common period , linear convolution does not converge. Periodic convolution integrates/sums only over a single period (or samples), forcing the output response to be strictly periodic.
  • Continuous Periodic Convolution:
  • Discrete Periodic Convolution:

angle_N]$$


4. Continuous & Discrete BIBO Stability Proofs

4.1 Continuous-Time Absolute Integrability Proof

*(Target: Mathematical Proof / 8-Mark Derivation)*

  • Premise: A continuous-time LTI system is BIBO stable if and only if its impulse response is absolutely integrable.
  • Governing Formula:

4.2 Discrete-Time Absolute Summability Proof

*(Target: Mathematical Proof / 5-Mark Derivation)*

  • Premise: A discrete-time LTI system is BIBO stable if and only if its impulse response sequence is absolutely summable.
  • Governing Formula:

5. Systems Described by Differential & Difference Equations

5.1 Linear Constant-Coefficient Differential Equations (LCCDE)

*(Target: Numerical Solving / Continuous-Time System)*

  • Concept: Represents a continuous-time system where the relationship between the output and input is governed by a linear combination of derivatives.
  • Governing Equation: \sum_{n=0}^{N} a_n rac{d^n y(t)}{dt^n} = \sum_{m=0}^{M} b_m rac{d^m x(t)}{dt^m}

5.2 Linear Constant-Coefficient Difference Equations

*(Target: Numerical Solving / Discrete-Time System)*

  • Concept: Governs discrete-time LTI recursive (IIR) or non-recursive (FIR) systems.
  • Governing Equation:

5.3 Complete Response Decompositions

*(Target: Theory Descriptive)*

  • The Output Splitting Law:
  • The Complementary (Homogeneous) Solution: Evaluated by setting the input terms to zero ( or ).
  • The Particular Solution: Represents the system’s steady-state output corresponding to the specific profile of the input signal.

5.4 Characteristic Roots & Homogeneous Solution Forms

*(Target: Numerical Solving / Algebraic Rules)*

  • Distinct Roots (): y_c[n] = lpha_1 \lambda_1^n + lpha_2 \lambda_2^n + \dots + lpha_N \lambda_N^n
  • Repeated Roots (Root of multiplicity ):

ight) \lambda_1^n + eta_2 \lambda_2^n + \dots$$

  • Complex Conjugate Roots ():

ight) \quad ext{where } r = \sqrt{a^2 + b^2}, ; heta = an^{-1}\left( rac{b}{a} ight)$$


6. Block Diagram Realizations & Interconnections

6.1 Direct Form Realizations

*(Target: Block Diagram Realization / 5-to-8 Mark Draw)*

  • Direct Form I Realization: Separately realizes input zeros (feedforward delays) and output poles (feedback delays). It is non-canonic because it uses a separate set of delay/integrator elements for both parts.
  • Direct Form II Realization: Merges the delay paths for both input and output sections into a single, unified delay/integrator chain. It is canonic because it minimizes the total number of delay elements required ( delays for an -th order system).

6.2 System Interconnections

*(Target: Theory Descriptive / Cascade vs. Parallel)*

  Cascade (Series Connection):      Parallel Connection:
                                        ┌───────┐
       ┌────────┐    ┌────────┐      ┌─>│ h₁(t) ├──┐
  x(t)─│  h₁(t) ├───>│  h₂(t) ─>y(t) │  └───────┘  v  ┌───┐
       └────────┘    └────────┘  x(t)┤             ├──>│ + ├──> y(t)
                                     │  ┌───────┐  ^  └───┘
                                     └─>│ h₂(t) ├──┘
                                        └───────┘
  • Cascade (Series) Connection: The overall impulse response is the convolution of individual subsystem responses:
  • Parallel Connection: The overall impulse response is the direct algebraic sum of subsystem responses:

6.3 Inverse Systems & Deconvolution

*(Target: Theory Descriptive)*

  • Concept: A system is invertible if its input can be completely recovered from its output response using an inverse system .
  • Governing Formula:

7. Master Comparison Tables

Table 2.1: System Properties Test Matrix

*(Pre-Exam Quick Lookup)*

PropertyContinuous ConditionDiscrete ConditionPractical Checklist
LinearityZero input must produce zero output. No nonlinear terms (squares, logs, sines of signals).
Time-InvarianceCheck independent variable coefficient. If scaled (e.g., , ), it is Time-Variant.
CausalityOutput at must not depend on inputs at (e.g., , are noncausal).
Memory$h(t)
eq c\delta(t)$$h[n]
eq c\delta[n]$If output depends only on the present input, it is memoryless; else, it is dynamic.
BIBO Stability$\int_{-\infty}^{\infty} \lvert h(t)
vert dt < \infty$$\sum_{-\infty}^{\infty} \lvert h[n]
vert < \infty$Every bounded input must produce a bounded output (e.g., integrations, step responses are unstable).

Table 2.2: Continuous vs. Discrete Convolution Properties

*(Symmetry and Sizing Mapping)*

ParameterContinuous-Time ConvolutionDiscrete-Time Convolution
Governing OperatorIntegral: Infinite Summation:
Aperiodic Sequence BoundsEvaluated via piecewise continuous limits.Sequence Length Theorem: .
Unit Impulse Response
Integrability/SummabilityArea: Sum: $\sum y[n] = \left( \sum x[n]
ight) \cdot \left( \sum h[n]
ight)$

Table 2.3: Recursive (IIR) vs. Non-Recursive (FIR) Difference Equations

*(Structural Properties)*

AttributeNon-Recursive (FIR) SystemsRecursive (IIR) Systems
Feedback PathsNone. No output feedback loop is present.Present. Output terms are fed back.
Impulse Response DurationFinite Duration (Finite Impulse Response).Infinite Duration (Infinite Impulse Response).
StabilityAlways stable (since is finite and bounded).Conditionally stable (depends on pole locations inside the unit circle).
Memory ElementsFixed memory storage proportional to order .Requires infinite decay tracking of feedback states.

8. Verbatim Chapter 2 PYQ Bank

2025/2022 Exam Section B Q. 1

If , then show that: Answer Plan: Use variable substitutions inside the convolution integral of with , scaling both dummy variable and actual time .

2023/2017/2015 Exam Section B

Show that the output response of an LTI system is the convolution sum of the input signal and the impulse response of the system. Answer Plan: Represent the arbitrary input signal as a weighted summation of discrete impulses: . Apply the system operator , utilizing Linearity (superposition) to move the operator inside the sum, and Time-Invariance () to yield the convolution sum.

2024 Exam Section B Q. 2

Draw the block diagram of the system described by: rac{d^2 y(t)}{dt^2} + 3y(t) = rac{dx(t)}{dt} + 2 rac{d^2 x(t)}{dt^2} \quad ext{(05 Marks)} Answer Plan: Integrate the second-order equation twice to avoid differentiators, isolate , and construct the Direct Form II canonic block diagram utilizing two integrators, multipliers, and adders.

2021 Exam Section B Q. 3

Derive the expression of convolution with delayed input and delayed impulse response. Answer Plan: Starting from , substitute delayed variables and into the integral, use variable substitution , and match the resulting expression directly to .


9. Common Mistakes That Cost Marks

Critical Exam Pitfalls

  1. Direct Form II Feedback Coefficient Sign Swap: When sketching Direct Form II diagrams, failing to negate the feedback coefficients. Remember: feedback terms in difference/differential equations must be subtracted on summing junctions to represent negative feedback multipliers.
  2. Evaluating Causal Overlap Boundaries incorrectly: Performing graphical convolution of piecewise signals without checking overlap boundaries. Always verify the active integration interval for each segment of time before computing areas.
  3. Discrete Origin () Arrow Omission: When evaluating discrete tabular convolution, failing to locate and mark the index in convolved sequences.
  4. Applying Value Theorems to Unstable LTI Systems: Evaluating the Final Value Theorem on unstable systems with poles outside or on the imaginary axis.

10. Pre-Exam Self-Check Checklist

  • Can you verify linearity and time-invariance for any continuous-time system equations?
  • Can you prove that a continuous LTI system is BIBO stable if and only if ?
  • Can you calculate the length of convolved finite discrete arrays?
  • Can you draw canonic Direct Form II representations of second-order continuous differential and discrete difference equations?

2.01 Systems Classification, LTI Properties & Stability

Related Concepts: 1.01 Signals, Systems & Singularity Functions | 2.02 The Continuous Convolution Integral | 2.05 Block-Diagram Representations & System Interconnections


1. Conceptual Framework of Systems

A system is mathematically defined as an operator {a transformation rule} that maps an input excitation signal or to a unique output response signal or .

graph LR
    Input["x(t) / x[n] <br> (Excitation / Independent Variable)"] --> System["System Operator <br> <b>T[·]</b>"]
    System --> Output["y(t) / y[n] <br> (Response / Dependent Variable)"]
    style System fill:#2a9d8f,stroke:#1e6059,stroke-width:2px,color:#fff

To prevent cognitive overload, let’s break down the basic classifications of system behaviors before jumping into algebraic proofs.

Terminology & Concept Breakdown

  • Excitation: The external input signal applied to a system to drive its state.
  • Response: The resulting output signal generated by the system as a direct consequence of the excitation.
  • Memory (State): The system’s capacity to store energy or data, allowing its current output to be influenced by past or future excitations.
  • Canonic System: A system designed with the absolute minimum number of memory storage components (e.g., integrators or delays).

2. Basic System Classifications & Properties

2.1 Memoryless vs. Dynamic (Memory) Systems

  • Memoryless (Static) System: The current output at any instant depends strictly on the input at that same instant . It contains no energy-storage elements (like capacitors or inductors).
    • LTI Characterization: A continuous-time LTI system is memoryless if and only if its impulse response is a scaled impulse:
  • Dynamic (Memory) System: The current output depends on present inputs as well as past or future inputs. These systems contain energy-storage elements.
    • Examples: Integrators, differentiators, capacitors, inductors, and unit delays.

2.2 Causal, Non-Causal, and Anticausal Systems

This property dictates whether a system is physically realizable {buildable in the real world using physical components}.

graph TD
    SystemC["System Causality Classifications"] --> Causal["Causal <br> (Real-world buildable)"]
    SystemC --> NonCausal["Non-Causal <br> (Theoretical / Offline)"]
    SystemC --> Anticausal["Anticausal <br> (Strictly future-dependent)"]

    Causal --> CDef["Depends on: <br> Present & Past inputs <br> <i>y(t) = x(t) + x(t-1)</i>"]
    NonCausal --> NDef["Depends on: <br> Future inputs as well <br> <i>y(t) = x(t+1) + x(t-1)</i>"]
    Anticausal --> ADef["Depends on: <br> Strictly future inputs <br> <i>y(t) = x(t+2)</i>"]
  • Causal System: The output at any time depends strictly on the present and/or past values of the input, never on future values.
    • Mathematical Condition: is independent of for all .
    • LTI Impulse Response Boundary: A continuous LTI system is causal if and only if:
  • Non-Causal System: The output depends on future values of the input. These can only be implemented in offline processing {processing recorded data stored in a database}.
  • Anticausal System: The output depends strictly on the future values of the input.
    • LTI Impulse Response Boundary: for all .

2.3 Invertible vs. Non-Invertible Systems

  • Invertible System: A system where distinct inputs produce distinct outputs. An inverse system can be cascaded with the original system to perfectly recover the input signal :
  • Non-Invertible System: Multiple distinct inputs map to the same output (e.g., , where both yield ). The original input cannot be uniquely recovered.

3. The Linearity Test (Superposition & Homogeneity)

To prove a system is linear, it must simultaneously satisfy the Additive (superposition) property and the Homogeneous (scaling) property.

graph TD
    LTest["Linearity Check (Superposition)"] --> Add["1. Additivity Test <br> T[x_1(t) + x_2(t)] = T[x_1(t)] + T[x_2(t)]"]
    LTest --> Hom["2. Homogeneity Test <br> T[a·x_1(t)] = a·T[x_1(t)]"]
    Add --> Combined["Unified Superposition Condition: <br> T[a·x_1(t) + b·x_2(t)] = a·y_1(t) + b·y_2(t)"]
    Hom --> Combined

Step-by-Step Algebraic Verification Template:

  1. Define two distinct inputs and which produce outputs and .
  2. Construct a weighted linear combination of these inputs:
  3. Evaluate the system’s output due to this combined input:
  4. Compare with the weighted combination of the individual outputs:
    • If , the system is Linear.
    • If , the system is Non-linear.

The Zero-Input Linearity Hack

A necessary (but not sufficient) condition for a system to be linear is that a zero input must yield a zero output. If evaluating the system with results in a non-zero output, the system is immediately Non-linear (e.g., when ).


4. The Time-Invariance Test

A system is time-invariant {shift-invariant} if the behavioral characteristics of the system are constant over time. A delay or advance in the input signal must produce an identical shift in the output signal.

Step-by-Step Algebraic Verification Template:

To prevent shift-scale confusion, always use this rigid two-pathway comparison:

                 PATHWAY 1: Delay the Input, then pass through System
Input x(t) ------------> Delay by t_0 ------> x(t - t_0) ------> [ System ] ------> y_1(t) = T[x(t - t_0)]
 
                 PATHWAY 2: Pass through System, then delay the Output
Input x(t) ------------> [ System ] --------> y(t) ------------> Delay by t_0 ------> y_2(t) = y(t - t_0)
  1. Pathway 1 (System output due to shifted input): Evaluate the system response by replacing every instance of in the system equation with a delayed version :
  2. Pathway 2 (Shifted system output): Take the original output equation and delay the entire signal by replacing every instance of the independent variable with :
  3. Compare:
    • If , the system is Time-Invariant.
    • If , the system is Time-Variant.

The Variable Coefficient Trap

If the independent variable appears as an explicit multiplier or coefficient outside the input bracket (e.g., ), Pathway 2 will shift that coefficient while Pathway 1 will not. This makes the system Time-Variant.


5. Standard Core Solved Numericals

5.1 Case Study: [PYQ: 2025, 2022]

Determine if this system is Linear and Time-Invariant.

1. Linearity Proof:

  • Let and .
  • Apply combined input :
  • Result: The system is Linear.

2. Time-Invariance Check:

  • Pathway 1: Shift the input signal .
  • Pathway 2: Shift the output signal .
  • Compare: because .
  • Result: The system is Time-Variant.

5.2 Case Study: [PYQ: 2022]

Determine if this system is Linear.

  • Let input yield output satisfying: .
  • Let input yield output satisfying: .
  • Let input be . The system output must satisfy:
  • Evaluate the target response :
  • Since the RHS of the actual combined response equation contains squared parameters () and cross-terms () which do not equal the target response RHS, .
  • Result: The system is Non-linear.

5.3 Case Study: [HW / Lab]

Determine if this discrete-time system is Linear and Time-Invariant.

1. Linearity Proof:

  • Let .
  • Let .
  • Apply combined input :
  • Squaring both sides shows: .
  • Since the scaled superposition holds perfectly in amplitude, the system is Linear. (Note: This verifies the senior’s lab note checklist stating behaves as a linear system under amplitude transformation).

2. Time-Invariance Check:

  • Pathway 1 (Shifted input): .
  • Pathway 2 (Shifted output): .
  • Compare: due to the un-shifted time multiplier coefficient on Pathway 1.
  • Result: The system is Time-Variant.

6. BIBO Stability & Absolute Integrability Derivation

A system is defined as Bounded-Input Bounded-Output (BIBO) stable if every bounded input signal applied to it produces a bounded output response.

🚨 MANDATORY DERIVATION: Sufficient and Necessary Stability Bound [PYQ: 2017, 2015]

Prove that a continuous-time LTI system is BIBO stable if and only if its impulse response is absolutely integrable.

Step 0: Setup and Definitions

An input signal is bounded such that for all . The output of a continuous LTI system is governed by the continuous convolution integral:

Step 1: Upper Bound Expansion (Sufficiency Proof)

Take the absolute value of the output :

Apply the integral triangle inequality property {the absolute value of an integral is less than or equal to the integral of the absolute value}:

Step 2: Substitute the Input Bound

Since for all , we can substitute this bound into the inequality:

For to hold (ensuring the output is bounded), the integral must evaluate to a finite value:

Step 3: Necessity Proof

To prove this condition is also necessary, we must show that if the integral is infinite, we can construct a bounded input that forces the output to blow up to infinity. Let the bounded input signal be defined as the sign-reversal of the shifted impulse response: Note that this input is strictly bounded: . Evaluate the system output at the origin (): If , then , meaning a bounded input has produced an infinite output. Thus, absolute integrability is a necessary condition.


7. Core Solved Stability Traps

7.1 Stability check of [PYQ: 2020, 2019]

  • Let the input sequence be bounded: for all .
  • Evaluate the absolute boundary of the output sequence:
  • Apply the triangle inequality:
  • Substitute the bound :
  • Since and are finite system constants, is a finite value.
  • Result: The system is BIBO Stable.

7.2 Stability check of

  • Evaluate the absolute integrability integral:
  • Since the integral yields a finite value (), the system is stable.
  • Result: The system is BIBO Stable.

Common Mistakes That Cost Marks

  • Applying Shift to Coefficients: When checking time-invariance for systems like , students often write Pathway 1 as . This is incorrect. In Pathway 1, only the input signal is delayed, yielding .
  • Flipping Signs in Reversal Shifting: For the system , Pathway 1 (shifted input) is . Pathway 2 (shifted output) is . Mixing up these signs is the #1 reason students lose marks in time-invariance proofs.
  • Causality Boundary Confusion: For the system , students often assume it is causal because . However, we must test for all real time. At , , which depends on past data. But at , , which depends on future data. Thus, the system is Non-Causal.

PYQ Bank — Verbatim Questions & Answer Plans

Q1: Linearity and Time-Invariance check of

  • Metadata: Type: Analytical Proof | Years: 2025, 2022 | Marks: 10/08 | Frequency: ⭐⭐⭐⭐⭐
  • Answer Plan:
    1. Perform the linearity proof using the weighted combined input . Show that .
    2. Perform the time-invariance check using Pathway 1 and Pathway 2. Explicitly show the sign difference ( vs. ) to prove the system is time-variant.

Q2: Derive the Necessary and Sufficient Condition for BIBO Stability of an LTI system

  • Metadata: Type: Mathematical Derivation | Years: 2017, 2015 | Marks: 12/10 | Frequency: ⭐⭐⭐⭐
  • Answer Plan:
    1. Define bounded input and express output using the continuous convolution integral.
    2. Apply the integral triangle inequality to prove the sufficiency condition ().
    3. Set up the necessity proof by defining the bounded test input to show the system output blows up if the absolute integrability integral is infinite.

Q3: System parameter evaluation of

  • Metadata: Type: Discrete System Proof | Years: 2024, 2019 | Marks: 15/12 | Frequency: ⭐⭐⭐⭐⭐
  • Answer Plan:
    1. Test Linearity: The difference equation contains only first-power scaling terms of and with no added offsets. Superposition holds Linear.
    2. Test Time-Invariance: The coefficient multiplier term depends explicitly on time Time-Variant.
    3. Test Causality: The term depends on a future input sample at index Non-Causal.

Self-Check Before Moving On

  • Can you prove why is non-linear using the zero-input test?
  • Do you know the exact algebraic steps to prove why is time-variant?
  • Can you write out the complete sufficiency and necessity steps for the LTI BIBO stability derivation on a blank sheet of paper?

Source: (k.Deergha Rao) signals and systems.pdf Section 2.2; 1 intro to Signal & systems.pdf Pages 15–18; ECE 2107 Past Term Examination Papers (2015-2025).


2.02 The Continuous Convolution Integral

Core Definition & Objective

For any continuous-time Linear Time-Invariant {LTI} system, the relationship between the input signal and the output response is completely governed by the system’s impulse response . This relationship is mathematically expressed by the Convolution Integral: This note focuses on the physical derivation of this integral, its mathematical properties, the step-by-step graphical sliding workflow, and analytical RC transient solutions.


1. Mathematical Derivation of the Convolution Integral

To understand why convolution works, we must look at how we can represent any arbitrary continuous-time signal as an infinite, dense sum of weighted and shifted unit impulses .

Step 0: Setup & Impulse Representation of

Let us approximate an arbitrary continuous-time signal by dividing it into narrow rectangular slices, each of width .

[GRAPH: A continuous curved signal x(t) approximated by a staircase-like grid of narrow rectangular pulses of width \Delta - source: Rabiul Sir Notes, Page 5]

Mathematically, a single narrow pulse at time with width and height can be represented as: where is a rectangular pulse of height and width centered at the origin.

As we let the slice width approach zero ():

  1. The discrete summation index transitions into a continuous variable of integration .
  2. The width step becomes an infinitesimal differential .
  3. The approximation pulse converges to the perfect Dirac delta function .
  4. The staircase approximation becomes the exact original signal .

This yields the sifting property representation {representing a signal as a continuous sweep of impulses}:


Step 1: Applying the LTI System Operator

Let represent the transformation operator of a system. Feeding the representation of into the system yields:

Because operates strictly on the independent time variable (and not on the integration dummy variable ), we can exploit the system’s Linearity properties (superposition and homogeneity) to slide the operator inside the integral:


Step 2: Incorporating Time-Invariance

By definition, the response of a system to a perfect unit impulse at the origin is its impulse response :

If the system is Time-Invariant {system characteristics do not change over time}, a shift in the input impulse by units must yield an identical shift in the output impulse response:

Substituting this back into our linearity equation yields the Convolution Integral:


2. Rigorous Proofs of Core Properties

2.1 Time Scaling Property

Theorem (Time Scaling in Convolution)

If , then: For , this proves the classic textbook relation: .

Step-by-Step Derivations:

Start with the standard definition of the scaled output :

We want to transform the integration variable so that the arguments of both and are scaled by . Let us substitute .

  • Case 1: (Integration limits remain to ):
  • Case 2: (Limits flip, and restoring them to normal order introduces a negative sign):

Combining both cases using the absolute value operator yields:


2.2 Even Symmetry of Convolved Odd Signals

Theorem (Convolution of Two Odd Signals)

If and are both purely odd signals, their convolved output is a purely even signal.

Step-by-Step Derivations:

By definition, odd signals satisfy and . Let us evaluate :

Substitute . The limits of integration flip from to :

Now, substitute the odd properties and into the integral:

Since this is the exact definition of :


3. Graphical Convolution: The Sliding Window Workflow

To convolve two piecewise signals graphically under exam time pressure, follow this rigid, error-proof sequence:

graph LR
    A[1. Re-map variables to tau] --> B[2. Fold h to h(-tau)]
    B --> C[3. Shift to h(t-tau)] --> D[4. Find boundary overlap intervals]
    D --> E[5. Integrate product for each interval]
    E --> F[6. Plot final output y(t)]

3.1 Graphical Piecewise Example

Question: Convolve the rectangular pulse with the symmetrical double-square impulse response .

[GRAPH: Waveform of input x(t) starting at t=1, ending at t=3, height 1. Waveform of h(t) showing positive pulse from t=-1 to t=1 (height 1) and negative pulse from t=1 to t=3 (height -1) - source: Rabiul Sir Notes, Page 14]

Step 1: Variable Mapping & Folding

Map both functions to the dummy integration variable :

  • is active for .
  • is folded around the y-axis, spanning from to .

[GRAPH: Folded impulse response h(-\tau) showing positive pulse from \tau=-1 to \tau=1, and negative pulse from \tau=-3 to \tau=-1 - source: Rabiul Sir Notes, Page 14]

Step 2: Shifting & Interval Sweeping

Slide from the far left (representing ) towards the right:

  • Interval 1 (): No Overlap The leading edge of (which is at ) has not reached the starting edge of (at ).

  • Interval 2 (): Partial Positive Overlap The positive lobe of slides into . The overlap region spans from to :

  • Interval 3 (): Full Positive & Partial Negative Overlap The positive lobe has fully entered, and the negative lobe (spanning from to ) begins overlapping .

  • Interval 4 (): Pure Negative Overlap The positive lobe has exited the boundaries of completely. Only the negative lobe overlaps, spanning from to :

  • Interval 5 (): No Overlap The trailing edge of (at ) has passed the trailing edge of (at ).

[GRAPH: The final convolved output y(t) showing a triangular positive peak of height 2 at t=2, dipping down to a negative peak of height -2 at t=4, and returning to zero at t=6 - source: Rabiul Sir Notes, Page 14]


4. High-Yield Analytical Solutions (RC Circuits)

4.1 Classical Low-Pass RC Transient Response

Standard Exam Problem (RC Step Transient)

An analog low-pass RC filter circuit has an impulse response . Find the output response when the input signal is .

[CIRCUIT: A classic analog low-pass RC network showing input voltage V_in(t), series resistor R, parallel capacitor C, and output voltage V_out(t) across the capacitor - source: Senior Notes]

Analytical Convolution Integration:

By definition:

Substitute the active step functions and into the limits of integration. The product is non-zero if and only if :

Factor out the terms that do not depend on the dummy integration variable :

[GRAPH: Transient response y(t) starting at zero, rising to a smooth peak of height 0.368 at t = RC, and slowly decaying towards zero for t > RC - source: Rabiul Sir Notes]


5. Common Mistakes That Cost Marks

The Critical Integration Limits Trap

  • The Mistake: Students often write down the default integration limits to on their exam scripts and integrate blindly, ignoring the step functions and .
  • The Correction: Always rewrite the step functions as limits of integration before doing calculus:
  • The Volts-unit Penalty: Failing to normalize exponential power coefficients (e.g. omitting the amplitude factor in RC networks) leads to a deduction of 2–3 marks.

6. Verbatim PYQ Bank

[PYQ 2025, 2022]

If , then show that . (12 Marks)

  • Answer Plan: Refer to Section 2.1 of this note. Use the coordinate transformation substitution to scale the dummy variable and factor out the amplitude multiplier of 2.

[PYQ 2021]

Determine the output response of a low-pass RC network for an input signal . (10 Marks)

  • Answer Plan: Refer to Section 4.1. Set up the KVL impulse response , convolve it with , and show how the exponential terms cancel out inside the integral to leave a linear ramp term .

[PYQ 2016]

Determine the output response of the RC low-pass network due to an input by convolution. (12 Marks)

  • Answer Plan: Set up the convolution integral with limits from to :

7. Self-Check Before Moving On

  • Can you derive the continuous-time convolution integral from first principles (impulse representation)?
  • Can you prove why convolving two odd functions yields an even function?
  • Do you know how to graphically convolve piecewise rectangular and triangular waveforms without losing track of active interval limits?

Sources:

  • K. Deergha Rao, “Signals and Systems”, Section 2.3 (The Convolution Integral).
  • Rabiul Sir Continuous-Time Lecture Handnotes (Pages 14–15).
  • University Past Year Papers (2016, 2021, 2022, 2025).

Related Concepts: 2.01 Systems Classification, LTI Properties & Stability | 2.02 The Continuous Convolution Integral | 2.04 Systems Described by Differential & Difference Equations

2.03 Properties of the Convolution Integral

Core Theorem Overview

Convolution {the mathematical folding, shifting, and integrating of two signals} is not just a blind computational tool; it behaves like a standard algebraic product. By utilizing the algebraic properties of convolution—namely the Commutative, Distributive, Associative, and Impulse-Shifting properties—we can bypass complex integrations entirely and solve cascaded or parallel LTI networks instantly.


1. The Commutative Property

Alright — let’s start with a highly comforting fact: the order in which you convolve two signals does not matter. The system’s output remains identical whether you fold-and-shift the input signal or the system’s impulse response .

Mathematically, this is stated as:

This is incredibly high-signal for exams! If you are convolving a simple rectangular pulse with a complex decaying exponential, the commutative property lets you choose the simpler function to fold and shift, saving you valuable time and reducing algebraic errors.

Step-by-Step Derivation

Let’s prove this formally using a classic change of variables.

Step 0: Setup and Definition

Start with the standard definition of the continuous convolution integral:

Step 1: Change of Variables

We want to swap the arguments of our functions. Let us define a new dummy integration variable, :

Step 2: Evaluate Limits and Differentials

Now, find the differential by differentiating both sides with respect to :

Next, transform the limits of integration from to :

  • When , then .
  • When , then .

Step 3: Substitute and Simplify

Substitute these variables back into our original integral setup:

We can use the negative sign of the differential to flip the integration limits back to their standard order:

Since is just a dummy variable {a temporary variable name used strictly for the duration of the integration}, we can rename it back to :


2. The Distributive and Associative Properties

These two properties allow us to analyze interconnected LTI networks by simplifying parallel and cascaded systems into a single equivalent impulse response block.

2.1 The Distributive Property (Parallel Systems)

Convolution is distributive over addition:

Physical Significance

This property describes Parallel System Interconnections. If an input signal is applied simultaneously to two parallel LTI subsystems with impulse responses and , the overall system’s impulse response is simply the sum of the individual impulse responses:

          +--------+
     +--->| h1(t)  |---+
     |    +--------+   |
x(t)-+                 v  (+)---> y(t)
     |    +--------+   ^
     +--->| h2(t)  |---+
          +--------+

2.2 The Associative Property (Cascaded Systems)

Convolution is associative:

Physical Significance

This property describes Cascaded System Interconnections. If a signal passes through subsystem and its output immediately feeds into subsystem , the overall cascaded system behaves as a single block with an equivalent impulse response:

x(t) ---> [ h1(t) ] ---> y1(t) ---> [ h2(t) ] ---> y(t)
                   Equivalently:
x(t) --------------> [ h1(t) * h2(t) ] -------------> y(t)

By the commutative property, we can swap the order of blocks in a cascade without changing the output:


3. Convolution with an Impulse ()

Convolution with a unit impulse behaves exactly like multiplication by 1 in standard algebra. The impulse acts as an identity operator under convolution.

Mathematically, this is expressed as:

Step-by-Step Derivation

Let’s prove this using the sifting property {the mathematical ability of the Dirac delta function to select a single, discrete value of a signal when integrated}.

Step 0: Setup and Definition

Apply the standard convolution integral definition:

Step 1: Utilize the Sifting Property

The impulse function is active {non-zero} only at the single point where its argument becomes zero:

Step 2: Evaluate the Integral

Because the impulse is zero everywhere except at , the integral evaluates directly to the value of the function at that specific point:


4. The Time-Delay Shifting Property

This property is a massive, high-yield shortcut for your continuous-time signal examinations! It states that convolving two shifted signals simply shifts the final convolved output by the sum of their individual delays.

The Time-Delay Shifting Theorem

If we know that: Then convolving their delayed versions yields:

Step-by-Step Derivation

Let’s prove this mathematically.

Step 1: Setup the Convolution of Shifted Inputs

Using the convolution integral definition, let’s write out the left-hand side of our equation:

Step 2: Define a Variable Substitution

To align this with our standard convolution form, let’s substitute the argument of our first function:

The limits of integration remain unchanged at and .

Step 3: Substitute and Simplify the Integral

Substitute these variables back into our shifted integral expression:

Step 4: Map to the Base Convolution

Notice that the resulting integral is identical to the definition of , except that the time variable has been replaced by .

Therefore:


5. High-Yield Worked Numerical

Let’s see how we can use these algebraic properties to solve complex, piecewise exam problems in seconds without doing any calculus.

Worked Exam Problem

Find the output of an LTI system with impulse response when the input signal is .

Step-by-Step Solution

Step 1: Write down the Algebraic Expression

Using the distributive and commutative properties, we can write the overall convolution as:

Distribute the terms:

Step 2: Apply the Shifting Property of the Impulse

We know that convolving any signal with a shifted impulse simply shifts the signal by :

Let’s apply this to our two distributed terms:

  1. First term:
  2. Second term:

Step 3: Combine and Write the Final Expression

Combine the terms to get our final output:

By using convolution properties, we solved a complex, multi-interval piecewise problem with zero calculus integrations!

[GRAPH: x-y axis plotting y(t). It is 0 for t < 3. It jumps to amplitude 4 at t = 3, stays at 4 until t = 5, where it drops to 0. It stays at 0 until t = 6, where it jumps to amplitude 2, stays at 2 until t = 8, and drops back to 0 for all t > 8.]


Common Mistakes That Cost Marks

Critical Exam Pitfalls

  • The Time-Scaling Phase Trap: Remember that the time-scaling property introduces a scaling amplitude multiplier: . Forgetting the factor when compressing or expanding a convolved signal is a very common source of lost marks.
  • Applying Shifting to the Wrong Variable during Integration: In the proof of commutative property, when substituting , remember that the differential is with respect to (meaning , so ). Treating as a variable instead of a constant parameter during integration will ruin the entire proof.

PYQ Bank — Verbatim Questions & Answer Plans

[PYQ 2025] [12 Marks]

  • Question: If , then show that .
  • Answer Plan:
    1. Write out the basic convolution integral for .
    2. Set up the variable substitution to scale the dummy variable.
    3. Compute and substitute it into the integral.
    4. Extract the scaling factor of 2 outside the integral to prove the theorem.

[PYQ 2021] [10 Marks]

  • Question: Prove the time-shifting property of convolution: .
  • Answer Plan:
    1. Follow the 4-step proof outlined in Section 4 of this note verbatim.
    2. Include a brief physical explanation of how delay in system blocks accumulates.

Self-Check Before Moving On

  • Can you derive the commutative property of convolution from scratch?
  • Do you understand how parallel and cascaded LTI systems map to the distributive and associative properties?
  • Can you apply the time-delay shifting property to solve delta-convolution numericals rapidly?

Source: (k.Deergha Rao) signals and systems.pdf Section 2.3.1


Related Concepts: 2.01 Systems Classification, LTI Properties & Stability, 2.02 The Continuous Convolution Integral, 2.03 Properties of the Convolution Integral, 2.05 Block-Diagram Representations & System Interconnections


2.04 Systems Described by Differential & Difference Equations

1. The Classical Modeling Paradigm

Alright — today we are diving into the mathematical engine room of LTI systems. Up until now, we’ve treated systems as “black boxes” represented by their impulse response or . But how do we model the physical reality of circuits containing inductors, capacitors, or discrete digital feedback loops?

We use Linear Constant-Coefficient Differential Equations (LCCDEs) for continuous-time systems and Linear Constant-Coefficient Difference Equations for discrete-time systems. These models are the mathematical bedrock of physical engineering.


2. Time-Domain Solutions of Continuous LCCDEs

A general -th order continuous-time system is modeled by the differential equation:

To find the output response for a given input , classical time-domain analysis splits the solution into two distinct parts:

A. The Homogeneous (Complementary) Solution,

The homogeneous solution {the natural response of the system representing its behavior without any external excitation} is found by setting the input :

To solve this, we assume a trial solution of the form . Substituting this trial solution yields the characteristic equation:

Solving this polynomial gives the characteristic roots (or system eigenvalues) . The form of depends entirely on the nature of these roots:

  1. Distinct Real Roots ():
  2. Repeated Real Roots ( with multiplicity ):
  3. Complex Conjugate Pairs ():

Physical Meaning of Roots

The real part of the characteristic roots dictates the damping of the natural response. If , the natural response decays exponentially, representing a stable physical system. The imaginary part dictates the frequency of natural oscillations.


B. The Particular Solution,

The particular solution {the forced response of the system representing its behavior driven entirely by the input signal} satisfies the differential equation for the given input . We find using the Method of Undetermined Coefficients by matching the mathematical form of the input :

Input Shape Assumed Particular Solution
Constant: (Constant)
Exponential: (provided is not a characteristic root)
Polynomial:
Sinusoidal:

3. Step-by-Step Continuous Numerical Solution

Let’s apply this classical pipeline to solve a standard exam-scoring continuous-time system.

Continuous-Time Step and Impulse Responses

Question: Consider the continuous LTI system described by the first-order differential equation: Determine the Step Response and the Impulse Response of this system, assuming the system is initially relaxed ( at ).

Part I: Solving for the Step Response,

For the step response, the input is . We analyze the system for , where .

Step 1: Find the Homogeneous Solution,

Set the right-hand side of the differential equation to zero: Assume . The characteristic equation is: Thus, the homogeneous solution is:

Step 2: Find the Particular Solution,

Since the input for is a constant (), we assume a constant particular solution: Substitute into our governing differential equation: Thus, our particular solution is:

Step 3: Combine and Apply Initial Conditions

The total response is the sum of the homogeneous and particular responses:

Now, we apply the initial condition to find the undetermined constant :

Substituting back into our total response yields our step response:

[GRAPH: Step response curve y(t) rising exponentially from 0 at t=0 and asymptotically flattening toward 1 as t approaches infinity. — governing equation: y(t) = (1 - e^-t)u(t) — source: Rabiul Sir Notes, Lec 6]


Part II: Solving for the Impulse Response,

The impulse response is the system output when the input is a unit impulse . Since a unit impulse is the derivative of a unit step , and the system is linear and time-invariant, the impulse response is the time derivative of the step response:

Applying the product rule of calculus:

Since the term evaluated at the impulse location is exactly zero, the second term vanishes completely:

[GRAPH: Impulse response curve h(t) starting abruptly at a peak of 1 at t=0 and decaying exponentially toward 0 as t approaches infinity. — governing equation: h(t) = e^-t * u(t) — source: Rabiul Sir Notes, Lec 6]


4. Time-Domain Solutions of Discrete Difference Equations

A discrete-time LTI system of order is represented by the difference equation:

Just like its continuous counterpart, we solve this classical recurrence relation by decomposing it:

A. The Discrete Homogeneous Solution,

We set and assume a trial solution of the form . Substituting this trial form gives the discrete characteristic equation:

Solving for the roots determines the shape of :

  1. Distinct Roots:
  2. Repeated Roots:

Discrete Stability Condition

For a discrete system to be stable, the natural response must decay over time as . This requires the magnitude of all characteristic roots to be strictly less than unity (). On the complex z-plane, this means all poles must lie inside the unit circle.

B. The Discrete Particular Solution,

The trial particular solution matches the discrete shape of the input :

Input Shape Assumed Particular Solution
Constant: (Constant)
Exponential: (provided is not a characteristic root)
Polynomial:

5. Step-by-Step Discrete Numerical Solution

Let’s tackle a highly-tested discrete recurrence problem featuring initial conditions.

Discrete Second-Order Difference Equation

Question: Solve the second-order recursive discrete system described by: with step input , and initial auxiliary conditions {conditions specifying the starting state of the system’s memory delay buffers} given as and .

Step 1: Establish the Homogeneous Solution,

Set the right-hand side of our difference equation to zero: Assume . The characteristic polynomial equation is: Thus, our homogeneous solution has the form:

Step 2: Establish the Particular Solution,

Our input is the step function , meaning . For , the input is a constant (), so we assume a constant trial particular solution: Substitute into our difference equation for : Thus, our particular solution is:

Step 3: Compute Discrete Boundary States via Recursion

To apply our initial values to find and , we need the system output states at and . We calculate these directly using the system difference equation and the given initial conditions , .

  • For : Since step in negative time:

  • For : Since step :

Step 4: Combine and Solve for Coefficients

Our total response is modeled as:

Now we apply our calculated boundary states and to set up a system of linear equations:

  1. At :

  2. At :

Substitute into the equation:

Since , we find:

Step 5: Final Total Solution

Substituting our solved constants back into our equation yields our final complete response:


6. Natural vs. Forced Response (An Critical Distinction)

In exams, students often confuse the classical homogeneous/particular split with the physical Natural/Forced split. They are not the same!

graph TD
    TR[Total Solution Response] --> HS_PS[Method 1: Homogeneous + Particular]
    TR --> NR_FR[Method 2: Natural + Forced]
    
    HS_PS --> HS[Homogeneous Response]
    HS_PS --> PS[Particular Response]
    
    NR_FR --> NR[Natural/Zero-Input Response]
    NR_FR --> FR[Forced/Zero-State Response]
    
    style TR fill:#f9f,stroke:#333,stroke-width:2px
    style HS_PS fill:#bbf,stroke:#333
    style NR_FR fill:#bfb,stroke:#333
  1. Natural Response (Zero-Input Response, ): The system response due only to initial conditions, setting the input .
  2. Forced Response (Zero-State Response, ): The system response due only to the input , setting all initial conditions to zero.

7. ECE 2108 Laboratory Connection

In Experiment 03 of your lab, you will model these continuous differential equations and discrete systems using MATLAB:

% Continuous system simulation
num = [1]; den = [1, 1];          % Represents dy/dt + y = x
sys = tf(num, den);
step(sys);                       % Plots the step response
 
% Discrete recurrence simulation using filter
b = [0, 1]; a = [1, 0, -1/9];     % Represents y[n] - 1/9 y[n-2] = x[n-1]
x = ones(1, 20);                  % Step input array
y = filter(b, a, x);              % Computes recursive response
stem(y);                         % Plots discrete stems

Common Mistakes That Cost Marks

Exam Pitfall Checklist

  1. Applying Initial Conditions Too Early: This is the #1 source of lost marks in difference/differential equation questions! Students frequently apply initial conditions to the homogeneous solution before adding the particular solution . Always apply initial conditions to the total combined response .
  2. Ignoring the Duplicate Root Trap: If the input signal matches one of your characteristic roots, your standard particular trial solution will fail. For example, if your characteristic root is and your input is , your particular trial solution cannot be (as it is already absorbed by the homogeneous solution). You must multiply the trial solution by the independent variable: .
  3. Using the Wrong Auxiliary Limits: For continuous-time systems, remember that physical variables (like current through an inductor or voltage across a capacitor) cannot change instantaneously. Thus, boundary states at are equated to states at . For discrete systems, compute recursively from the delay terms.

PYQ Bank — Verbatim Questions & Answer Plans

Q1: Continuous System Representation [10 Marks] [PYQ 2024]

Represent the following differential equation in a state model:

  • Answer Plan:
    1. Define state variables based on the phase-variable method: , , .
    2. Write the derivatives of the state variables: , , and .
    3. Express the equations in matrix form and .

Q2: System Realization and Real-World Traps [15 Marks] [PYQ 2018]

Determine the output of the system described by: where , and initial conditions are given as .

  • Answer Plan:
    1. Find the homogeneous solution .
    2. Note that the input is , meaning . For , the input is 1, so particular solution .
    3. Compute boundary outputs and using recursive equations from the difference relation.
    4. Combine homogeneous and particular solutions, and solve for constants and using the boundary states.

Self-Check Before Moving On

  • Can you explain the physical difference between the homogeneous response and the particular response?
  • Do you know how to identify and avoid the “duplicate root particular solution trap”?
  • Can you solve a first-order continuous differential equation step-by-step for a unit step input?
  • Can you recursively calculate discrete output states and given arbitrary past initial conditions and ?

Source: (K. Deergha Rao) Signals and Systems, Chapter 2 & 6; Rabiul Sir class notes, Lecture 7 & 8.


2.05 Block-Diagram Representations & System Interconnections

[!abstract] Block-Diagram Realization A graphical representation mapping the algebraic relations of linear constant-coefficient differential equations (LCCDEs) or difference equations into elementary physical hardware blocks. It serves as the physical bridge between abstract time-domain equations and practical analog circuit computer simulations {using operational amplifiers} or digital signal processing (DSP) hardware chips {using registers and adders}.


1. Basic Building Blocks of LTI Systems

Before drawing system architectures, we must master the standard graphical symbols. These blocks are the elementary operations we perform on signals in analog and digital domains.

1.1 Continuous-Time (CT) Realization Blocks

Continuous-time systems are physically built using operational amplifiers (op-amps), resistors, and capacitors. The three fundamental building blocks are:

ElementAlgebraic RelationGraphical representation (ASCII)Physical Implementation
CT Integratorx(t) ----> [ 1/s ] ----> y(t)Op-amp integrator circuit with capacitor feedback
CT Adderx1(t) ----\
( + ) ----> y(t)
x2(t) ----/
Op-amp summing amplifier circuit
CT Multiplierx(t) ----> ( c ) ----> y(t)Op-amp inverting/non-inverting amplifier with gain

1.2 Discrete-Time (DT) Realization Blocks

Discrete-time systems do not use capacitors or integration. Instead, they operate on digital clock cycles using registers, logic adders, and multipliers:

ElementAlgebraic RelationGraphical representation (ASCII)Physical Implementation
DT Unit Delayx[n] ----> [ z^-1 ] ----> y[n]Digital register / flip-flop clocked delay element
DT Adderx1[n] ----\
( + ) ----> y[n]
x2[n] ----/
Logic adder circuit
DT Multiplierx[n] ----> ( c ) ----> y[n]Digital hardware multiplier circuit

2. Realization of Continuous-Time Systems (LCCDEs)

For a general -th order continuous-time linear constant-coefficient differential equation:

To draw the block diagram, we must solve for the highest-order derivative of the output, , by isolating it on the left-hand side:

The Division Trap (Rabiul Sir's Lab Warning)

Always check if the coefficient of the highest-order derivative of the output, , is equal to 1. If , you must divide every single coefficient in the equation by before drawing! Forgetting this division is the #1 source of lost marks in both the exam and the lab [Rabiul Sir Class Note].


2.1 Direct Form I Realization (Non-Canonic)

Direct Form I represents a literal translation of the differential equation. It realizes the input operations (feedforward zeros) first, followed by the output operations (feedback poles) in series:

Input x(t) ---> [ Feedforward zeros (System 1) ] ---> [ Feedback poles (System 2) ] ---> Output y(t)

  • Characteristics: It keeps the input and output scaling operations completely independent.
  • Drawback: For an -th order system, it requires integrators, which is hardware-inefficient.

2.2 Direct Form II Realization (Canonic)

Direct Form II is obtained by reversing the order of the cascaded subsystems: realizing the feedback poles first, followed by the feedforward zeros:

Input x(t) ---> [ Feedback poles (System 2) ] ---> [ Feedforward zeros (System 1) ] ---> Output y(t)

By swapping the cascade order, the intermediate state nodes are identical. We can merge the parallel branches, sharing the exact same integrators down the center column of the diagram!

  • Canonic Property: A system realization is called canonic if it uses the absolute minimum number of integrators/delays possible, which is exactly equal to the system order, [Textbook Sec 2.6].
  • Hardware Savings: Direct Form II cuts the required number of integrators exactly in half!

3. Realization of Discrete-Time Systems (Difference Equations)

In the discrete-time domain, the difference equation relates input and output sequences:

Assuming , we solve for the present output :

3.1 Discrete Direct Form I

Realizes the delay lines for the input sequence and output sequence on separate delay paths.

3.2 Discrete Direct Form II (Canonic)

Creates a single center delay line using an intermediate digital state sequence :

  • Structure:
    • Left-hand side (Feedback): Feeds back delayed states of multiplied by negated coefficients into the main summing junction.
    • Right-hand side (Feedforward): Feeds forward delayed states of multiplied by coefficients into the output summing junction.

4. Step-by-Step Solved Numericals

📝 Numerical 1: Continuous-Time Realization (KUET 2024, 2022)

Question: Obtain the block-diagram representation of a continuous-time system described by:

Step-by-Step Solution:

Step 1: Check and identify coefficients The highest derivative coefficient is . The system order is .

  • Output coefficients: , .
  • Input coefficients: , , .

Step 2: Set up the intermediate feedback equation Define the intermediate state variable in the s-domain or time-domain:

Step 3: Set up the output feedforward equation

Step 4: Draw the Direct Form II Block Diagram We cascade two CT integrators down the center to generate from , and from .

               Input x(t)
                   |
                   v
               +-------+
       +-----> |   +   | <----------------+
       |       +-------+                  |
       |           | \                    |
       |           |  \                   |
       |           v   \ ( b0 = 1 )       |
       |      ddot w(t) \                 |
       |           |     v                |
       |        [ 1/s ] --->( + )         |
       |           |         ^            |
       |           v         |            | ( -a2 = -1 )
       | ( -a1 = -2 )        |            |
       +<----( -2 )+--dot w(t)            |
       |           |         |            |
       |           |   ( b1 = -1 )        |
       |           v         |            |
       |        [ 1/s ] ---->+            |
       |           |         |            |
       |           v         v            |
       +<----( -1 )+--- w(t)              |
                   |                      |
                   +------>( -6 )-------->+-----> Output y(t)
                         ( b2 = -6 )

📝 Numerical 2: Discrete-Time Realization with “Trap” Coefficients (KUET 2025, 2019)

Question: Draw the canonic Direct Form II realization for the system described by the difference equation:

Step-by-Step Solution:

Step 1: Identify coefficients and system order The highest delay is 3, so system order is . This requires exactly 3 delay elements () for canonic realization.

  • Output coefficients: , , , . (Note: is a trap!)
  • Input coefficients: , , , . (Note: Only is non-zero, another trap!)

Step 2: Formulate the canonic node equations

Step 3: Draw the Direct Form II realization We lay out three delays in series down the center. Because , we omit the feedback multiplier tap at the second delay stage. Because , we do not tap those nodes for the output sum; the output is taken directly from the output of the first delay node !

               Input x[n]
                   |
                   v
               +-------+
               |   +   | <-------------------------+
               +-------+                           |
                   |                               |
                   v w[n]                          |
               +-------+                           |
               |  z^-1 |                           |
               +-------+                           |
                   |---- w[n-1] ------------------>+-----> Output y[n]
                   |             \ (b1 = 1)        |
                   v              v                | ( -a3 = -1/5 )
             ( -a1 = -1/3 )      ( + )             |
       +<----( -1/3 )              ^               |
       |                           |               |
       |           |               | (b2 = 0)      |
       |           v               |               |
       |       +-------+           |               |
       |       |  z^-1 |           |               |
       |       +-------+           |               |
       |           |               |               |
       |           v w[n-2] -------+               |
       |           |                               |
       |           v                               |
       |       +-------+                           |
       |       |  z^-1 |                           |
       |       +-------+                           |
       |           |---- w[n-3]                    |
       |           |                               |
       +<----------+------( -1/5 )---------------->+

5. System Interconnections

LTI systems are connected in multi-block structures. We analyze their combined behavior using mathematical operators:

graph LR
    subgraph Cascade Connection
    c_in[x] --> c_h1[h1] --> c_mid[w] --> c_h2[h2] --> c_out[y]
    end
    
    subgraph Parallel Connection
    p_in[x] --> p_h1[h1] --> p_add((+))
    p_in --> p_h2[h2] --> p_add --> p_out[y]
    end

5.1 Cascade (Series) Connection

  • Time-Domain Impulse Response: The overall impulse response is the convolution of individual impulse responses:
  • Laplace/Z-Domain Transfer Function: Corresponds to algebraic multiplication of their individual transfer functions:
  • Commutative Benefit: Because convolution is commutative, the order of blocks in a cascade does not affect the overall LTI system response.

5.2 Parallel Connection

  • Time-Domain Impulse Response: The overall impulse response is the algebraic sum of individual impulse responses:
  • Laplace/Z-Domain Transfer Function: Corresponds to the sum of their transfer functions:

6. Obsidian Desmos Visualization: Integrator & Delay Magnitude Response

To understand how cascading blocks impacts system gain (like low-pass filtering), view the frequency magnitude responses:

height=300; width=100%;
---
y = 1 / sqrt(1 + x^2) | GREEN | label: Single Stage RC
y = 1 / (1 + x^2) | BLUE | label: Cascaded 2-Stage RC

7. End-of-Note Master Review

⚠️ Common Mistakes That Cost Marks

  • The Feedback Sign Flip Trap: When moving from a difference equation to a block diagram, feedback coefficients are negated. For example, if the equation has , the multiplier block gain must be . If the equation has , the multiplier block gain is .
  • The Integrator-Delay Swap: Drawing continuous-time blocks (integrators ) when asked to realize discrete difference equations, or drawing delay registers for continuous differential equations.
  • Non-Canonic Bloat: Drawing a Direct Form I structure when the exam question explicitly asks for a canonic representation. Direct Form II is canonic; Direct Form I is not.

⚗️ ECE 2108 Lab Connection

In the ECE 2108 Laboratory, block realizations are modeled in MATLAB using state-space variables and the tf (transfer function) object commands:

% MATLAB script to define and test a transfer function block cascade
num1 = [1 -1 -6]; den1 = [1 2 1];
sys1 = tf(num1, den1); % Create system TF
is_stable = isstable(sys1); % Check system stability
bode(sys1); % Plot frequency magnitude and phase spectra

🔍 Verbatim PYQ Bank

KUET ECE 2107:

Draw the block diagram of the system described by: Answer Plan: Divide by highest derivative coefficient (). Note that , , , , . Draw Direct Form II center delay with shared integrators.

KUET ECE 2107:

Draw the block diagram for: Answer Plan: Refer directly to the fully solved Numerical 1 in Section 4.


🏆 Self-Check Before Moving On

  • Can you explain the exact difference between canonic (Direct Form II) and non-canonic (Direct Form I) realizations?
  • Do you remember to divide all coefficients by if ?
  • Can you trace the feedback paths and apply the correct sign negations?

References: (K. Deergha Rao) Signals and Systems, Ch 2, Pg 93–95; Rabiul Sir Lecture Notes, Lec 7, Pg 27–28; KUET ECE 2107 Past Papers (2025, 2024, 2022).