04 Chapter Map - The Sampling Theorem & Multi-Rate Processing
Chapter 4 Overview & Map of Content (MOC)
Nyquist boundaries, aperture effect sinc droops, zero-order holds, and multi-rate decimation/interpolation arrays.
📚 Study Notes Index
Read in order — each note assumes the previous one.
| # | Note | What it covers |
|---|---|---|
| 4.00 | 4.00 Sampling and Multi-Rate Processing Compact Review | Sampling Compact Review, Sampling Cheat Sheet |
| 4.01 | 4.01 The Shannon Nyquist Sampling Theorem | Sampling Theorem, Nyquist Rate, Sampling Proof |
| 4.02 | 4.02 Spectral Replications and Aliasing Dynamics | Aliasing Dynamics, Spectral Replications, Frequency Folding, Anti-Aliasing Filtering |
| 4.03 | 4.03 Ideal Natural and Flat-Top Sampling Techniques | Sampling Techniques, Flat-Top Sampling, Natural Sampling, Aperture Effect, Equalizer Filter |
| 4.04 | 4.04 Multi-Rate Signal Processing Decimation and Interpolati | Decimation, Interpolation, Up-sampling, Down-sampling, Multi-rate Processing |
🎯 Exam Weight
ECE 2107 Exam Relevance
Master the core derivations, mathematical definitions, and problem-solving techniques. Refer to ECE 2107 - Signals and Systems for syllabus boundaries and past year questions.
🔗 Related Resources
- Course Teaching Plan: ECE 2107 - Signals and Systems
- Previous chapter: 03 Chapter Map - State-Space Representation of CT Systems
- Next chapter: 05 Chapter Map - Analog Filter Design
Chapter 4: Sampling & Multi-Rate Processing — Compact Review
1. The Shannon-Nyquist Sampling Theorem
1.1 Theorem Statement and Fundamental Bounds
*(Target: Theory Descriptive / Numerical Solving)* [1.05, 4.01]
- Shannon-Nyquist Theorem: A continuous-time, band-limited analog signal containing no frequency components higher than Hz can be uniquely and perfectly reconstructed from its discrete samples if and only if the sampling frequency (samples/second) satisfies [1.05, 6.1.2]:
- Nyquist Rate (): The absolute minimum theoretical sampling rate to avoid overlap (aliasing) [1.05, 6.1.2]:
- Nyquist Interval (): The maximum allowable time duration between consecutive samples [1.05]:
- Band-Pass Sampling Theorem: For a band-pass signal with non-zero energy restricted to the frequency band , the minimum sampling rate to prevent aliasing is [6.1.2]:
1.2 Frequency-Domain Representation of Sampling (Spectral Replication)
*(Target: Mathematical Proof / 10-Mark Derivation)* [4.01]
- Mathematical Modeling: The sampled signal is modeled as the multiplication of the analog signal by an infinite periodic Dirac impulse train with period [6.1.1]:
- Frequency-Domain Spectrum: Multiplying in the time domain corresponds to convolving their respective Fourier transforms in the frequency domain, replicating the analog spectrum at integer multiples of the sampling angular frequency [4.01, 7.4]:
2. The Three Sampling Conditions
*(Target: Theory Descriptive / Spectral Diagrams)* [1.05, 4.02]
| Condition | Mathematical Criteria | Spectral Dynamics | Reconstruction Filter Requirement |
|---|---|---|---|
| Over-sampling | Adjacent spectral replications are separated by a guard band () [1.05]. | Practical, cheap low-pass filter with a gradual transition band [1.05]. | |
| Nyquist-rate sampling | Adjacent spectral replications touch exactly at their edges without overlapping [1.05]. | Ideal “brick-wall” low-pass filter with an infinite roll-off slope [1.05]. | |
| Under-sampling | Adjacent spectral replications overlap, causing aliasing (frequency folding) [1.05]. | Non-recoverable: Original signal cannot be reconstructed by any filter [1.05]. |
[GRAPH: Replicated frequency spectra showing: (1) Over-sampling (spectral copies separated by guard bands), (2) Nyquist sampling (copies exactly touching at f_max), and (3) Under-sampling (copies overlapping, highlighting shaded aliasing fold-over regions) — source: Ch 4.02 / Ch 7 Fig 7.12]
3. Aliasing Dynamics & Anti-Aliasing Filters
3.1 Aliasing Effect
*(Target: Theory Descriptive)* [1.05, 4.02]
- Definition: A destructive, irreversible frequency-folding distortion that occurs when an analog signal is under-sampled () [1.05, 6.1.2].
- Mechanism: High-frequency spectral components above the folding frequency (Nyquist frequency, ) fold back into the baseband spectrum and masquerade as false low-frequency components [1.05, 6.1.2].
3.2 Anti-Aliasing Filter
*(Target: Theory Descriptive)* [4.02]
- Definition: A high-order analog low-pass filter placed before the sampler (A/D converter) [1.05, 4.02].
- Function: It band-limits the input analog signal by stripping away all noise and frequency components higher than {the folding limit} before sampling occurs, ensuring the Nyquist criterion is strictly satisfied [1.05, 4.02].
4. Classification of Sampling Techniques
*(Target: Theory Descriptive / Structural Comparison)* [1.05, 4.03]
The physical switching implementation of sampling is divided into three distinct methodologies:
| Parameter / Feature | Ideal (Impulse) Sampling | Natural Sampling (Chopping) | Flat-Top Sampling (Sample & Hold) |
|---|---|---|---|
| Mathematical Multiplier | Infinite train of zero-width Dirac delta impulses: [1.05, 4.03]. | Periodic train of finite-width rectangular pulses of duration [1.05, 4.03]. | Sampled value held strictly constant over duration via capacitor [1.05, 4.03]. |
| Waveform Top Profile | Zero width, infinite height impulses [1.05]. | Tops of pulses follow the exact analog curve of [1.05, 141]. | Tops of pulses are perfectly flat, producing a staircase profile [1.05, 141]. |
| Spectral Envelope | Flat amplitude scaling factor across all frequencies [7.4]. | Monotonically decaying sinc envelope: scaled by Fourier coefficients [4.03]. | Decaying sinc function envelope: [4.03]. |
| High-Frequency Distortion | None. | None (within the baseband) [4.03]. | Aperture Effect: Sinc envelope attenuates high frequencies within the baseband [4.03]. |
| Equalizer Required? | No. | No [4.03]. | Yes: Requires a equalizer filter to restore flat response [4.03]. |
[GRAPH: Graphical wave representation comparing: (1) Analog wave, (2) Natural sampled wave (curving tops), and (3) Flat-top sampled wave (flat horizontal tops) — source: Ch 4.03 / Ch 6 Fig 6.3]
4.1 The Aperture Effect
*(Target: Theory Descriptive)* [4.03]
- Aperture Effect: The high-frequency amplitude distortion (droop) introduced during flat-top sampling because the pulse width is finite (not an ideal impulse) [4.03].
- Mathematical Envelope: The baseband spectrum is multiplied by a sinc envelope [4.03]:
- Remedy: An active equalizer circuit with frequency response proportional to is placed in the reconstruction stage to compensate for the high-frequency attenuation [4.03].
5. Reconstruction & Zero-Order Hold (ZOH)
5.1 Ideal Reconstruction (Whittaker-Shannon Interpolation)
*(Target: Mathematical Proof / 10-Mark Derivation)* [7.5]
- Mechanism: Ideal reconstruction is achieved by passing the sampled impulse train through an ideal “brick-wall” low-pass filter with cutoff frequency and gain [7.5]:
- Reconstruction Formula: In the time domain, convolving with yields the continuous-time signal via sinc interpolation [7.5]:
5.2 Quantization Mechanics & SQNR
*(Target: Theory Descriptive / Numerical Solving)* [6.1.2, 6.1.3]
- Quantization Step Size (): For a -bit linear quantizer with a full-scale voltage range , the step size is [6.1.3]:
- Quantization Noise Power ( or ): Assuming the quantization error is uniformly distributed in the range , the mean-square error (noise power) is [6.1.3]:
- Signal-to-Quantization Noise Ratio (SQNR): Expressed as a function of the number of bits , the maximum theoretical SQNR for a full-scale sinusoidal input is [6.1.3]: {Note: Every additional bit added to the ADC resolution improves the SQNR by exactly 6.02 dB}.
6. Multi-Rate Signal Processing
*(Target: Theory Descriptive / Numerical Solving)* [4.04]
6.1 Discrete-Time Down-sampler (Decimator)
*(Target: Numerical Solving / Array Manipulation)* [1.05, 4.04]
- Definition: Reduces the sampling rate of a discrete sequence by an integer factor [1.05, 4.04].
- Operation: Keeps every -th sample and discards the intermediate samples [1.05, 4.04]:
- Anti-Aliasing Filter Requirement: To prevent digital aliasing before discarding samples, the discrete signal must be band-limited to using a digital low-pass decimation filter [4.04].
6.2 Discrete-Time Up-sampler (Interpolator)
*(Target: Numerical Solving / Array Manipulation)* [1.05, 4.04]
- Definition: Artificially increases the sampling rate of a discrete sequence by an integer factor [1.05, 4.04].
- Operation: Inserts zero-valued samples between consecutive original samples [1.05, 4.04]:
- Anti-Imaging Filter Requirement: To remove the high-frequency spectral images created by the inserted zeros, the up-sampled signal must be passed through a digital low-pass interpolation filter with cutoff and gain factor [4.04].
6.3 Down-sampling vs. Up-sampling Comparison
*(Target: Theory Descriptive)* [4.04]
| Feature / Property | Down-sampler (Compressor) | Up-sampler (Expander) |
|---|---|---|
| Mathematical Identity | [1.05, 4.04] | for multiples of [1.05, 4.04] |
| Effect on Array Length | Slashes length by a factor of . | Expands length by a factor of . |
| Time-Domain Operation | Discards in-between samples [1.05, 4.04]. | Inserts zeros in-between samples [1.05, 4.04]. |
| Frequency Spectrum Effect | Stretches the spectrum in frequency. | Compresses the spectrum, creating images. |
| Filtering Required | Low-pass decimation filter before down-sampling [4.04]. | Low-pass interpolation filter after up-sampling [4.04]. |
| Data Loss Profile | Lossy (irreversible unless over-sampled) [1.05]. | Non-lossy (information is fully preserved). |
7. Common Mistakes That Cost Marks
Critical Exam Pitfalls
- Bit-Reversal / Shift Origin Mismatch: In down-sampling numericals, forgetting to track the origin index (, underlined or marked with an arrow). Down-sampling keeps samples at measured strictly relative to the original origin sample, not just from the left-most element of the array.
- Omitting Zero Insertion in Up-sampling: Writing interpolations by directly duplicating adjacent samples (staircase interpolation) instead of inserting actual zeros first before passing through the low-pass interpolation filter.
- Forgetting the Equalizer in Flat-Top Sampling: Stating that flat-top sampling preserves baseband signal spectrum shape without distortion. You must specify that it introduces aperture effect droop and requires a equalizer [4.03].
- Nyquist Interval Variable Swap: Confusing the Nyquist Rate (frequency, ) with the Nyquist Interval (time, ).
8. PYQ Bank — Verbatim Questions & Answer Plans
Q1: Down-sampling and Up-sampling Array Solving [KUET 2024, 2022]
- Question: What is discrete-time up-sampler and down-sampler? Find the up-sampling sequence and down-sampling sequence for a given signal array by factor 3.
- Answer Plan:
- Define down-sampler and write the compressor identity: [1.05].
- Define up-sampler and write the expander identity: [1.05].
- Identify the index of the given array.
- Extract indices at multiples of to formulate the down-sampled array.
- Insert exactly 2 zeros between every adjacent sample of the original array to formulate the up-sampled array.
Q2: Shannon-Nyquist Theorem Proof [KUET 2019, 2018, 2017]
- Question: State and prove the Shannon-Nyquist sampling theorem.
- Answer Plan:
- State the theorem: [1.05].
- Model the impulse-train sampler mathematically: [6.1.1].
- (derivation): Apply continuous-time Fourier transform to show [4.01].
- Discuss how overlapping spectra (aliasing) occurs if , whereas guard bands are maintained if [1.05, 4.02].
Q3: Distinguish Between Sampling Techniques [KUET 2018, 2017]
- Question: Classify sampling techniques and distinguish between Ideal, Natural, and Flat-top sampling.
- Answer Plan:
- List the three sampling classifications [1.05].
- Insert comparison matrix detailing: Mathematical multiplier, Waveform top profile, Spectrum envelope, and Equalizer requirements [4.03].
- Explicitly define the aperture effect droop and the role of the recovery filter [4.03].
Chapter 9 Self-Check Revision Checklist
- Can you write down the frequency-domain representation of uniform sampling from memory?
- Do you know how the aperture effect shifts flat-top sampling spectrum profiles compared to ideal impulse sampling?
- Can you solve discrete down-sampling array mappings relative to a shifted index origin?
- Do you know the exact SQNR improvement obtained per additional ADC bit?
Related Notes: 4.02 Spectral Replications & Aliasing Dynamics | 4.03 Ideal, Natural & Flat-Top Sampling Techniques | 4.04 Multi-Rate Signal Processing: Decimation & Interpolation
4.01 The Shannon-Nyquist Sampling Theorem
Core Idea
The Shannon-Nyquist Sampling Theorem is the mathematical bridge that allows us to convert a continuous-time analog signal into a discrete-time sequence without any loss of information. It asserts that if a band-limited continuous-time signal has no frequency components higher than Hz, it can be uniquely and perfectly reconstructed if the sampling frequency satisfies .
1. Mathematical Definitions and Concepts
To understand sampling, we must mathematically define the transition from continuous-time to discrete-time indices under a uniform sampling period {the time interval between successive samples}.
1.1 The Sampling Equations
Let represent a continuous-time analog input signal. Uniform sampling is modeled as taking snapshots of the signal every seconds:
Here:
- = Sampling Period [seconds]
- = Sampling Frequency [Hz or samples/second]
- = Sampling Angular Frequency [rad/s]
1.2 The Nyquist Conditions
- Nyquist Rate (): The absolute minimum theoretical sampling rate that avoids overlapping spectral replicas.
- Nyquist Interval (): The maximum allowable time spacing between adjacent samples:
2. Rigorous Proof of the Sampling Theorem [PYQ 2019, 2017]
The proof of the sampling theorem relies on modeling the physical sampling switch as a continuous-time multiplication of the analog signal by a periodic impulse train :
2.1 Time-Domain Formulation
Let be an impulse train of unit area spaced by :
The sampled signal is the product:
Using the sampling property of the impulse ():
2.2 Frequency-Domain Formulation
Since multiplication in the time domain corresponds to convolution in the frequency domain (scaled by ):
Because is periodic with period , we can express it as a complex exponential Fourier Series:
The Fourier coefficients are:
Thus:
Taking the Fourier transform of this exponential series yields a train of impulses in the frequency domain:
Now, convolve with :
Since convolving any function with a shifted impulse simply shifts the function itself:
Physical Meaning of the Result
This equation proves that the spectrum of the sampled signal consists of an infinite series of replicated copies of the original analog spectrum , spaced at integer multiples of the sampling frequency and scaled in amplitude by .
3. High-Yield Solved Numericals
3.1 Example 1: Multi-Tone Composite Waveform [PYQ 2016, 2015]
Question: Calculate the Nyquist Rate and Nyquist Interval for the analog signal:
Step-by-Step Solution:
-
Extract individual frequencies:
- For Term 1 ():
- For Term 2 ():
-
Identify maximum frequency ():
-
Evaluate Nyquist parameters:
- Nyquist Rate:
- Nyquist Interval:
3.2 Example 2: Sinc and Sinc-Squared Functions
Question: Calculate the Nyquist Rate for the signal:
Step-by-Step Solution:
To solve this, we must check both standard engineering definitions of the Sinc function since different instructors use different standards.
-
Interpretation A: Normalized Sinc (Rao Standard: )
- Express the base term:
- Find the base maximum frequency:
- Because squaring in time corresponds to frequency-domain convolution, the band limit doubles:
- Calculate the Nyquist Rate:
-
Interpretation B: Unnormalized Sinc ()
- Express the base term:
- Find base maximum frequency:
- Doubling the band limit due to multiplication:
- Calculate the Nyquist Rate:
4. Common Mistakes That Cost Marks
The Sinc frequency factor error
When squaring a signal (like or convolving in frequency), the highest frequency component doubles (). Many students forget to double the base frequency and evaluate the Nyquist rate incorrectly, losing major marks.
The Angular vs. Cyclic frequency trap ( vs. )
Always verify if the question asks for the Nyquist rate in Hz or rad/s.
- Nyquist rate in Hz:
- Nyquist rate in rad/s: Confusing the two factors in the proof or numericals leads to scaling errors by .
5. PYQ Bank — Verbatim Questions & Answer Plans
5.1 PYQ 2019/2017 [10 Marks]
Question: State and prove the Shannon-Nyquist sampling theorem.
- Answer Plan:
- State the theorem formally (Section 1).
- Model uniform impulse train sampling in the time domain (Section 2.1).
- Compute the Fourier series representation of the impulse train (Section 2.2).
- Carry out the frequency-domain convolution integration to derive (Section 2.2).
- Explain the reconstruction criteria (over-sampling, Nyquist, under-sampling).
5.2 PYQ 2016/2015 [5 Marks]
Question: Determine the Nyquist Rate and Nyquist Interval of the signal .
- Answer Plan: Follow the step-by-step extraction and numerical solution laid out in Section 3.1 to secure all 5 marks.
6. Self-Check Before Moving On
- Can you state the Shannon-Nyquist theorem verbatim without skipping the “band-limited” constraint?
- Can you derive the Fourier Transform of an impulse train ?
- Can you prove that multiplication by in time replicates the spectrum in frequency?
- Do you know how to calculate the maximum frequency for composite signals and sinc-squared signals?
Source: (k.Deergha Rao) signals and systems.pdf (Chapter 6 & 7), 1.05 The Sampling Theorem Bridge & Multi-Rate Processing.md.
4.01 The Shannon-Nyquist Sampling Theorem | 4.03 Ideal, Natural & Flat-Top Sampling Techniques
4.02 Spectral Replications & Aliasing Dynamics
Core Idea
Uniform time-domain sampling mathematically translates to a periodic replication of the signal’s continuous spectrum in the frequency domain at integer multiples of the sampling frequency . The relationship between the sampling rate and the maximum signal frequency determines whether these replicated spectral bands remain isolated or overlap. When under-sampled, overlapping bands cause Aliasing, a destructive, irreversible frequency-folding distortion that can only be prevented prior to sampling using an analog Anti-Aliasing Filter.
1. The Physics of Spectral Replications
To understand what happens in the frequency domain when we sample an analog signal, we recall the continuous-time impulse-train sampled signal from Note 4.01:
Since the sampling function is periodic with period , its Fourier transform is a discrete impulse train in the frequency domain spaced by the angular sampling frequency :
Applying the frequency convolution property {multiplication in time is convolution in frequency}, we derive the spectrum of the sampled signal :
This elegant formula reveals that the spectrum of a sampled signal consists of the original spectrum scaled by and repeated infinitely at every integer multiple of the sampling frequency .
2. The Three Sampling Conditions
The boundary condition that determines the separation of these replicated spectral bands is established by comparing the angular sampling frequency with twice the maximum frequency component of the analog signal .
2.1 Over-Sampling ()
When the sampling frequency is strictly greater than twice the highest frequency component, the replicated spectral copies are spaced far apart.
- Guard Band: A clear frequency gap {buffer band} exists between adjacent replicas, spanning the interval:
- Reconstruction Filter: Because of this gap, a practical, low-cost analog low-pass reconstruction filter with a gradual transition band can easily isolate the baseband spectrum without introducing phase or amplitude distortion.
[GRAPH: Replicated frequency spectra under the over-sampling condition (\Omega_s > 2\Omega_m). Plot shows a series of triangular-shaped spectral bands of height 1/T_s centered at \Omega = 0, \pm\Omega_s, \pm2\Omega_s. The baseband triangle is bounded by -\Omega_m and \Omega_m. Clear gaps of width \Omega_s - 2\Omega_m representing guard bands are highlighted between adjacent triangles - source: K. Deergha Rao Fig 7.14]
2.2 Nyquist-Rate Sampling ()
This is the boundary condition where the sampling rate is exactly equal to twice the maximum frequency of the signal.
- Edge-Touching: The adjacent spectral replicas touch exactly at their edges with no frequency gap:
- The “Brick-Wall” Necessity: To reconstruct the original signal perfectly, we require an ideal low-pass filter with an infinitely sharp, vertical cutoff at : Physical Constraint: Such a filter is mathematically causal but physically non-realizable because its impulse response is a double-sided sinc function extending from to , requiring infinite time delay (anticipatory memory) to implement.
[GRAPH: Replicated frequency spectra under the Nyquist-rate sampling condition (\Omega_s = 2\Omega_m). Plot shows triangular spectral bands of height 1/T_s centered at 0 and \pm\Omega_s touching exactly at the boundary frequency \Omega = \Omega_m, showing zero gap between the adjacent bands - source: K. Deergha Rao Fig 7.12]
2.3 Under-Sampling ()
When the sampling frequency is less than twice the maximum frequency component, the adjacent spectral replicas overlap in the frequency domain.
- Fold-Over Region: The high-frequency tails of one replica overlap with the low-frequency portion of the adjacent replica.
- Destructive Interference: Within this overlapping band, the spectra sum together algebraically. The original high frequencies fold back into the lower frequencies, making it physically impossible to reconstruct the original waveform. This spectral overlap region is called the fold-over region or aliasing zone.
[GRAPH: Replicated frequency spectra under the under-sampling condition (\Omega_s < 2\Omega_m) demonstrating aliasing. Plot shows overlapping triangular spectral bands centered at 0, \pm\Omega_s, \pm2\Omega_s. The overlapping regions between adjacent triangles are heavily shaded and labeled as 'Fold-over / Aliasing region' to show the corruption of low-frequency data by high-frequency replicas - source: K. Deergha Rao Fig 7.13]
3. Aliasing Distortion & The Frequency-Folding Mechanism
3.1 Mathematical Definition of Aliasing
Aliasing is the frequency-folding distortion that occurs when a continuous-time signal is sampled at a rate below its Nyquist limit. High-frequency components “fold” around the folding frequency {also known as the folding boundary or half-sampling limit} and reappear as false, lower-frequency components in the reconstructed baseband.
3.2 The Symmetrical Folding Formula
If a continuous-time sinusoidal signal has a true frequency , and it is sampled at a rate , the apparent reconstructed frequency in the baseband can be calculated using the symmetrical folding formula:
3.3 High-Yield Algebraic Aliasing Proof
To see this folding mechanism algebraically, let us sample a high-frequency cosine wave at a sampling rate where .
The discrete-time sequence of samples is:
Let the true frequency be represented as an integer multiple of the sampling frequency plus an offset:
Substitute this ratio back into our discrete-time expression:
Using the cosine angle addition identity for any integer and :
This algebraic identity proves that the discrete sample values of the high-frequency sinusoid are mathematically identical to the sample values of a lower-frequency sinusoid . During reconstruction, the DAC cannot distinguish between these two signals and will always output the lower frequency , resulting in irreversible data loss.
3.4 Grounded Numerical Example
Problem: A continuous-time signal is sampled at a rate . Find the true frequency of the signal, verify if aliasing occurs, and determine the apparent frequency of the reconstructed signal.
Step 1: Extract the True Frequency
From the expression :
Step 2: Test the Nyquist Criteria
The minimum theoretical sampling rate to avoid aliasing is the Nyquist Rate:
Since our actual sampling frequency , aliasing will definitely occur.
Step 3: Apply the Folding Formula
We seek an integer such that the aliased frequency falls below the half-sampling folding limit : For :
Since , the apparent reconstructed frequency is:
Step 4: Verify Graphically and Algebraically
The wave has folded around the folding frequency and is reconstructed as a false sine wave.
4. The Anti-Aliasing Filter (AAF)
4.1 The Fundamental Post-Sampling Rule
The Post-Sampling Filtering Fallacy
Once a signal is sampled and aliasing occurs, the overlapping spectral components merge completely. At this point, the original low frequencies and folded-back high frequencies are mathematically summed into a single amplitude value at each frequency index. No digital filter or software algorithm can ever separate them. Aliasing is an irreversible physical process.
4.2 The Solution: Analog Pre-Filtering
To prevent aliasing, we must remove all frequency components above the half-sampling limit before the signal reaches the sampler or Analog-to-Digital Converter (ADC). This is achieved using an analog Anti-Aliasing Filter (AAF).
+-----------------------+ +---------+
Analog Input --->| Anti-Aliasing Filter |----->| Sampler |---> Sampled Output
x(t) | (Analog Low-Pass) | | (ADC) | x[n]
+-----------------------+ +---------+
Cutoff:
f_c <= f_s / 2
4.3 Structural Design Specifications of an AAF
- Filter Classification: Active or passive analog low-pass filter (LPF).
- Cutoff Frequency (): Designed to match the folding frequency boundary:
- The Over-Sampling Relaxer: In practical engineering, designing a sharp analog filter with a very narrow transition band is incredibly difficult and expensive. Therefore, we deliberately over-sample the signal () to create a wide guard band. This wide guard band allows us to use a cheap, low-order analog anti-aliasing filter while still completely preventing aliasing.
5. Common Mistakes That Cost Marks
The Post-ADC Digital Filtering Trap
In exam papers, examiners often ask if a digital filter implemented in a DSP can eliminate aliasing. Always answer NO. Explain that once the analog signal passes through the ADC sampler, the overlapping spectral copies are already summed. A digital filter cannot distinguish between a true signal and a signal aliased to .
Incorrect Folding Calculations
When calculating folding frequencies, do not just subtract the frequency as . Always take the absolute value . Forgetting the absolute value yields a negative frequency, which is mathematically correct under exponential notation but physically incorrect for real-valued signals without a corresponding phase-sign inversion.
6. PYQ Bank — Verbatim Questions & Answer Plans
6.1 PYQ 2021 Question 1c / 2019 Question 2b [06 Marks]
Question: Explain the aliasing effect and describe the means/filters used to avoid it.
- Answer Plan:
- Define Aliasing mathematically and conceptually (Section 3.1).
- State the condition for under-sampling () which leads to spectral overlap (Section 2.3).
- Draw the overlapping triangular spectrum diagram (Section 2.3).
- Explain the solution: Placing an analog Anti-Aliasing Filter before the sampler with (Section 4.2 & 4.3).
6.2 PYQ 2018 Question 2b [06 Marks]
Question: Draw the criteria and frequency spectrum in case of over-sampling, under-sampling & Nyquist rate sampling.
- Answer Plan:
- Divide your answer into three distinct sub-sections matching Section 2.
- For Over-sampling, state and draw the spaced-out triangular replicas with highlighted guard bands.
- For Nyquist-rate sampling, state and draw the replicas touching exactly.
- For Under-sampling, state and draw overlapping replicas with shaded fold-over aliasing regions.
7. Self-Check Before Moving On
- Can you derive the periodic replicated spectrum equation using time-convolution?
- Do you know the exact frequency criteria for over-sampling, under-sampling, and Nyquist rate sampling?
- Can you calculate the apparent folding frequency of any under-sampled sinusoid using ?
- Can you explain why a digital filter cannot remove aliasing after a signal has been sampled?
- Do you understand the role, physical placement, and cutoff constraints of an analog Anti-Aliasing Filter?
Source: (k.Deergha Rao) signals and systems.pdf (Chapter 7.4), ECE 2107 - Signals and Systems.md, 1.05 The Sampling Theorem Bridge & Multi-Rate Processing.md, Azmat Sir Class Slides.
4.02 Spectral Replications & Aliasing Dynamics | 4.04 Multi-Rate Signal Processing: Decimation & Interpolation
4.03 Ideal, Natural & Flat-Top Sampling Techniques
Core Idea
Continuous-time analog signals cannot be directly processed by digital systems without conversion. The physical interface is the Analog-to-Digital Converter (ADC), where the continuous time axis is discretized. Depending on the physical implementation of the sampling switch, this discretization process is classified into Ideal (Impulse), Natural (Chopping), and Flat-Top (Sample-and-Hold) sampling. While ideal and natural sampling preserve the exact, undistorted frequency spectrum of the analog signal within each replica, practical flat-top sampling introduces high-frequency roll-off distortion known as the Aperture Effect, requiring post-filtering equalization.
1. The Physical Analog-to-Digital Conversion (ADC) Pipeline
Before looking at the mathematics of different sampling techniques, we must understand where sampling fits in the physical hardware pipeline of a modern receiver.
THE ADC PIPELINE
Analog +------------+ Filtered +-------------+ Flat-top +-----------+ Quantized +---------+ Digital
Signal | Anti- | Analog | Sample & | Sampled | | Samples | | Word
x_a(t) ------->| Aliasing |-------------->| Hold |-------------->| Quantizer |-------------->| Encoder |------------->
| LPF (f_c) | x_filt(t) | (Flat-top) | x_ft(t) | | x_q(n) | | b-bits
+------------+ +-------------+ +-----------+ +---------+
^
| Trigger Clock
| f_s >= 2 f_max
[DIAGRAM: Complete Block Diagram of the Analog-to-Digital Conversion (ADC) Process, showing the cascade of anti-aliasing filtering, sample-and-hold discretization, quantization, and binary encoding - source: Textbook Fig 6.2]
1.1 Role of Individual Blocks
- Anti-Aliasing Filter: An analog low-pass filter with cutoff frequency . It strips away high-frequency noise and out-of-band components that would otherwise fold back into the baseband and cause irreversible aliasing distortion during the sampling stage.
- Sample-and-Hold (S&H) Circuit: The physical hardware executing flat-top sampling. It tracks the analog input voltage during a very short window (sample) and holds it strictly constant (hold) across the remainder of the sampling period to give the quantizer stable voltage levels to convert.
- Quantizer: Converts the continuously variable amplitude of the flat-topped staircase samples into discrete voltage levels chosen from a finite pool of levels, where is the ADC bit resolution.
- Encoder: Maps each quantized voltage level to a unique -bit binary word, emitting a stream of digital data ready for processor manipulation.
2. Ideal (Impulse Train) Sampling
Ideal Sampling—also called Impulse Sampling—represents the theoretical mathematical baseline where the analog signal is multiplied by an infinite train of zero-width Dirac delta impulses.
IDEAL SAMPLING WAVEFORM CHARACTERISTICS
x_a(t) (Continuous Waveform) p(t) (Periodic Impulse Train)
_--""--_ | | | | | | |
_-" "-_ | | | | | | |
/ \ | | | | | | |
------------------------- t ------------------------- t
0 T_s 2T_s
x_s(t) (Ideally Sampled Impulses)
|
| |
| | |
| | |
------------------------- t
[GRAPH: Waveform representation of Ideal Sampling: Multiplying a smooth continuous-time analog wave x_a(t) by an infinite train of zero-width Dirac impulses p(t) yields an impulse train x_s(t) whose impulse areas match the sample values - source: Textbook Fig 6.1]
2.1 Mathematical Formulation
In the time domain, we multiply by the periodic impulse train : x_s(t) = x_a(t) \cdot p(t) \tag{1}
The periodic impulse train is defined as: p(t) = \sum_{n=-\infty}^{\infty} \delta(t - nT_s) \tag{2}
Substituting Eq. (2) into Eq. (1) and applying the impulse sifting property () yields: x_s(t) = \sum_{n=-\infty}^{\infty} x_a(nT_s) \delta(t - nT_s) \tag{3}
2.2 Frequency-Domain Representation
Taking the Fourier transform of Eq. (3) maps this multiplication to convolution in the frequency domain, yielding replicated copies of the analog spectrum spaced at integer multiples of the sampling frequency : X_s(j\Omega) = \frac{1}{T_s} \sum_{k=-\infty}^{\infty} X_a(j(\Omega - k\Omega_s)) \tag{4}
Conceptual Checkpoint
Because each spectral replica in is scaled by the constant factor , the shape of the original spectrum is completely undistorted inside each replicated frequency band. However, because Dirac impulses have infinite height and zero width, this technique is a mathematical abstraction that is physically impossible to realize in hardware.
3. Natural Sampling (Chopping)
Natural Sampling is a physically realizable technique where the continuous-time signal is electronically switched (or “chopped”) by a train of narrow, rectangular pulses of finite width and period .
NATURAL SAMPLING WAVEFORM CHARACTERISTICS
p(t) (Periodic Rectangular Pulses) x_ns(t) (Naturally Sampled Wave)
___ ___ ___ _--""--_
| | | | | | _| | | | |_
| | | | | | | | | | | | |
| | | | | | | | | | | | |
------------------------- t ------------------------- t
<--> tau (Tops curve along wave contour)
<-------> T_s
[GRAPH: Waveform representation of Natural Sampling: Multiplying an analog wave by a periodic rectangular pulse train of pulse-width tau and period T_s yields a pulsed wave x_ns(t) where the top of each rectangular slice preserves the natural curve of the original analog wave - source: Textbook Fig 6.1]
3.1 Mathematical Formulation
The naturally sampled signal is: x_{ns}(t) = x_a(t) \cdot p_{rect}(t) \tag{5}
where is a periodic rectangular pulse train of amplitude , period , and pulse width : p_{rect}(t) = \sum_{n=-\infty}^{\infty} \text{rect}\left(\frac{t - nT_s}{\tau}\right) \tag{6}
Because is a periodic function of time, it can be represented by its exponential Fourier series: p_{rect}(t) = \sum_{n=-\infty}^{\infty} C_n e^{j n \Omega_s t} \tag{7}
where the Fourier coefficients are evaluated over one period : C_n = \frac{1}{T_s} \int_{-T_s/2}^{T_s/2} p_{rect}(t) e^{-j n \Omega_s t} \, dt = \frac{1}{T_s} \int_{-\tau/2}^{\tau/2} (1) e^{-j n \Omega_s t} \, dt \tag{8} C_n = \frac{1}{T_s} \left[ \frac{e^{-j n \Omega_s t}}{-j n \Omega_s} \right]_{-\tau/2}^{\tau/2} = \frac{e^{j n \Omega_s \tau/2} - e^{-j n \Omega_s \tau/2}}{j n \Omega_s T_s} \tag{9} C_n = \frac{2 \sin(n \Omega_s \tau / 2)}{n \Omega_s T_s} = \frac{\tau}{T_s} \frac{\sin(n \Omega_s \tau / 2)}{n \Omega_s \tau / 2} = \frac{\tau}{T_s} \text{sinc}\left(\frac{n \Omega_s \tau}{2\pi}\right) \tag{10}
3.2 Frequency-Domain Representation
Substituting the Fourier series representation of Eq. (7) back into Eq. (5) yields: x_{ns}(t) = x_a(t) \cdot \sum_{n=-\infty}^{\infty} C_n e^{j n \Omega_s t} = \sum_{n=-\infty}^{\infty} C_n x_a(t) e^{j n \Omega_s t} \tag{11}
Applying the Frequency Shifting (Modulation) Property of the Fourier transform () to Eq. (11) gives: X_{ns}(j\Omega) = \sum_{n=-\infty}^{\infty} C_n X_a(j(\Omega - n\Omega_s)) \tag{12}
Substituting the explicit expression for from Eq. (10) into Eq. (12) yields the final spectral representation of naturally sampled signals: X_{ns}(j\Omega) = \frac{\tau}{T_s} \sum_{n=-\infty}^{\infty} \text{sinc}\left(\frac{n \Omega_s \tau}{2\pi}\right) X_a(j(\Omega - n\Omega_s)) \tag{13}
SPECTRUM OF NATURALLY SAMPLED SIGNAL
Sinc Envelope [ sinc( \Omega \tau / 2\pi ) ]
. . . . - - - - - - . . . .
.- -.
/ \
| | | |
| | | | | | | | | |
---|-----|--|--|-----|--|--|-----|--|--|--- \Omega
-\Omega_s 0 \Omega_s 2\Omega_s
[GRAPH: Frequency spectrum of Natural Sampling: The analog spectrum repeats at integer multiples of \Omega_s. Each replica is scaled as a whole by the constant coefficient C_n. This results in no internal frequency distortion within individual replicas - source: Textbook Ch 6]
3.3 Physical Interpretation
- The spectrum consists of replicated copies of the original spectrum centered at integer multiples of the sampling frequency .
- Each individual spectral replica is scaled as a whole by the constant value .
- Because the scaling factor is constant for a given harmonic index , the baseband spectrum () and all individual replicas are completely undistorted in shape. They are merely scaled in overall amplitude.
4. Flat-Top Sampling (Sample-and-Hold)
In modern microelectronics, natural sampling is difficult to execute because quantizers require a completely stable, static voltage level during conversion. Instead, Flat-Top Sampling is used, where the analog signal’s amplitude is sampled at and held constant for the duration of the sampling pulse, producing a staircase-like waveform.
FLAT-TOP SAMPLING WAVEFORM CHARACTERISTICS
x_a(t) (Continuous Waveform) x_ft(t) (Flat-Top Staircase Wave)
_--""--_ _----_
_-" "-_ | | _----_
/ \ | || |
------------------------- t ------------------------- t
<--> tau
[GRAPH: Waveform representation of Flat-Top Sampling: The analog amplitude is sampled at discrete instants and held strictly flat for duration tau, producing a staircase waveform - source: Textbook Fig 6.2]
4.1 Mathematical Modeling as a Convolution Cascade
To model flat-top sampling mathematically, we can think of it as a two-stage cascade:
- First, the analog signal is ideally sampled with a zero-width impulse train to generate .
- Second, this impulse train is convolved with a single rectangular pulse of width and amplitude to “stretch” each impulse into a flat-topped block of width .
MATHEMATICAL DECOMPOSITION OF FLAT-TOP SAMPLING
Analog +-----------------+ Ideal Impulses +-----------------+ Flat-top
Signal ----->| Ideal Sampler |----------------->| Rectangular |---> Staircase
x_a(t) | Clock: T_s | x_s(t) | Filter h(t) | x_ft(t)
+-----------------+ +-----------------+
Let the single rectangular stretching pulse be: h(t) = \text{rect}\left(\frac{t - \tau/2}{\tau}\right) = \begin{cases} 1, & 0 \le t < \tau \\ 0, & \text{otherwise} \end{cases} \tag{14}
Using this pulse shape, the flat-top sampled signal is defined as: x_{ft}(t) = x_s(t) * h(t) \tag{15}
Substituting Eq. (3) for into Eq. (15) yields: x_{ft}(t) = \left[ \sum_{n=-\infty}^{\infty} x_a(nT_s) \delta(t - nT_s) \right] * h(t) \tag{16}
Since convolution is a linear operator, we distribute it inside the summation: x_{ft}(t) = \sum_{n=-\infty}^{\infty} x_a(nT_s) \left[ \delta(t - nT_s) * h(t) \right] \tag{17}
By the impulse shifting property of convolution (), we obtain the final time-domain expression for a flat-top sampled signal: x_{ft}(t) = \sum_{n=-\infty}^{\infty} x_a(nT_s) h(t - nT_s) \tag{18}
4.2 Frequency-Domain Representation
Applying the convolution theorem () to Eq. (15) gives: X_{ft}(j\Omega) = X_s(j\Omega) \cdot H(j\Omega) \tag{19}
We first evaluate the Fourier transform of the rectangular stretching pulse defined in Eq. (14) using the time-shifting property: H(j\Omega) = \mathcal{F}\left\{\text{rect}\left(\frac{t - \tau/2}{\tau}\right)\right\} = \left[ \tau \text{sinc}\left(\frac{\Omega \tau}{2\pi}\right) \right] e^{-j \Omega \tau / 2} \tag{20}
Now, substituting from Eq. (4) and from Eq. (20) into Eq. (19) yields: X_{ft}(j\Omega) = \left[ \frac{1}{T_s} \sum_{k=-\infty}^{\infty} X_a(j(\Omega - k\Omega_s)) \right] \cdot \tau \text{sinc}\left(\frac{\Omega \tau}{2\pi}\right) e^{-j \Omega \tau / 2} \tag{21}
Distributing the terms yields the final frequency-domain expression for flat-top sampled signals: X_{ft}(j\Omega) = \frac{\tau}{T_s} \text{sinc}\left(\frac{\Omega \tau}{2\pi}\right) e^{-j \Omega \tau / 2} \sum_{k=-\infty}^{\infty} X_a(j(\Omega - k\Omega_s)) \tag{22}
5. The Aperture Effect & Frequency Distortion
Looking closely at the spectrum of the flat-top sampled signal in Eq. (22) reveals a critical engineering problem that distinguishes it from both ideal and natural sampling.
5.1 The Mathematical Proof of Baseband Distortion
In natural sampling (Eq. 13), each spectral replica is scaled as a whole by a constant factor . In flat-top sampling (Eq. 22), the entire replicated spectrum is multiplied by a continuous, frequency-dependent envelope .
Let us look at the reconstructed baseband signal () after passing the flat-top sampled signal through an ideal low-pass reconstruction filter: X_{ft,\text{baseband}}(j\Omega) = \left[ \frac{\tau}{T_s} \text{sinc}\left(\frac{\Omega \tau}{2\pi}\right) e^{-j \Omega \tau / 2} \right] \cdot X_a(j\Omega) \tag{23}
THE FLAT-TOP APERTURE DISTORTION EFFECT
Ideal Reconstructed Spectrum Flat-top Reconstructed Spectrum
|H(j\Omega)| |H(j\Omega)|
+-------------+ +-\ /-+
| | | \ / |
| | | \ / |
| | | \ / |
------|-------------|------ \Omega ------|-----\--/-----|------ \Omega
-f_m f_m -f_m 0 f_m
(Flat Passband) (High-Frequency Roll-off / Droop)
[GRAPH: Comparison of ideal reconstructed passband (perfectly flat) vs. flat-top reconstructed passband: The continuous Sinc envelope of flat-top sampling attenuates higher frequencies within the baseband, creating severe high-frequency attenuation - source: Textbook Ch 6]
5.2 Physical Consequences of the Aperture Effect
- High-Frequency Roll-Off: Because the envelope is a continuously decreasing function of frequency over the baseband, it attenuates higher frequencies within the desired signal .
- Aperture Distortion: This non-uniform attenuation across the passband distorts the signal.
- The Pulse-Width Trade-off:
- If we make the pulse width very small relative to (), the Sinc envelope becomes very wide and flat over the baseband, minimizing distortion. However, a very narrow pulse contains very little signal energy, causing a severe drop in the signal-to-noise ratio (SNR).
- If we increase to maximize signal energy, we increase the Sinc roll-off, resulting in severe aperture distortion.
5.3 Hardware Correction: The Equalizer Filter
To resolve this trade-off, engineers use a larger pulse width to preserve signal energy and place an analog Equalizer Filter (or Aperture Corrector) with frequency response immediately after the low-pass reconstruction filter.
APERTURE EQUALIZATION SIGNAL CASCADE
Staircase +---------------+ Attenuated +---------------+ Restored flat
Signal --->| Reconstruction|--> Baseband | Equalizer |--> Analog Out
x_ft(t) | LPF (f_s/2) | x_LPF(t) | Filter E(j\Omega)| x_out(t)
+---------------+ +---------------+
The equalizer’s frequency response must be the mathematical inverse of the aperture distortion envelope to restore a flat frequency response across the baseband: E(j\Omega) = \frac{1}{H(j\Omega)} = \frac{1}{\tau \text{sinc}\left(\frac{\Omega \tau}{2\pi}\right) e^{-j \Omega \tau / 2}} \tag{24}
The magnitude response of the equalizer filter over the passband is: |E(j\Omega)| = \frac{1}{\tau \text{sinc}\left(\frac{\Omega \tau}{2\pi}\right)} = \frac{\frac{\Omega\tau}{2}}{\tau \sin\left(\frac{\Omega\tau}{2}\right)} = \frac{\Omega}{2 \sin\left(\frac{\Omega\tau}{2}\right)} \tag{25}
This rising frequency response compensates for the Sinc droop, restoring a flat baseband frequency response.
6. Unified Comparison of Sampling Techniques
This comparison table summarizes the key properties of the three sampling techniques:
| Feature | Ideal (Impulse) Sampling | Natural (Chopping) Sampling | Flat-Top (S&H) Sampling |
|---|---|---|---|
| Physical Realizability | Mathematically ideal, physically impossible. | Physically realizable using high-speed switches. | Standard practical interface in modern ADCs. |
| Pulsed Waveform Shape | Train of zero-width Dirac delta impulses. | Train of narrow pulses; tops curve along wave contour. | Staircase-like waveform; tops are flat. |
| Time-Domain Equation | |||
| Frequency-Domain Equation | |||
| Baseband Spectral Shape | Undistorted: Scaled evenly by constant factor . | Undistorted: Scaled evenly by constant factor . | Distorted: Scaled unevenly by Sinc envelope (Aperture Effect). |
| Replication Envelope | Flat envelope (infinite bandwidth). | Attenuated at high replica indexes by Sinc envelope. | Replicas and baseband are both filtered by continuous Sinc envelope. |
| Equalization Needed | No. | No. | Yes: Requires equalizer filter. |
7. Common Mistakes That Cost Marks
The Flat-Top Equalizer Oversight
Students often assume that since flat-top sampling uses a low-pass reconstruction filter, the analog signal is perfectly recovered. On exams, you must state that flat-top sampling requires an equalizer filter () to correct for the aperture effect. Neglecting this detail can cost you several marks on theoretical questions.
Natural vs. Flat-Top Spectral Envelope Confusions
Do not confuse the spectral envelopes of natural and flat-top sampling:
- In natural sampling, the Sinc function acts on the discrete harmonic index , meaning each spectral replica is scaled by a single constant value. No distortion is introduced inside any replica.
- In flat-top sampling, the Sinc function is a continuous function of operating frequency , meaning the scaling factor varies across each replica. This introduces severe distortion inside every replica, including the baseband.
8. PYQ Bank — Verbatim Questions & Answer Plans
8.1 PYQ 2023 Question 4b [5 Marks]
Question: Draw the block diagram of the analog-to-digital (ADC) conversion process.
- Answer Plan:
- Draw the functional hardware block diagram shown in Section 1.
- Label all intermediate signals clearly: Analog Input , Anti-Aliased Output , Flat-topped Samples , Quantized Samples , and Digital -bit Output.
- Briefly summarize the role of the 4 key blocks (Anti-Aliasing Filter, Sample and Hold, Quantizer, Encoder) in 1 sentence each to secure full marks.
8.2 PYQ 2017 Question 4b [7 Marks]
Question: Distinguish between Ideal, Natural, and Flat-top sampling techniques.
- Answer Plan:
- Define each of the three techniques clearly.
- Write down the time-domain multiplication or convolution expressions for each technique.
- Reproduce the Unified Comparison Table from Section 6 to highlight differences in physical realizability, wave shape, baseband distortion, and the need for equalization.
8.3 PYQ 2018 Question 4b [4 Marks]
Question: Classify the sampling techniques.
- Answer Plan:
- State that physical sampling techniques are classified into three types based on the hardware switch model: Ideal (Impulse) sampling, Natural (Chopping) sampling, and Flat-top (Sample-and-Hold) sampling.
- Provide a 1-sentence definition of each along with their corresponding time-domain mathematical expressions.
9. Self-Check Before Moving On
- Can you reproduce the complete block diagram of the ADC process from memory?
- Do you understand why natural sampling preserves an undistorted baseband spectrum while flat-top sampling does not?
- Can you derive the flat-top frequency-domain expression using convolution?
- Can you define the Aperture Effect and write down the magnitude response of the equalizer filter needed to correct it?
Source: (k.Deergha Rao) signals and systems.pdf (Chapters 6 & 7), 1.05 The Sampling Theorem Bridge & Multi-Rate Processing.md, Rabiul sir class note.pdf.
4.03 Ideal, Natural & Flat-Top Sampling Techniques | Course Roadmap
4.04 Multi-Rate Signal Processing: Decimation & Interpolation
Core Idea
Multi-rate signal processing is the branch of digital signal processing that deals with systems whose sampling rates change at different stages. Because a discrete-time sequence index must strictly be an integer, discrete scaling is non-trivial. It is achieved through Down-sampling (Decimation), which decreases the sampling rate by discarding samples, and Up-sampling (Interpolation), which increases the sampling rate by inserting zeros.
1. The Core Philosophy of Discrete-Time Scaling
In continuous-time systems, time scaling is mathematically straightforward: we replace the independent variable with . For , the signal is compressed; for , the signal is expanded.
However, in discrete-time systems, this operation is highly restricted. The independent variable is an integer sample index . We cannot define a value at a fractional index like . Thus:
- A direct compression like is possible but causes permanent data loss because we must throw away all odd-indexed samples ().
- A direct expansion like is undefined for odd values of (such as ).
To resolve these physical constraints, multi-rate digital systems use decimation and interpolation to scale discrete arrays without losing mathematical consistency.
2. Discrete-Time Down-Sampler (Decimation by )
The down-sampler (also known as a sampling rate compressor) reduces the sampling rate of a discrete signal by an integer factor .
+-------+
x[n] ------>| | M |------> x_d[n] = x[nM]
+-------+
2.1 Mathematical Formulation
A down-sampler by factor keeps only every -th sample of the input sequence and discards the intermediate samples:
If the sampling period of the input signal is (sampling frequency ), the sampling period of the down-sampled signal becomes:
2.2 Spectral Effects & Digital Aliasing
In the frequency domain, shrinking a signal in the time domain expands its spectrum. Specifically, down-sampling by factor stretches the DTFT spectrum by a factor of :
This expansion can cause the shifted copies of the spectrum to overlap, resulting in digital aliasing.
The Decimation Filter Rule
To prevent destructive aliasing during decimation, we must place a digital low-pass Anti-Aliasing Filter (or Decimation Filter) before the down-sampling block. The filter must have a normalized cutoff frequency of: This strips away any high-frequency components that would otherwise fold back into the baseband.
3. Discrete-Time Up-Sampler (Interpolation by )
The up-sampler (also known as a sampling rate expander) increases the sampling rate of a discrete signal by an integer factor .
+-------+
x[n] ------>| ^ L |------> x_e[n]
+-------+
3.1 Mathematical Formulation
An up-sampler by factor inserts exactly zero-valued samples between each consecutive pair of original samples:
If the original sampling period is , the up-sampled sequence has a sampling period of:
3.2 Spectral Effects & Imaging Distortion
In the frequency domain, expanding a signal in the time domain compresses its spectrum. Up-sampling compresses the baseband spectrum by a factor of :
Because of this compression, unwanted duplicates of the original spectrum (called spectral images) appear within the new interval .
The Interpolation Filter Rule
The zero-inserted sequence has a rough, staircase-like shape. To eliminate the high-frequency spectral images and interpolate the actual intermediate signal values, we must pass through an Interpolation Filter (a digital low-pass filter) with:
- Cutoff Frequency:
- Passband Gain: (to compensate for the amplitude drop caused by zero-insertion)
4. Comprehensive Multi-Rate Comparison Table
The physical and mathematical characteristics of the two multi-rate operators are summarized below:
| Feature | Down-sampling () | Up-sampling () |
|---|---|---|
| Mathematical Equation | (for ) | |
| Time Domain Effect | Discards samples | Inserts zeros |
| Information Volume | Data loss occurs | Zero-padding (no new info yet) |
| New Sampling Period | (slower) | (faster) |
| Spectral Effect | Spectrum expands by | Spectrum compresses by |
| Associated Distortion | Digital Aliasing | Spectral Imaging |
| Associated Filter | Anti-Aliasing Filter (before ) | Anti-Imaging Filter (after ) |
| Filter Cutoff & Gain | , | , |
5. Comprehensive Worked Examples (The Exam Killers)
5.1 Example 1: The 10-Mark 2024 KUET Exam Classic [PYQ 2024]
Question: Find out the up-sampling sequence and down-sampling sequence from the input signal sequence for a factor of 3.
Step-by-Step Solution:
Scenario A: Default Origin Assumption (Leftmost Element is )
Under the standard convention, if the origin is not explicitly marked with an arrow () or underline (), the first element is located at the origin : All other indices are zero: for or .
1. Down-sampling by Factor : The formula is: Let’s map individual indices :
Thus, the down-sampled sequence is:
2. Up-sampling by Factor : The up-sampler inserts zeros between each consecutive sample of the original sequence:
Thus, the up-sampled sequence is:
Scenario B: Alternative Origin Assumption (Origin at is marked, e.g., at value )
If the examiner defines a different origin during the exam, say at the third sample ():
1. Down-sampling by Factor :
Thus, the down-sampled sequence collapses to:
2. Up-sampling by Factor : Insert 2 zeros between each consecutive element, maintaining the origin at value :
5.2 Example 2: The 2022 Exam Sequence [PYQ 2022]
Question: If , find the compressed (down-sampled) and expanded (up-sampled) sequences for a factor of 3.
Step-by-Step Solution:
-
Extract the Index Map relative to the underlined origin:
-
Calculate Down-sampling ():
- (out of bounds)
Therefore, the down-sampled sequence is:
-
Calculate Up-sampling (): Insert zeros between each consecutive pair of elements, keeping the origin aligned at the original sample :
6. Common Mistakes That Cost Marks
The Origin Alignment Trap
Do not always assume that the first element in a bracket is the origin! Always check the array for an arrow () or underline (). If you down-sample without mapping the indices relative to first, your entire output array will shift, resulting in a zero-mark evaluation on the numerical.
The Anti-Imaging Filter Gain Oversight
When asked to draw the block diagram of an interpolator, students often forget that up-sampling scales down the signal amplitude. The matching digital low-pass reconstruction filter must contain a scaling gain factor of to restore the signal’s original physical voltage range.
7. PYQ Bank — Verbatim Questions & Answer Plans
7.1 PYQ 2024 Question 7c [10 Marks]
Question: Find out the up-sampling sequence and down-sampling sequence from the input signal sequence for the discrete-time system under a factor of 3.
- Answer Plan:
- State the mathematical down-sampling and up-sampling equations.
- Write out the step-by-step coordinate substitutions showing how index values map under both Scenario A (default leftmost origin) and Scenario B (alternative marked origin).
- Provide the final bolded output arrays clearly labeling the coordinate.
7.2 PYQ 2021 [5 Marks]
Question: Define (i) Discrete time up-sampler; (ii) Discrete time down-sampler.
- Answer Plan:
- Provide the formal time-domain equations for both operators.
- Draw the standard block diagrams ( and ).
- Explain the physical effect of both blocks in the time domain (zero-insertion vs. sample compression).
8. Self-Check Before Moving On
- Can you define down-sampling and up-sampling mathematically and graphically?
- Do you know why an anti-aliasing filter is required before a down-sampler, and what its cutoff frequency must be?
- Can you explain why up-sampling creates spectral images, and how the interpolation filter removes them?
- Can you reliably execute index mappings on discrete arrays with non-zero time origins?
Source: (k.Deergha Rao) signals and systems.pdf (Section 6.6), 1.05 The Sampling Theorem Bridge & Multi-Rate Processing.md, pyq catagorised (Table 7).