4.01 The Shannon-Nyquist Sampling Theorem | 4.03 Ideal, Natural & Flat-Top Sampling Techniques
4.02 Spectral Replications & Aliasing Dynamics
Core Idea
Uniform time-domain sampling mathematically translates to a periodic replication of the signal’s continuous spectrum in the frequency domain at integer multiples of the sampling frequency . The relationship between the sampling rate and the maximum signal frequency determines whether these replicated spectral bands remain isolated or overlap. When under-sampled, overlapping bands cause Aliasing, a destructive, irreversible frequency-folding distortion that can only be prevented prior to sampling using an analog Anti-Aliasing Filter.
1. The Physics of Spectral Replications
To understand what happens in the frequency domain when we sample an analog signal, we recall the continuous-time impulse-train sampled signal from Note 4.01:
Since the sampling function is periodic with period , its Fourier transform is a discrete impulse train in the frequency domain spaced by the angular sampling frequency :
Applying the frequency convolution property {multiplication in time is convolution in frequency}, we derive the spectrum of the sampled signal :
This elegant formula reveals that the spectrum of a sampled signal consists of the original spectrum scaled by and repeated infinitely at every integer multiple of the sampling frequency .
2. The Three Sampling Conditions
The boundary condition that determines the separation of these replicated spectral bands is established by comparing the angular sampling frequency with twice the maximum frequency component of the analog signal .
2.1 Over-Sampling ()
When the sampling frequency is strictly greater than twice the highest frequency component, the replicated spectral copies are spaced far apart.
- Guard Band: A clear frequency gap {buffer band} exists between adjacent replicas, spanning the interval:
- Reconstruction Filter: Because of this gap, a practical, low-cost analog low-pass reconstruction filter with a gradual transition band can easily isolate the baseband spectrum without introducing phase or amplitude distortion.
[GRAPH: Replicated frequency spectra under the over-sampling condition (\Omega_s > 2\Omega_m). Plot shows a series of triangular-shaped spectral bands of height 1/T_s centered at \Omega = 0, \pm\Omega_s, \pm2\Omega_s. The baseband triangle is bounded by -\Omega_m and \Omega_m. Clear gaps of width \Omega_s - 2\Omega_m representing guard bands are highlighted between adjacent triangles - source: K. Deergha Rao Fig 7.14]
2.2 Nyquist-Rate Sampling ()
This is the boundary condition where the sampling rate is exactly equal to twice the maximum frequency of the signal.
- Edge-Touching: The adjacent spectral replicas touch exactly at their edges with no frequency gap:
- The “Brick-Wall” Necessity: To reconstruct the original signal perfectly, we require an ideal low-pass filter with an infinitely sharp, vertical cutoff at : Physical Constraint: Such a filter is mathematically causal but physically non-realizable because its impulse response is a double-sided sinc function extending from to , requiring infinite time delay (anticipatory memory) to implement.
[GRAPH: Replicated frequency spectra under the Nyquist-rate sampling condition (\Omega_s = 2\Omega_m). Plot shows triangular spectral bands of height 1/T_s centered at 0 and \pm\Omega_s touching exactly at the boundary frequency \Omega = \Omega_m, showing zero gap between the adjacent bands - source: K. Deergha Rao Fig 7.12]
2.3 Under-Sampling ()
When the sampling frequency is less than twice the maximum frequency component, the adjacent spectral replicas overlap in the frequency domain.
- Fold-Over Region: The high-frequency tails of one replica overlap with the low-frequency portion of the adjacent replica.
- Destructive Interference: Within this overlapping band, the spectra sum together algebraically. The original high frequencies fold back into the lower frequencies, making it physically impossible to reconstruct the original waveform. This spectral overlap region is called the fold-over region or aliasing zone.
[GRAPH: Replicated frequency spectra under the under-sampling condition (\Omega_s < 2\Omega_m) demonstrating aliasing. Plot shows overlapping triangular spectral bands centered at 0, \pm\Omega_s, \pm2\Omega_s. The overlapping regions between adjacent triangles are heavily shaded and labeled as 'Fold-over / Aliasing region' to show the corruption of low-frequency data by high-frequency replicas - source: K. Deergha Rao Fig 7.13]
3. Aliasing Distortion & The Frequency-Folding Mechanism
3.1 Mathematical Definition of Aliasing
Aliasing is the frequency-folding distortion that occurs when a continuous-time signal is sampled at a rate below its Nyquist limit. High-frequency components “fold” around the folding frequency {also known as the folding boundary or half-sampling limit} and reappear as false, lower-frequency components in the reconstructed baseband.
3.2 The Symmetrical Folding Formula
If a continuous-time sinusoidal signal has a true frequency , and it is sampled at a rate , the apparent reconstructed frequency in the baseband can be calculated using the symmetrical folding formula:
3.3 High-Yield Algebraic Aliasing Proof
To see this folding mechanism algebraically, let us sample a high-frequency cosine wave at a sampling rate where .
The discrete-time sequence of samples is:
Let the true frequency be represented as an integer multiple of the sampling frequency plus an offset:
Substitute this ratio back into our discrete-time expression:
Using the cosine angle addition identity for any integer and :
This algebraic identity proves that the discrete sample values of the high-frequency sinusoid are mathematically identical to the sample values of a lower-frequency sinusoid . During reconstruction, the DAC cannot distinguish between these two signals and will always output the lower frequency , resulting in irreversible data loss.
3.4 Grounded Numerical Example
Problem: A continuous-time signal is sampled at a rate . Find the true frequency of the signal, verify if aliasing occurs, and determine the apparent frequency of the reconstructed signal.
Step 1: Extract the True Frequency
From the expression :
Step 2: Test the Nyquist Criteria
The minimum theoretical sampling rate to avoid aliasing is the Nyquist Rate:
Since our actual sampling frequency , aliasing will definitely occur.
Step 3: Apply the Folding Formula
We seek an integer such that the aliased frequency falls below the half-sampling folding limit : For :
Since , the apparent reconstructed frequency is:
Step 4: Verify Graphically and Algebraically
The wave has folded around the folding frequency and is reconstructed as a false sine wave.
4. The Anti-Aliasing Filter (AAF)
4.1 The Fundamental Post-Sampling Rule
The Post-Sampling Filtering Fallacy
Once a signal is sampled and aliasing occurs, the overlapping spectral components merge completely. At this point, the original low frequencies and folded-back high frequencies are mathematically summed into a single amplitude value at each frequency index. No digital filter or software algorithm can ever separate them. Aliasing is an irreversible physical process.
4.2 The Solution: Analog Pre-Filtering
To prevent aliasing, we must remove all frequency components above the half-sampling limit before the signal reaches the sampler or Analog-to-Digital Converter (ADC). This is achieved using an analog Anti-Aliasing Filter (AAF).
+-----------------------+ +---------+
Analog Input --->| Anti-Aliasing Filter |----->| Sampler |---> Sampled Output
x(t) | (Analog Low-Pass) | | (ADC) | x[n]
+-----------------------+ +---------+
Cutoff:
f_c <= f_s / 2
4.3 Structural Design Specifications of an AAF
- Filter Classification: Active or passive analog low-pass filter (LPF).
- Cutoff Frequency (): Designed to match the folding frequency boundary:
- The Over-Sampling Relaxer: In practical engineering, designing a sharp analog filter with a very narrow transition band is incredibly difficult and expensive. Therefore, we deliberately over-sample the signal () to create a wide guard band. This wide guard band allows us to use a cheap, low-order analog anti-aliasing filter while still completely preventing aliasing.
5. Common Mistakes That Cost Marks
The Post-ADC Digital Filtering Trap
In exam papers, examiners often ask if a digital filter implemented in a DSP can eliminate aliasing. Always answer NO. Explain that once the analog signal passes through the ADC sampler, the overlapping spectral copies are already summed. A digital filter cannot distinguish between a true signal and a signal aliased to .
Incorrect Folding Calculations
When calculating folding frequencies, do not just subtract the frequency as . Always take the absolute value . Forgetting the absolute value yields a negative frequency, which is mathematically correct under exponential notation but physically incorrect for real-valued signals without a corresponding phase-sign inversion.
6. PYQ Bank — Verbatim Questions & Answer Plans
6.1 PYQ 2021 Question 1c / 2019 Question 2b [06 Marks]
Question: Explain the aliasing effect and describe the means/filters used to avoid it.
- Answer Plan:
- Define Aliasing mathematically and conceptually (Section 3.1).
- State the condition for under-sampling () which leads to spectral overlap (Section 2.3).
- Draw the overlapping triangular spectrum diagram (Section 2.3).
- Explain the solution: Placing an analog Anti-Aliasing Filter before the sampler with (Section 4.2 & 4.3).
6.2 PYQ 2018 Question 2b [06 Marks]
Question: Draw the criteria and frequency spectrum in case of over-sampling, under-sampling & Nyquist rate sampling.
- Answer Plan:
- Divide your answer into three distinct sub-sections matching Section 2.
- For Over-sampling, state and draw the spaced-out triangular replicas with highlighted guard bands.
- For Nyquist-rate sampling, state and draw the replicas touching exactly.
- For Under-sampling, state and draw overlapping replicas with shaded fold-over aliasing regions.
7. Self-Check Before Moving On
- Can you derive the periodic replicated spectrum equation using time-convolution?
- Do you know the exact frequency criteria for over-sampling, under-sampling, and Nyquist rate sampling?
- Can you calculate the apparent folding frequency of any under-sampled sinusoid using ?
- Can you explain why a digital filter cannot remove aliasing after a signal has been sampled?
- Do you understand the role, physical placement, and cutoff constraints of an analog Anti-Aliasing Filter?
Source: (k.Deergha Rao) signals and systems.pdf (Chapter 7.4), ECE 2107 - Signals and Systems.md, 1.05 The Sampling Theorem Bridge & Multi-Rate Processing.md, Azmat Sir Class Slides.