With the introduction of the concept of signal sampling, which produces a discrete time signal by selecting the values of the continuous time signal at evenly spaced points in time, it is now possible to discuss one of the most important results in signal processing, the Nyquist-Shannon sampling theorem. Often simply called the sampling theorem, this theorem concerns signals, known as bandlimited signals, with spectra that are zero for all frequencies with absolute value greater than or equal to a certain level. The theorem implies that there is a sufficiently high sampling rate at which a bandlimited signal can be recovered exactly from its samples, which is an important step in the processing of continuous time signals using the tools of discrete time signal processing.
The Nyquist-Shannon sampling theorem concerns signals with continuous time Fourier transforms that are only nonzero on the interval \((−B,B)\) for some constant \(B\). Such a function is said to be bandlimited to \((−B,B)\). Essentially, the sampling theorem has already been implicitly introduced in the previous module concerning sampling. Given a continuous time signals \(x\) with continuous time Fourier transform \(X\), recall that the spectrum \(X_s\) of sampled signal \(x_s\) with sampling period \(T_s\) is given by \[X_(\omega)=\frac> \sum_
The above discussion has already shown the sampling theorem in an informal and intuitive way that could easily be refined into a formal proof. However, the original proof of the sampling theorem, which will be given here, provides the interesting observation that the samples of a signal with period \(T_s\) provide Fourier series coefficients for the original signal spectrum on \(\left(-\pi / T_, \pi / T_\right)\). Let \(x\) be a \(\left(-\pi / T_, \pi / T_\right)\) bandlimited signal and \(x_s\) be its samples with sampling period \(T_s\). We can represent \(x\) in terms of its spectrum \(X\) using the inverse continuous time Fourier transform and the fact that \(x\) is bandlimited. The result is \[x(t)=\frac \int_<-\pi / T_> X(\omega) e^ d \omega \nonumber \] This representation of \(x\) may then be sampled with sampling period \(T_s\) to produce \[x_(n)=x_\left(n T_\right)=\frac \int_<-\pi / T_>^<\pi / T_> X(\omega) e^> d \omega \nonumber \] Noticing that this indicates that \(x_s(n)\) is the \(n\)th continuous time Fourier series coefficient for \(X(\omega)\) on the interval \(\left(-\pi / T_, \pi / T_\right)\), it is shown that the samples determine the original spectrum \(X(\omega)\) and, by extension, the original signal itself.
Another way to show the sampling theorem is to derive the reconstruction formula that gives the original signal \(\tilde
The Nyquist-Shannon Sampling Theorem and the Whittaker-Shannon Reconstruction formula enable discrete time processing of continuous time signals. Because any linear time invariant filter performs a multiplication in the frequency domain, the result of applying a linear time invariant filter to a bandlimited signal is an output signal with the same bandlimit. Since sampling a bandlimited continuous time signal above the Nyquist rate produces a discrete time signal with a spectrum of the same form as the original spectrum, a discrete time filter could modify the samples spectrum and perfectly reconstruct the output to produce the same result as a continuous time filter. This allows the use of digital computing power and flexibility to be leveraged in continuous time signal processing as well. This is more thoroughly described in the final module of this chapter.
The properties of human physiology and psychology often inform design choices in technologies meant for interaction with people. For instance, digital devices dealing with sound use sampling rates related to the frequency range of human vocalizations and the frequency range of human auditory sensitivity. Because most of the sounds in human speech concentrate most of their signal energy between 5 Hz and 4 kHz, most telephone systems discard frequencies above 4 kHz and sample at a rate of 8 kHz. Discarding the frequencies greater than or equal to 4 kHz through use of an anti-aliasing filter is important to avoid aliasing, which would negatively impact the quality of the output sound as is described in a later module. Similarly, human hearing is sensitive to frequencies between 20 Hz and 20 kHz. Therefore, sampling rates for general audio waveforms placed on CDs were chosen to be greater than 40 kHz, and all frequency content greater than or equal to some level is discarded. The particular value that was chosen, 44.1 kHz, was selected for other reasons, but the sampling theorem and the range of human hearing provided a lower bound for the range of choices.
The Nyquist-Shannon Sampling Theorem states that a signal bandlimited to \(\left(-\pi / T_, \pi / T_\right)\) can be reconstructed exactly from its samples with sampling period \(T_s\). The Whittaker-Shannon interpolation formula, which will be further described in the section on perfect reconstruction, provides the reconstruction of the unique \(\left(-\pi / T_, \pi / T_\right)\) bandlimited continuous time signal that samples to a given discrete time signal with sampling period \(T_s\). This enables discrete time processing of continuous time signals, which has many powerful applications.
This page titled 10.2: Sampling Theorem is shared under a CC BY license and was authored, remixed, and/or curated by Richard Baraniuk et al..
