Discrete time systems

Introduction

As you already now know, a discrete time system operates on a discrete time signal input and produces a discrete time signal output. There are numerous examples of useful discrete time systems in digital signal processing, such as digital filters for images or sound. The class of discrete time systems that are both linear and time invariant, known as discrete time LTI systems, is of particular interest as the properties of linearity and time invariance together allow the use of some of the most important and powerful tools in signal processing.

Discrete time systems

Linearity and time invariance

A system $H$ is said to be linear if it satisfies two important conditions. The first, additivity, states for every pair of signals $x,y$ that $H(x+y)=H\left(x\right)+H\left(y\right)$ . The second, homogeneity of degree one, states for every signal $x$ and scalar $a$ we have $H\left(ax\right)=aH\left(x\right)$ . It is clear that these conditions can be combined together into a single condition for linearity. Thus, a system is said to be linear if for every signals $x,y$ and scalars $a,b$ we have that

Linearity is a particularly important property of systems as it allows us to leverage the powerful tools of linear algebra, such as bases, eigenvectors, and eigenvalues, in their study.

A system $H$ is said to be time invariant if a time shift of an input produces the corresponding shifted output. In other, more precise words, the system $H$ commutes with the time shift operator $S_T$ for every $T\in \mathbb{Z}$ . That is,

Time invariance is desirable because it eases computation while mirroring our intuition that, all else equal, physical systems should react the same to identical inputs at different times.

When a system exhibits both of these important properties it opens. As will be explained and proven in subsequent modules, computation of the system output for a given input becomes a simple matter of convolving the input with the system's impulse response signal. Also proven later, the fact that complex exponential are eigenvectors of linear time invariant systems will encourage the use of frequency domain tools such as the various Fouier transforms and associated transfer functions, to describe the behavior of linear time invariant systems.

Difference equation representation

It is often useful to to describe systems using equations involving the rate of change in some quantity. For discrete time systems, such equations are called difference equations, a type of recurrence relation. One important class of difference equations is the set of linear constant coefficient difference equations, which are described in more detail in subsequent modules.

Discrete time systems summary

Many useful discrete time systems will be encountered in a study of signals and systems. This course is most interested in those that demonstrate both the linearity property and the time invariance property, which together enable the use of some of the most powerful tools of signal processing. It is often useful to describe them in terms of rates of change through linear constant coefficient difference equations, a type of recurrence relation.