Linear prediction

related topics
{math, number, function}
{rate, high, increase}
{system, computer, user}

Linear prediction is a mathematical operation where future values of a discrete-time signal are estimated as a linear function of previous samples.

In digital signal processing, linear prediction is often called linear predictive coding (LPC) and can thus be viewed as a subset of filter theory. In system analysis (a subfield of mathematics), linear prediction can be viewed as a part of mathematical modelling or optimization.

Contents

The prediction model

The most common representation is

where \widehat{x}(n) is the predicted signal value, x(ni) the previous observed values, and ai the predictor coefficients. The error generated by this estimate is

where x(n) is the true signal value.

These equations are valid for all types of (one-dimensional) linear prediction. The differences are found in the way the parameters ai are chosen.

For multi-dimensional signals the error metric is often defined as

where \|.\| is a suitable chosen vector norm.

Estimating the parameters

The most common choice in optimization of parameters ai is the root mean square criterion which is also called the autocorrelation criterion. In this method we minimize the expected value of the squared error E[e2(n)], which yields the equation

for 1 ≤ jp, where R is the autocorrelation of signal xn, defined as

and E is the expected value. In the multi-dimensional case this corresponds to minimizing the L2 norm.

The above equations are called the normal equations or Yule-Walker equations. In matrix form the equations can be equivalently written as

where the autocorrelation matrix R is a symmetric, Toeplitz matrix with elements ri,j = R(ij), vector r is the autocorrelation vector rj = R(j), and vector a is the parameter vector.

Full article ▸

related documents
Constant term
Matrix addition
Catalan's conjecture
Symmetric tensor
Sather
Infinite set
Commutative diagram
Condition number
Interpreted language
Canonical LR parser
Dirichlet's theorem on arithmetic progressions
Most significant bit
Atlas (topology)
BQP
EXPTIME
Cauchy's integral theorem
Linear span
Finitely generated abelian group
Single precision
NC (complexity)
Merge algorithm
Nilpotent group
Wreath product
Vector calculus
Exponential time
Unification
Rational root theorem
Genus (mathematics)
Hilbert's basis theorem
Addition of natural numbers