Why is the Average Power Equal to the Autocorrelation Function at Zero Lag?
One of the most important results in Random Process Theory is the relationship between the average power of a stationary random process and its autocorrelation function. Students often memorize the formula without understanding where it comes from.
In this article, we will derive the result step-by-step and show mathematically why:
where Rx(0) is the autocorrelation function evaluated at zero time delay.
Step 1: Definition of Average Power
For a random process X(t), the average power is defined as the expected value of the square of the process:
Here:
- E[ ] denotes the expectation operator.
- X(t) is the value of the random process at time t.
- The square operation ensures that positive and negative values contribute positively to power.
This definition is analogous to electrical power, where power is proportional to the square of voltage or current.
Step 2: Definition of Autocorrelation Function
The autocorrelation function measures the similarity between a signal and a delayed version of itself. It is defined as:
where:
- Ï„ (tau) represents the time delay (lag).
- Rx(Ï„) tells us how strongly the process at time t is related to its value at time t + Ï„.
If the value of Rx(Ï„) is large, the signal remains highly correlated after that delay. If it is small, the signal changes significantly over time.
Step 3: Evaluate Autocorrelation at Zero Delay
To find the relationship with power, substitute:
into the autocorrelation formula:
Since:
we obtain:
Final Result
Comparing this expression with the definition of average power:
and
we conclude that:
This is a fundamental property of wide-sense stationary (WSS) random processes and is frequently used in communication systems, signal processing, and stochastic analysis.
Intuitive Understanding
Think of autocorrelation as comparing a signal with itself.
- When Ï„ ≠ 0, you compare the signal with a delayed version.
- When Ï„ = 0, you compare every value with itself.
- A quantity compared with itself produces its square.
- The expected value of these squares is exactly the average power.
Therefore, the autocorrelation function reaches its maximum value at zero lag, and that value equals the signal power.
Solved Example
Suppose the autocorrelation function of a random process is:
Find the average power of the process.
Solution
Using the property:
Substitute Ï„ = 0:
Since:
Therefore: