Random Variable and Random Process
In the fields of probability theory and statistics, understanding the distinction between a Random Variable and a Random Process (Stochastic Process) is fundamental. This guide breaks down these concepts with mathematical precision and practical examples.
1. Random Variable (RV)
Definition:
A Random Variable is a deterministic function that maps each possible outcome of a random experiment to a unique real number.
A Random Variable is a deterministic function that maps each possible outcome of a random experiment to a unique real number.
Mathematical Representation
A random variable X is defined as a mapping from the sample space S to the set of real numbers ℝ:
X : S → ℝ
- S (Sample Space): The set of all possible outcomes of an experiment.
- s ∈ S: A specific outcome.
- X(s): The numerical value associated with outcome s.
Example: Rolling a Fair Die
Consider a single roll of a six-sided die.
Consider a single roll of a six-sided die.
- Sample Space: S = {1, 2, 3, 4, 5, 6}
- Random Variable X: Defined as the value appearing on the top face.
2. Random Process (Stochastic Process)
Definition:
A Random Process (or Stochastic Process) is an indexed collection of random variables, typically indexed by time, representing a system that evolves over time.
A Random Process (or Stochastic Process) is an indexed collection of random variables, typically indexed by time, representing a system that evolves over time.
Mathematical Representation
A random process is denoted as a family of random variables:
{ X(t, s) : t ∈ T, s ∈ S }
Where:
- X(t): A random variable for every fixed time t.
- T (Index Set): Usually represents time (can be discrete or continuous).
- S (Sample Space): The set of all possible realizations (trajectories).
Example: Stock Market Prices
Consider the price of a specific stock measured every hour.
Consider the price of a specific stock measured every hour.
- X(1): Price at 9:00 AM (Random Variable)
- X(2): Price at 10:00 AM (Random Variable)
- X(t): Price at any time t.
Comparison: Random Variable vs. Random Process
To differentiate the two, consider that a random variable provides a "snapshot" of uncertainty, while a random process provides a "movie" of uncertainty over time.
| Feature | Random Variable | Random Process |
|---|---|---|
| Core Concept | A single numerical value per outcome. | A function of time/index. |
| Notation | X or X(s) | {X(t), t ∈ T} |
| Domain | Depends only on the Sample Space (S). | Depends on Sample Space (S) AND Time (T). |
| Outcome | A single number (e.g., 5). | A waveform or time-series (Sample Path). |
| Application | Rolling dice, coin flips, height of a person. | EEG signals, weather forecasting, stock trends. |
Summary
- Function Mapping: A Random Variable maps S → ℝ. A Random Process maps S × T → ℝ.
- Realization: A single observation of a random variable is a number; a single observation of a random process is a signal/function (often called a realization or sample path).
- Interchangeability: The term Stochastic Process is synonymous with Random Process.
- Ensemble: The collection of all possible sample functions in a random process is called an Ensemble.