Unit Roots and the ADF Test
The random walk and the difference between a stochastic and deterministic trend, the augmented Dickey–Fuller test, its non-standard null distribution, and the spurious-regression trap that manufactures fake relationships between unrelated prices.
Prerequisites: Stationarity, ARMA Models
A unit root is the precise statement of what makes a price series non-stationary: it wanders with no tendency to return, its variance grows without bound, and shocks to it are permanent. Distinguishing a unit-root (random-walk) series from a stationary or trend-stationary one is not academic hair-splitting, it determines whether you difference or detrend, whether a regression between two series is meaningful or nonsense, and whether a "mean-reverting spread" is real. The augmented Dickey–Fuller test is the standard instrument, and the spurious-regression phenomenon is the expensive lesson behind why it matters.
The random walk and the unit root
Consider the AR(1) . The reciprocal characteristic root is , and stationarity requires . The boundary case ,
is the random walk, a unit root. Its properties are qualitatively different from a stationary AR(1):
- Permanent shocks. Iterating, : every shock is fully absorbed into the level forever; there is no mean reversion. (A stationary AR(1) decays shocks at rate .)
- Variance grows with time. . The series has no fixed variance to estimate, weak stationarity fails.
- No unconditional mean to revert to. The best forecast of is just (a martingale), whatever the horizon.
Such a series is integrated of order one, : its first difference is stationary . This is why prices () are modeled through returns (). See Stationarity.
Stochastic versus deterministic trend
Both a random walk with drift, , and a trend-stationary process, with stationary , look like upward-drifting lines. But they demand opposite remedies:
- Difference-stationary (unit root): the trend is stochastic; the right transform is differencing. Detrending by regression leaves the series non-stationary.
- Trend-stationary: the trend is deterministic; the right transform is regressing out the trend. Differencing over-differences it, inducing a non-invertible MA unit root.
Choosing wrong leaves non-stationarity in or destroys real structure, which is exactly what a unit-root test is for.
The Dickey–Fuller test
Test (unit root) against (stationary). Rewrite the AR(1) by subtracting :
so the unit-root null becomes against . You run this regression and look at the -statistic on . The crucial subtlety: under the null the regressor is itself non-stationary, so the -statistic does not follow a Student- or normal distribution. Its distribution is non-standard (a functional of Brownian motion), so you must compare against the special Dickey–Fuller critical values, which are more negative than the usual ones (about at 5% with a constant, versus ). Using the normal table here is a classic error that massively over-rejects. The augmented Dickey–Fuller (ADF) test adds lagged differences to soak up serial correlation in so the residuals are white:
You choose whether to include the constant and trend based on the series; the critical values differ for each specification. The KPSS test flips the null (stationary under ) and is often reported alongside ADF for a confirmatory cross-check, since ADF has notoriously low power.
The spurious-regression trap
This is why unit roots matter to a trader. Granger and Newbold showed that regressing one independent random walk on another unrelated random walk produces, with high probability, a large and a hugely significant -statistic on the slope, a completely fake relationship. Two series that share nothing but a stochastic trend will look strongly "related" because both wander persistently. The tell is a very low Durbin–Watson (strongly autocorrelated residuals) alongside the high . Regressing price levels on price levels is exactly this trap: correlations of levels are near-meaningless. The disciplines that avoid it: regress returns (differenced, series) on returns, or, when the levels genuinely move together, test for Cointegration, the one legitimate way to regress on .
Worked example
Take two independent simulated random walks (no relationship whatsoever). Regress on in levels: you routinely get and on the slope, spuriously "significant." Now first-difference both and regress on : the slope is insignificant and , correctly revealing no relationship. Same data, opposite conclusions, the levels regression was reading shared wandering as association. Running ADF on each level fails to reject the unit root (as it should), warning you not to regress the levels in the first place.
Failure modes in financial data
- Low power. ADF struggles to distinguish a true unit root from a stationary process with close to 1 (e.g. ), exactly the persistent-but-mean-reverting case a pairs trader cares about. Short samples make this worse; pair ADF with KPSS and economic judgment.
- Structural breaks masquerade as unit roots. A stationary series with a level shift is often mistaken by ADF for ; break-robust tests (Zivot–Andrews) are needed.
- Over-differencing. Differencing a trend-stationary or already-stationary series introduces a non-invertible MA and inflates variance, the mirror-image mistake.
- Fat tails and volatility clustering distort the finite-sample null distribution of the ADF statistic; the tabulated critical values assume homoskedastic Gaussian errors.
In interviews
Define a unit root via in an AR(1) and list the three consequences, permanent shocks, variance growing as , and the martingale forecast . Set up the ADF regression as testing , and, the point that separates the prepared candidate, stress that the test statistic has a non-standard (Dickey–Fuller) distribution, not Student-, because is non-stationary under the null, so you must use special critical values. Explain the difference-stationary vs trend-stationary remedies (difference vs detrend). The spurious-regression story is the applied payoff: regressing on manufactures fake significance, which is why we model returns and test for cointegration before ever regressing price levels.
Practice in interviews
Further reading
- Dickey & Fuller (1979), Distribution of the Estimators for Autoregressive Time Series with a Unit Root
- Hamilton, Time Series Analysis (Ch. 15–17)
- Granger & Newbold (1974), Spurious Regressions in Econometrics