Why Use a t-Statistic?
Two SigmaData Scientist · Technical ScreenLast updated
This problem tests your conceptual understanding of the t-statistic, specifically how sample parameters influence its value and how it bridges the gap between estimation and hypothesis testing.
The Problem
You are working as a quant researcher analyzing the impact of a specific market signal on asset returns. You have collected a sample of returns X = {x_1, x_2, ..., x_n}.
-
Define the t-statistic for testing the null hypothesis that the population mean return
muequals 0. Explicitly state the formula and define every variable used. -
Explain the intuitive meaning of the t-statistic: How does it treat the relationship between the observed mean, the noise (variance) in the data, and the sample size?
-
Suppose you calculate a t-statistic of 2.1. If you were to increase your sample size
nby a factor of 4 while keeping the sample mean and sample standard deviation constant, what happens to the t-statistic? Show your work. -
Discuss the "t-distribution" assumption. In what scenario would a researcher be justified in using a Z-statistic instead of a t-statistic, and why might that be dangerous in financial time series data?
Hints
Hint 1
Recall that the t-statistic is essentially a signal-to-noise ratio: the estimated mean divided by the standard error.
Hint 2
Consider how the standard error of the mean, `s / sqrt(n)`, scales as `n` increases.
Hint 3
Remember that the t-distribution approaches the standard normal distribution as the degrees of freedom (based on sample size) grow large.
Follow-up questions
- How does the presence of autocorrelation (serial correlation) in your returns data invalidate the standard calculation of the t-statistic?
- If your data is non-normally distributed with heavy tails, how does this affect the reliability of the p-value derived from the t-distribution?
- In a machine learning context, how might you use bootstrapping to estimate the distribution of your mean effect if you are unsure if your data follows a specific distribution?
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.