Inferential Statistics > Comparison of Means
Comparison of Means TechniquesThere are many cases in statistics where you’ll want to compare means for two populations or samples. Which technique you use depends on what type of data you have and how that data is grouped together.
The four major ways of comparing means from data that is assumed to be normally distributed are:
- Independent Samples T-Test. Use the independent samples t-test when you want to compare means for two data sets that are independent from each other. Click here for a step by step article.
- One sample T-Test. Choose this when you want to compare means between one data set and a specified constant (like the mean from a hypothetical normal distribution). Click here for a step by step article.
- Paired Samples T-Test. Use this test if you have one group tested at two different times. In other words, you have two measurements on the same item, person, or thing.The groups are “paired” because there intrinsic connections between them (i.e. they are not independent). This comparison of means is often used for groups of patients before treatment and after treatment, or for students tested before remediation and after remediation. Click here for a step by step article.
- One way Analysis of Variance (ANOVA). Although not really a test for comparison of means, ANOVA is the main option when you have more than two levels of independent variable. For example, if your independent variable was “brand of coffee” your levels might be Starbucks, Peets and Trader Joes. Use this test when you have a group of individuals randomly split into smaller groups and completing different tasks (like drinking different coffee).
Non Normal Data
If you have non-normal data (or if you don’t know what distribution your data comes from), you can’t use any of the above tests for comparison of means. You must use a non-parametric test (non-parametric basically means that you don’t know the distributions’s parameters):
- For independent samples, use the Mann-Whitney U test. This test is essentially the same as the t-test for independent samples.
- For paired groups, use Wilcoxon Signed Rank. This test compares medians, not means.
If you prefer an online interactive environment to learn R and statistics, this free R Tutorial by Datacamp is a great way to get started. If you're are somewhat comfortable with R and are interested in going deeper into Statistics, try this Statistics with R track.Comments are now closed for this post. Need help or want to post a correction? Please post a comment on our Facebook page and I'll do my best to help!