Statistics How To

Method of Moments Definition and Example

Statistics Definitions > Method of Moments

You may want to read this article first: What is a Moment?

What is Method of Moments?

The method of moments is a way to estimate population parameters, like the population mean or the population standard deviation. The basic idea is that you take known facts about the population, and extend those ideas to a sample. For example, it’s a fact that within a population:
Expected value E(x) = μ
For a sample, the estimator (method of moments) is just the sample mean, . The formula for the sample mean is:
sample mean formula


This is the first moment condition.

The second moment condition involves the variance. The population variance is Var(x) = &sigma2, so we just need to use the method of moments to estimate the variance in the sample. Here’s how the formula is derived:

  • Use the fact that the population variance Var(x) = &sigma2 is the same as: E(x-μ)22.
  • As in the first moment, replace the population expectation by the sample equivalent (the sample mean). However, while the first moment was the sample mean of x, this time it’s x-μ, giving the formula:
    sample variance

The same principal is used to derive higher moments like skewness and kurtosis:
method of moments 2

The above method is probably the most widely used method of moments. There is another method, which uses sample moments about the mean instead of sample moments about the origin. You can read more about that here on the Penn State website (Scroll to “Another form of the method”).

Advantages and Disadvantages

Advantages

  • Method of moments is simple (compared to other methods like the maximum likelihood method) and can be performed by hand.

Disadvantages

  • The parameter estimates may be inaccurate. This is more frequent with smaller samples and less common with large samples.
  • The method may not result in sufficient statistics. In other words, it may not take into account all of the relevant information in the sample.

If you prefer an online interactive environment to learn R and statistics, this free R Tutorial by Datacamp is a great way to get started. If you're are somewhat comfortable with R and are interested in going deeper into Statistics, try this Statistics with R track.

Comments are now closed for this post. Need help or want to post a correction? Please post a comment on our Facebook page and I'll do my best to help!
Method of Moments Definition and Example was last modified: October 12th, 2017 by Andale