Statistics How To

Model Misspecification

Regression Analysis > Model Misspecification

What is Model Misspecification?

Model Misspecification is where the model you made with regression analysis is in error. In other words, it doesn’t account for everything it should. Models that are misspecified can have biased coefficients and error terms, and tend to have biased parameter estimations.

Left Out Variables

Important variables can be missed for a variety of reasons, including by mistake or on purpose. The following models show (1) the correct model and (2) a model without xk+1t:
(1)y1 = Β1x1t + Β2x2t +…Βkxkt + Βk+1xk+1 + η
(2) y1 = Β1x1t + Β2x2t +…Βkxkt + η
The opposite of a left-out variable is an irrelevant variable.

Irrelevant Variables

Irrelevant variables shouldn’t have been put in the model in the first place. The following models show (1) the correct model and (2) a model with an irrelevant variable xk+1t:
(1) y1 = Β1x1t + Β2x2t +…Βkxkt + η
(2)y1 = Β1x1t + Β2x2t +…Βkxkt + Βk+1xk+1 + η

Functional Form Misspecification

When a model has the appropriate explanatory variables, but still fails to account for the relationship between the explanatory and response variables, then the model has functional form misspecification. Examples of function form misspecification include leaving out a squared variable or constraining dy/dx to be constant (Wooldridge, 1994).

Tests for Model Misspecification

These tests are usually performed using software:

  • The Ramsey Regression Specification Error Test (RESET): a general misspecification test for linear regression models.
  • Davidson and MacKinnon J Test: a test for non-nested model specification.

References:
Davidson, R. and J.G. MacKinnon (1981). “Several tests for model specification in the presence of alternative hypotheses,” Econometrica 49, 781–793.
Ramsey, J.B. (1969). “Tests for specification errors in classical linear least-squares analysis,” Journal of the Royal Statistical Society, Series B, 71, 350–371.
Rao, Potluri. “Some Notes on Misspecification in Multiple Regressions.” The American Statistician 25, no. 5 (1971): 37-39. doi:10.2307/2686082.
Wooldridge, J.M. (1994). “A simple specification test for the predictive ability of transformation models,” Review of Economics and Statistics 76, 59–65.

------------------------------------------------------------------------------

If you prefer an online interactive environment to learn R and statistics, this free R Tutorial by Datacamp is a great way to get started. If you're are somewhat comfortable with R and are interested in going deeper into Statistics, try this Statistics with R track.

Comments are now closed for this post. Need help or want to post a correction? Please post a comment on our Facebook page and I'll do my best to help!
Model Misspecification was last modified: October 12th, 2017 by Stephanie Glen