Statistical model specification explained

y together with years of schooling s and on-the-job experience x , we might specify a functional relationship y = f(s,x) as follows:^[1] ln y = ln y _{0} + \rho s + \beta _{1} x + \beta _{2} x ^{2} + \varepsilon where \varepsilon is the unexplained error term that is supposed to comprise independent and identically distributed Gaussian variables.

The statistician Sir David Cox has said, "How [the] translation from subject-matter problem to statistical model is done is often the most critical part of an analysis".^[2]

Specification error and bias

Specification error occurs when the functional form or the choice of independent variables poorly represent relevant aspects of the true data-generating process. In particular, bias (the expected value of the difference of an estimated parameter and the true underlying value) occurs if an independent variable is correlated with the errors inherent in the underlying process. There are several different possible causes of specification error; some are listed below.

• An inappropriate functional form could be employed.
• A variable omitted from the model may have a relationship with both the dependent variable and one or more of the independent variables (causing omitted-variable bias).^[3]
• An irrelevant variable may be included in the model (although this does not create bias, it involves overfitting and so can lead to poor predictive performance).
• The dependent variable may be part of a system of simultaneous equations (giving simultaneity bias).

Additionally, measurement errors may affect the independent variables: while this is not a specification error, it can create statistical bias.

Note that all models will have some specification error. Indeed, in statistics there is a common aphorism that "all models are wrong". In the words of Burnham & Anderson,

"Modeling is an art as well as a science and is directed toward finding a good approximating model ... as the basis for statistical inference".^[4]

Detection of misspecification

The Ramsey RESET test can help test for specification error in regression analysis.

In the example given above relating personal income to schooling and job experience, if the assumptions of the model are correct, then the least squares estimates of the parameters

\rho and \beta will be efficient and unbiased. Hence specification diagnostics usually involve testing the first to fourth moment of the residuals.^[5]

Model building

Building a model involves finding a set of relationships to represent the process that is generating the data. This requires avoiding all the sources of misspecification mentioned above.

One approach is to start with a model in general form that relies on a theoretical understanding of the data-generating process. Then the model can be fit to the data and checked for the various sources of misspecification, in a task called statistical model validation. Theoretical understanding can then guide the modification of the model in such a way as to retain theoretical validity while removing the sources of misspecification. But if it proves impossible to find a theoretically acceptable specification that fits the data, the theoretical model may have to be rejected and replaced with another one.

A quotation from Karl Popper is apposite here: "Whenever a theory appears to you as the only possible one, take this as a sign that you have neither understood the theory nor the problem which it was intended to solve".^[6]

Another approach to model building is to specify several different models as candidates, and then compare those candidate models to each other. The purpose of the comparison is to determine which candidate model is most appropriate for statistical inference. Common criteria for comparing models include the following: R², Bayes factor, and the likelihood-ratio test together with its generalization relative likelihood. For more on this topic, see statistical model selection.

See also

• Abductive reasoning
• Conceptual model
• Data analysis
• Data transformation (statistics)
• Design of experiments
• Durbin–Wu–Hausman test
• Exploratory data analysis
• Feature selection
• Heteroscedasticity, second-order statistical misspecification
• Information matrix test
• Model identification
• Principle of Parsimony
• Spurious relationship
• Statistical conclusion validity
• Statistical inference
• Statistical learning theory

Further reading

• .
• Book: Asteriou, Dimitrios . Hall . Stephen G. . Stephen G. Hall . Misspecification: Wrong regressors, measurement errors and wrong functional forms . Applied Econometrics . . 2011 . Second . 172–197 .
• Statistical model specification and power: recommendations on the use of test-qualified pooling in analysis of experimental data . Colegrave . N. . Ruxton . G. D. . . 2017 . 284 . 1851 . 20161850 . 10.1098/rspb.2016.1850. 28330912 . 5378071 .
• Book: Gujarati, Damodar N. . Damodar N. Gujarati . Porter . Dawn C.. Dawn C. Porter . Econometric modeling: Model specification and diagnostic testing . Basic Econometrics . . 2009 . Fifth . 467–522 . 978-0-07-337577-9 .
• .
• Book: Kmenta, Jan . Jan Kmenta . Elements of Econometrics . New York . Macmillan Publishers . Second . 1986 . 0-02-365070-2 . 442–455 . registration .
• E. L. . Lehmann . Erich Leo Lehmann . 1990 . Model specification: The views of Fisher and Neyman, and later developments . . 5 . 2 . 160–168 . 10.1214/ss/1177012164 . free .
• MacKinnon . James G. . James G. MacKinnon . 1992 . Model specification tests and artificial regressions . . 30 . 1 . 102–146 . 2727880 .
• Book: Maddala, G. S. . G. S. Maddala . Lahiri . Kajal . Introduction to Econometrics . . Fourth . 2009 . 978-0-470-01512-4 . 401–449 . Diagnostic checking, model selection, and specification testing .
• Sapra. Sunil. A regression error specification test (RESET) for generalized linear models. Economics Bulletin. 3. 1. 2005. 1–6.

Notes and References

1. This particular example is known as Mincer earnings function.
2. .
3. "Quantitative Methods II: Econometrics", College of William & Mary.
4. .
5. Book: Long, J. Scott . J. Scott Long. Pravin K. . Trivedi . Some specification tests for the linear regression model . Kenneth A. . Bollen . Kenneth A. Bollen . J. Scott . Long . Testing Structural Equation Models . . 1993 . 66–110 .
6. .