Economics 20 - Prof,Anderson 1
Multiple Regression Analysis
y = b0 + b1x1 + b2x2 +,,, bkxk + u
7,Specification and Data Problems
Economics 20 - Prof,Anderson 2
Functional Form
We’ve seen that a linear regression can
really fit nonlinear relationships
Can use logs on RHS,LHS or both
Can use quadratic forms of x’s
Can use interactions of x’s
How do we know if we’ve gotten the right
functional form for our model?
Economics 20 - Prof,Anderson 3
Functional Form (continued)
First,use economic theory to guide you
Think about the interpretation
Does it make more sense for x to affect y in
percentage (use logs) or absolute terms?
Does it make more sense for the derivative
of x1 to vary with x1 (quadratic) or with x2
(interactions) or to be fixed?
Economics 20 - Prof,Anderson 4
Functional Form (continued)
We already know how to test joint
exclusion restrictions to see if higher order
terms or interactions belong in the model
It can be tedious to add and test extra terms,
plus may find a square term matters when
really using logs would be even better
A test of functional form is Ramsey’s
regression specification error test (RESET)
Economics 20 - Prof,Anderson 5
Ramsey’s RESET
RESET relies on a trick similar to the
special form of the White test
Instead of adding functions of the x’s
directly,we add and test functions of ?
So,estimate y = b0 + b1x1 + … + bkxk +
d1?2 + d1?3 +error and test
H0,d1 = 0,d2 = 0 using F~F2,n-k-3 or
LM~χ22
Economics 20 - Prof,Anderson 6
Nonnested Alternative Tests
If the models have the same dependent
variables,but nonnested x’s could still just
make a giant model with the x’s from both
and test joint exclusion restrictions that lead
to one model or the other
An alternative,the Davidson-MacKinnon
test,uses ? from one model as regressor in
the second model and tests for significance
Economics 20 - Prof,Anderson 7
Nonnested Alternatives (cont)
More difficult if one model uses y and the
other uses ln(y)
Can follow same basic logic and transform
predicted ln(y) to get ? for the second step
In any case,Davidson-MacKinnon test may
reject neither or both models rather than
clearly preferring one specification
Economics 20 - Prof,Anderson 8
Proxy Variables
What if model is misspecified because no
data is available on an important x variable?
It may be possible to avoid omitted
variable bias by using a proxy variable
A proxy variable must be related to the
unobservable variable – for example,x3* =
d0 + d3x3 + v3,where * implies unobserved
Now suppose we just substitute x3 for x3*
Economics 20 - Prof,Anderson 9
Proxy Variables (continued)
What do we need for for this solution to
give us consistent estimates of b1 and b2?
E(x3* | x1,x2,x3) = E(x3* | x3) = d0 + d3x3
That is,u is uncorrelated with x1,x2 and x3*
and v3 is uncorrelated with x1,x2 and x3
So really running y = (b0 + b3d0) + b1x1+
b2x2 + b3d3x3 + (u + b3v3) and have just
redefined intercept,error term x3 coefficient
Economics 20 - Prof,Anderson 10
Proxy Variables (continued)
Without out assumptions,can end up with
biased estimates
Say x3* = d0 + d1x1 + d2x2 + d3x3 + v3
Then really running y = (b0 + b3d0) + (b1 + b
3d1) x1+ (b2 + b3d2) x2 + b3d3x3 + (u + b3v3)
Bias will depend on signs of b3 and dj
This bias may still be smaller than omitted
variable bias,though
Economics 20 - Prof,Anderson 11
Lagged Dependent Variables
What if there are unobserved variables,and
you can’t find reasonable proxy variables?
May be possible to include a lagged
dependent variable to account for omitted
variables that contribute to both past and
current levels of y
Obviously,you must think past and current
y are related for this to make sense
Economics 20 - Prof,Anderson 12
Measurement Error
Sometimes we have the variable we want,
but we think it is measured with error
Examples,A survey asks how many hours
did you work over the last year,or how
many weeks you used child care when your
child was young
Measurement error in y different from
measurement error in x
Economics 20 - Prof,Anderson 13
Measurement Error in a
Dependent Variable
Define measurement error as e0 = y – y*
Thus,really estimating y = b0 + b1x1 + …+
bkxk + u + e0
When will OLS produce unbiased results?
If e0 and xj,u are uncorrelated is unbiased
If E(e0) ≠ 0 then b0 will be biased,though
While unbiased,larger variances than with
no measurement error
Economics 20 - Prof,Anderson 14
Measurement Error in an
Explanatory Variable
Define measurement error as e1 = x1 – x1*
Assume E(e1) = 0,E(y| x1*,x1) = E(y| x1*)
Really estimating y = b0 + b1x1 + (u – b1e1)
The effect of measurement error on OLS
estimates depends on our assumption about
the correlation between e1 and x1
Suppose Cov(x1,e1) = 0
OLS remains unbiased,variances larger
Economics 20 - Prof,Anderson 15
Measurement Error in an
Explanatory Variable (cont)
Suppose Cov(x1*,e1) = 0,known as the classical
errors-in-variables assumption,then
Cov(x1,e1) = E(x1e1) = E(x1*e1) + E(e12) = 0 + se2
x1 is correlated with the error so estimate is biased
? ? ? ?
? ?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
??
?
??
?
??
22
*
2
*
122
*
2
1
22
*
2
1
1
1
111
11
1
,
?p l i m
ex
x
ex
e
ex
e
xV a r
euxC o v
ss
s
b
ss
s
b
ss
sb
b
b
bb
Economics 20 - Prof,Anderson 16
Measurement Error in an
Explanatory Variable (cont)
Notice that the multiplicative error is just
Var(x1*)/Var(x1)
Since Var(x1*)/Var(x1) < 1,the estimate is
biased toward zero – called attenuation bias
It’s more complicated with a multiple
regression,but can still expect attenuation
bias with classical errors in variables
Economics 20 - Prof,Anderson 17
Missing Data – Is it a Problem?
If any observation is missing data on one of
the variables in the model,it can’t be used
If data is missing at random,using a
sample restricted to observations with no
missing values will be fine
A problem can arise if the data is missing
systematically – say high income
individuals refuse to provide income data
Economics 20 - Prof,Anderson 18
Nonrandom Samples
If the sample is chosen on the basis of an x
variable,then estimates are unbiased
If the sample is chosen on the basis of the y
variable,then we have sample selection bias
Sample selection can be more subtle
Say looking at wages for workers – since
people choose to work this isn’t the same as
wage offers
Economics 20 - Prof,Anderson 19
Outliers
Sometimes an individual observation can
be very different from the others,and can
have a large effect on the outcome
Sometimes this outlier will simply be do to
errors in data entry – one reason why
looking at summary statistics is important
Sometimes the observation will just truly
be very different from the others
Economics 20 - Prof,Anderson 20
Outliers (continued)
Not unreasonable to fix observations where
it’s clear there was just an extra zero
entered or left off,etc,
Not unreasonable to drop observations that
appear to be extreme outliers,although
readers may prefer to see estimates with and
without the outliers
Can use Stata to investigate outliers
Multiple Regression Analysis
y = b0 + b1x1 + b2x2 +,,, bkxk + u
7,Specification and Data Problems
Economics 20 - Prof,Anderson 2
Functional Form
We’ve seen that a linear regression can
really fit nonlinear relationships
Can use logs on RHS,LHS or both
Can use quadratic forms of x’s
Can use interactions of x’s
How do we know if we’ve gotten the right
functional form for our model?
Economics 20 - Prof,Anderson 3
Functional Form (continued)
First,use economic theory to guide you
Think about the interpretation
Does it make more sense for x to affect y in
percentage (use logs) or absolute terms?
Does it make more sense for the derivative
of x1 to vary with x1 (quadratic) or with x2
(interactions) or to be fixed?
Economics 20 - Prof,Anderson 4
Functional Form (continued)
We already know how to test joint
exclusion restrictions to see if higher order
terms or interactions belong in the model
It can be tedious to add and test extra terms,
plus may find a square term matters when
really using logs would be even better
A test of functional form is Ramsey’s
regression specification error test (RESET)
Economics 20 - Prof,Anderson 5
Ramsey’s RESET
RESET relies on a trick similar to the
special form of the White test
Instead of adding functions of the x’s
directly,we add and test functions of ?
So,estimate y = b0 + b1x1 + … + bkxk +
d1?2 + d1?3 +error and test
H0,d1 = 0,d2 = 0 using F~F2,n-k-3 or
LM~χ22
Economics 20 - Prof,Anderson 6
Nonnested Alternative Tests
If the models have the same dependent
variables,but nonnested x’s could still just
make a giant model with the x’s from both
and test joint exclusion restrictions that lead
to one model or the other
An alternative,the Davidson-MacKinnon
test,uses ? from one model as regressor in
the second model and tests for significance
Economics 20 - Prof,Anderson 7
Nonnested Alternatives (cont)
More difficult if one model uses y and the
other uses ln(y)
Can follow same basic logic and transform
predicted ln(y) to get ? for the second step
In any case,Davidson-MacKinnon test may
reject neither or both models rather than
clearly preferring one specification
Economics 20 - Prof,Anderson 8
Proxy Variables
What if model is misspecified because no
data is available on an important x variable?
It may be possible to avoid omitted
variable bias by using a proxy variable
A proxy variable must be related to the
unobservable variable – for example,x3* =
d0 + d3x3 + v3,where * implies unobserved
Now suppose we just substitute x3 for x3*
Economics 20 - Prof,Anderson 9
Proxy Variables (continued)
What do we need for for this solution to
give us consistent estimates of b1 and b2?
E(x3* | x1,x2,x3) = E(x3* | x3) = d0 + d3x3
That is,u is uncorrelated with x1,x2 and x3*
and v3 is uncorrelated with x1,x2 and x3
So really running y = (b0 + b3d0) + b1x1+
b2x2 + b3d3x3 + (u + b3v3) and have just
redefined intercept,error term x3 coefficient
Economics 20 - Prof,Anderson 10
Proxy Variables (continued)
Without out assumptions,can end up with
biased estimates
Say x3* = d0 + d1x1 + d2x2 + d3x3 + v3
Then really running y = (b0 + b3d0) + (b1 + b
3d1) x1+ (b2 + b3d2) x2 + b3d3x3 + (u + b3v3)
Bias will depend on signs of b3 and dj
This bias may still be smaller than omitted
variable bias,though
Economics 20 - Prof,Anderson 11
Lagged Dependent Variables
What if there are unobserved variables,and
you can’t find reasonable proxy variables?
May be possible to include a lagged
dependent variable to account for omitted
variables that contribute to both past and
current levels of y
Obviously,you must think past and current
y are related for this to make sense
Economics 20 - Prof,Anderson 12
Measurement Error
Sometimes we have the variable we want,
but we think it is measured with error
Examples,A survey asks how many hours
did you work over the last year,or how
many weeks you used child care when your
child was young
Measurement error in y different from
measurement error in x
Economics 20 - Prof,Anderson 13
Measurement Error in a
Dependent Variable
Define measurement error as e0 = y – y*
Thus,really estimating y = b0 + b1x1 + …+
bkxk + u + e0
When will OLS produce unbiased results?
If e0 and xj,u are uncorrelated is unbiased
If E(e0) ≠ 0 then b0 will be biased,though
While unbiased,larger variances than with
no measurement error
Economics 20 - Prof,Anderson 14
Measurement Error in an
Explanatory Variable
Define measurement error as e1 = x1 – x1*
Assume E(e1) = 0,E(y| x1*,x1) = E(y| x1*)
Really estimating y = b0 + b1x1 + (u – b1e1)
The effect of measurement error on OLS
estimates depends on our assumption about
the correlation between e1 and x1
Suppose Cov(x1,e1) = 0
OLS remains unbiased,variances larger
Economics 20 - Prof,Anderson 15
Measurement Error in an
Explanatory Variable (cont)
Suppose Cov(x1*,e1) = 0,known as the classical
errors-in-variables assumption,then
Cov(x1,e1) = E(x1e1) = E(x1*e1) + E(e12) = 0 + se2
x1 is correlated with the error so estimate is biased
? ? ? ?
? ?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
?
??
?
??
?
??
22
*
2
*
122
*
2
1
22
*
2
1
1
1
111
11
1
,
?p l i m
ex
x
ex
e
ex
e
xV a r
euxC o v
ss
s
b
ss
s
b
ss
sb
b
b
bb
Economics 20 - Prof,Anderson 16
Measurement Error in an
Explanatory Variable (cont)
Notice that the multiplicative error is just
Var(x1*)/Var(x1)
Since Var(x1*)/Var(x1) < 1,the estimate is
biased toward zero – called attenuation bias
It’s more complicated with a multiple
regression,but can still expect attenuation
bias with classical errors in variables
Economics 20 - Prof,Anderson 17
Missing Data – Is it a Problem?
If any observation is missing data on one of
the variables in the model,it can’t be used
If data is missing at random,using a
sample restricted to observations with no
missing values will be fine
A problem can arise if the data is missing
systematically – say high income
individuals refuse to provide income data
Economics 20 - Prof,Anderson 18
Nonrandom Samples
If the sample is chosen on the basis of an x
variable,then estimates are unbiased
If the sample is chosen on the basis of the y
variable,then we have sample selection bias
Sample selection can be more subtle
Say looking at wages for workers – since
people choose to work this isn’t the same as
wage offers
Economics 20 - Prof,Anderson 19
Outliers
Sometimes an individual observation can
be very different from the others,and can
have a large effect on the outcome
Sometimes this outlier will simply be do to
errors in data entry – one reason why
looking at summary statistics is important
Sometimes the observation will just truly
be very different from the others
Economics 20 - Prof,Anderson 20
Outliers (continued)
Not unreasonable to fix observations where
it’s clear there was just an extra zero
entered or left off,etc,
Not unreasonable to drop observations that
appear to be extreme outliers,although
readers may prefer to see estimates with and
without the outliers
Can use Stata to investigate outliers
