Professional Documents
Culture Documents
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
1
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
2
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
3
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression Model
y = b0 + b1x +e
where:
b0 and b1 are called parameters of the model,
e is a random variable called the error term.
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
4
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression Equation
E(y) = b0 + b1x
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
5
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression Equation
E(y)
Regression line
Intercept Slope b1
b0
is positive
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
6
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression Equation
E(y)
Intercept
b0 Regression line
Slope b1
is negative
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
7
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression Equation
No Relationship
E(y)
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
8
or duplicated, or posted to a publicly accessible website, in whole or in part.
Estimated Simple Linear Regression Equation
ŷ b0 b1 x
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
9
or duplicated, or posted to a publicly accessible website, in whole or in part.
Estimation Process
Estimated
b0 and b1 Regression Equation
provide estimates of ŷ b0 b1 x
b0 and b1 Sample Statistics
b0, b1
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
10
or duplicated, or posted to a publicly accessible website, in whole or in part.
Least Squares Method
min (y i y i ) 2
where:
yi = observed value of the dependent variable
for the ith observation
y^i = estimated value of the dependent variable
for the ith observation
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
11
or duplicated, or posted to a publicly accessible website, in whole or in part.
Least Squares Method
b1 ( x x )( y y )
i i
(x x ) i
2
where:
xi = value of independent variable for ith
observation
yi = value of dependent variable for ith
_ observation
x = mean value for independent variable
_
y = mean value for dependent variable
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
12
or duplicated, or posted to a publicly accessible website, in whole or in part.
Least Squares Method
b0 y b1 x
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
13
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
14
or duplicated, or posted to a publicly accessible website, in whole or in part.
Simple Linear Regression
Number of Number of
TV Ads (x) Cars Sold (y)
1 14
3 24
2 18
1 17
3 27
Sx = 10 Sy = 100
x2 y 20
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
15
or duplicated, or posted to a publicly accessible website, in whole or in part.
Estimated Regression Equation
b1 ( xi x )( y i y ) 20
5
( xi x ) 2
4
y-Intercept for the Estimated Regression Equation
b0 y b1 x 20 5(2) 10
Estimated Regression Equation
yˆ 10 5x
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
16
or duplicated, or posted to a publicly accessible website, in whole or in part.
Coefficient of Determination
i
( y y ) 2
i
( ˆ
y y ) 2
i i
( y ˆ
y ) 2
where:
SST = total sum of squares
SSR = sum of squares due to regression
SSE = sum of squares due to error
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
17
or duplicated, or posted to a publicly accessible website, in whole or in part.
Coefficient of Determination
r2 = SSR/SST
where:
SSR = sum of squares due to regression
SST = total sum of squares
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
18
or duplicated, or posted to a publicly accessible website, in whole or in part.
Coefficient of Determination
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
19
or duplicated, or posted to a publicly accessible website, in whole or in part.
Sample Correlation Coefficient
where:
b1 = the slope of the estimated regression
equation yˆ b0 b1 x
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
20
or duplicated, or posted to a publicly accessible website, in whole or in part.
Sample Correlation Coefficient
rxy (sign of b1 ) r 2
yˆ 10 is
The sign of b1 in the equation 5 x“+”.
rxy = + .8772
rxy = +.9366
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
21
or duplicated, or posted to a publicly accessible website, in whole or in part.
Assumptions About the Error Term e
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
22
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
23
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance
An Estimate of 2
The mean square error (MSE) provides the estimate
of 2, and the notation s2 is also used.
s 2 = MSE = SSE/(n 2)
where:
SSE ( yi yˆ i ) 2 ( yi b0 b1 xi ) 2
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
24
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance
An Estimate of
• To estimate we take the square root of 2.
• The resulting s is called the standard error of
the estimate.
SSE
s MSE
n2
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
25
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: t Test
Hypotheses
H0 : b1 0
H a : b1 0
Test Statistic
b1 s
t where sb1
sb1 S( xi x ) 2
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
26
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: t Test
Rejection Rule
where:
t is based on a t distribution
with n - 2 degrees of freedom
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
27
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: t Test
b1
3. Select the test statistic. t
sb1
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
28
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: t Test
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
29
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: F Test
Hypotheses
H0 : b1 0
H a : b1 0
Test Statistic
F = MSR/MSE
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
30
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: F Test
Rejection Rule
Reject H0 if
p-value <
or F > F
where:
F is based on an F distribution with
1 degree of freedom in the numerator and
n - 2 degrees of freedom in the denominator
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
31
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: F Test
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
32
or duplicated, or posted to a publicly accessible website, in whole or in part.
Testing for Significance: F Test
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied Slide
33
or duplicated, or posted to a publicly accessible website, in whole or in part.