3 views

Uploaded by Namita Dey

2b

- Hint03
- Bab 2.ppt
- Simp Reg
- BA Sample Paper Questions
- Minimal detectable change (MDC)
- Stata Result
- STAT 125-HK. Business Statistics Midterm Exam.docx
- Multiple Regression Analysis: BRM
- Regression Analysis 05
- Regress
- EDP660simplelinearregressionMinitabOutput
- Regression Analysis
- #IJERTV7IS070032
- Upload
- pset1
- Lampiran 6
- SanjayTupepaperofgrwothofsoftwarefirmsinIndia
- Regression
- Econ 113 Probset3 Sol
- Assignment 1

You are on page 1of 14

Multiple linear regression involves one dependent

variable and more than one independent variable. The

equation that describes multiple linear regression model is

given below:

y = 0 + 1 x1 + 2 x2 + .

. + k xk +

.

.,xk are

independent variables. These independent variables being

used to predict the dependent variable.

coefficients (also called model parameters). These

regression coefficients are estimated based on observed

sample data.

The term (pronounced as epsilon) is random error.

Sasadhar Bera, IIM Ranchi

Suppose that n number of observations are collected for

response variable (y) and k number of independent

variables present in the regression model.

i = 1, 2, . . ., n

y

y1

y2

.

yi

.

yn

x1

x11

x21

.

xi1

.

xn1

j = 1, 2, . . .,k

x2

x12

x22

.

xi2

.

xn2

.

.

.

.

.

.

.

xj

x1j

x2j

.

xij

.

xnj

.

.

.

.

.

.

.

xk

x1k

x2k

.

xik

.

xnk

Suppose that n number of observations are collected for

response variable (y) and k number of independent

variables present in the regression model.

The scalar notation of regression model:

yi = 0 + 1 xi1 + 2 xi2 + .

i = 1, 2, . . ., n

j = 1, 2, . . .,k

. + j xij + . . + k xik + i

k = number of independent variables

Suppose that n number of observations are collected for

response variable (y) and k number of independent

variables present in the regression model.

yn1 = Xn(k+1) (k+1) 1 + n1

n = total number of observations, k = total number of

variables, is model parameters in vector notation.

y1

.

y yi

.

y n

1 x11 . x1 j

. . .

.

X 1 x i1 . x ij

. . .

.

1 x . x

n1

nj

.

.

.

.

.

x 1k

.

x ik

.

x nk

0

1

.

j

.

k

1

.

i

.

n

The error in regression model is the difference between

actual and predicted value. It may be positive or negative

value.

Error is also known as residual. Predicted value by

regression equation is called fitted value or fit.

The sum of squared difference between the actual and

predicted values known as sum of square of error. Least

square method minimizes the sum of square of error to

find out the best fitting plane.

It is to be noted that the regressor variables in linear

regression model are non-random. That means its values

are fixed.

Sasadhar Bera, IIM Ranchi

In matrix notation, the regression equation:

y =X +

n

that minimizes L =

i 1

2

i

=

T

y X ( y X)

T

T

T

( L) 2 X y 2 X X 0

Sasadhar Bera, IIM Ranchi

For

ith

y i Xi

ei y i y i

n

2

e

i

i 1

n k 1

of regressors.

MSE

Variance( ) = (X T X) 1

Sasadhar Bera, IIM Ranchi

The test for significance of regression is a test to

determine if there is a linear relationship between the

response variable and regressor variables.

H0 : 1 = 2 = . . . = k = 0

H1 : At least one j is not zero

The test procedure involves an analysis of variance

(ANOVA) partitioning of the total sum of square into a sum

of squares due to regression and a sum of square due to

error (or residual)

Total number of model parameters = p = Number of

regression coefficients = (k+1)

Sasadhar Bera, IIM Ranchi

10

ANOVA table

Source of

Variation

Regression

Residual

error

Total

DF

SS

MS

FCal

SSR

SSR /k =MSR

MSR/MSE

n k-1

SSE

SSE / (n-k-1)

= MSE

n 1

TSS

y

2

i

n

T

SSR yi y XT y i1

n

i 1

n

SSE yi yi y T y XT y

i 1

n

TSS yi y

i 1

11

Coefficient

Adding an unimportant variable to the model can actually

increase the mean square error, thereby decreasing the

usefulness of the model.

The hypothesis for testing the significance of any

individual regression coefficient, say j is

H0: j = 0

H1: j 0

j

2 C jj

, ( n k 1)

element of (XTX)-1 . Reject H0 if Tcal > t , ( n k 1)

2

12

In matrix notation, the regression equation:

y =X +

where Normal (0, 2)

Mean response = y = E(y) = E(X ) + E() = X + 0

y|x = E(y | x0 ) = x0

0

var(y | x0 )

x T0 (XT X)1 x 0

y|x

( n p )

x T0 (XT X)1 x 0

Sasadhar Bera, IIM Ranchi

13

Coefficient of multiple determination =

R2

SSR

=

TSS

SSE

1

TSS

TSS

TSS

SSR : Sum of square due to regression

SSE : Sum of square due to error

TSS : Total sum of square

dependent variable explained by regressor variables.

R2 is measure the goodness of linear fit. The better the

linear fit is, the R2 closer to 1.

14

The major drawback of using coefficient of multiple

determination (R2) is that adding a predictor variable to the

model will always increase R2, regardless of whether the

additional variable is significant or not. To avoid such

situation, regression model builders prefer to use adjusted

R2 statistic.

SSE

2

adj

n 1

( n p)

(1 R 2 )

1

1

TSS

n p

(n 1)

are added to the model.

chance that non-significant terms have been included in the

15

model.

Sasadhar Bera, IIM Ranchi

- Hint03Uploaded byIre Reign Francisquite
- Bab 2.pptUploaded bypuput indah sari
- Simp RegUploaded byNathaly Amado
- BA Sample Paper QuestionsUploaded byNeeraj Purohit
- Minimal detectable change (MDC)Uploaded bynss
- Stata ResultUploaded bysnazrul
- STAT 125-HK. Business Statistics Midterm Exam.docxUploaded byblosome
- Multiple Regression Analysis: BRMUploaded byAgrani Central
- Regression Analysis 05Uploaded byIRPS
- RegressUploaded byAtreya Chakroborty
- EDP660simplelinearregressionMinitabOutputUploaded bySaumya Garg
- Regression AnalysisUploaded byRAKESH2919
- #IJERTV7IS070032Uploaded bygasutama
- UploadUploaded byDan Lu
- pset1Uploaded byKennethFu
- Lampiran 6Uploaded byTri Eri Setianingsih
- SanjayTupepaperofgrwothofsoftwarefirmsinIndiaUploaded byrongon86
- RegressionUploaded byshags
- Econ 113 Probset3 SolUploaded byPrebble Q Ramswell
- Assignment 1Uploaded bybobo010
- 04. BV Final.pdfUploaded byanwarncb18
- v67b05.pdfUploaded byDawsonn-andoh Steve
- A Study of Profitability and Liquidity of Chhimek Laghubitta Bikash Bank Limited, Everest Bank Limited and Janaki FinanceUploaded byDipesh Raj Pandey
- How persistently do firms innovateUploaded byapi-3851548
- Acemoglu 2013 Innovation NetworkUploaded byroblee1
- Collinearity2x2.pdfUploaded byLyly Magnan
- technical problem solving syllabusUploaded byapi-269153238
- e301sample questions2_12Uploaded byOsman Gulseven
- Assumptions RegressionUploaded bySwapnil Patil
- Data Science Course (2)Uploaded byprathyusha

- Norm Exercise1Uploaded byNamita Dey
- Marquess Beta WildStone 13Uploaded byNamita Dey
- Top 10 Advertising Agency in India 2013 _ Best Advertising Agencies in IndiaUploaded byNamita Dey
- M102 Manoj SahuUploaded byNamita Dey
- Weekly Workshift Scheduling_Summary of a CaseUploaded byNamita Dey
- Introduction to Social Crm for TravelUploaded byNamita Dey
- Norm_Exercise2.docUploaded byNamita Dey
- Thomas Cook CrmUploaded byahen123
- EspnUploaded byNamita Dey
- Norm Exercise3 (1)Uploaded byLaura Catalina Perez
- Inter_NPDUploaded bypraneeth9
- Tripadvisor Ppp OptUploaded byNamita Dey
- S128Uploaded byNamita Dey
- Travel and TourismUploaded byNamita Dey
- CDK Digital Case Prep QuestionsUploaded byNamita Dey
- InventoryUploaded byNamita Dey
- 2009_sol_z_tableUploaded bySani Abu Naufal
- Decoding Patanjali’s Popularity _ VCCircleUploaded byNamita Dey
- Sport Obermeyer CaseUploaded byNamita Dey
- Session 1Uploaded byNamita Dey
- New Text Document.txtUploaded byNamita Dey
- Hydro_review-2014Uploaded byNamita Dey
- docslide.us_ch-03-case-sport-obermeyer.pptUploaded byAnkit Mishra
- Ultratech and Jaypee Associates DealUploaded byNamita Dey
- Demographic QuestionairesUploaded byNamita Dey
- 812Uploaded byNamita Dey
- SimulationUploaded byNamita Dey
- CRISIL First Cut_CPI_IIP_Aug_2016.pdfUploaded byAnirudh Kumar
- Additinal SurchargeUploaded byNamita Dey

- Atomic NucleusUploaded bysudha24_7
- EBO 4 Grid EditUploaded by13670319
- Ov5647 FullUploaded byFrancisc Moldovan
- Slurry Erosion Characteristic and Erosion Mechanisms of Stainless SteelUploaded byZhao Yuqiao
- Rajat Report on Folding TableUploaded byRajat Thakur
- notes4Uploaded byManh Vo
- Peter Ragnar the Awesome Science of LuckUploaded byJames T-rex
- Lecture 6Uploaded byMohamed Arafa
- Rahughat HE ProjectUploaded byAnonymous ufMAGXcskM
- Review of P-y Relationships in Cohesionless SoilUploaded byMa Rco
- The Artificial Kidney Investigating Current Dialysis MethodsUploaded byalejzamora9
- FULLTEXT01.pdfUploaded byroyclhor
- CFD-ACI-318-11Uploaded byLy Piseth
- specific yield.pdfUploaded byVicky Ceunfin
- 7. Water Level Sensing Using PLCUploaded byvinothnrv
- OzoneUploaded byJobin Varghese
- rocks and minerals webquest justin powersUploaded byapi-264089789
- Utility FogUploaded bySashank D Champ
- On Measurement of SmokeUploaded byAllen DY Yang
- Biomechanics - CopyUploaded byShounak Ghosh
- T60 REFUploaded byNeelakandan Masilamani
- basic of composite resinUploaded byRajesh Jain
- Polymer Blend'sUploaded byMohsin Alam
- MK6_EG_PCP_REV-20120612.pdfUploaded bymohdnazir
- CK 12 Chemistry Second EditionUploaded byjmrks
- A View of Automotive Control SystemUploaded byherry
- Lecture 25Uploaded byadsharif
- Physics SPM ModificationsUploaded byMuhammad Jaziem
- Pagilagan Rashleigh Rhon V.Uploaded byMichael Camit Eso
- Fornadel - Mineralogical, Stable Isotope Au-Te Mineralization GreeceUploaded byTzontonel