Questions to Address for the Org Change Analyses

1. What has been the overall student response to the Organizational Change PBL course over the past 5
years?
a. What is the overall level of student response for 5 year period? (use course item)
Pivot tables illustrating “overall course rating” of OC/other PBL courses/Non-PBL course overtime/each term
* some of the courses are not taught every term, therefore there are some missing data
b. How does overall student response to this module compare to the other PBL modules (as a group) for
the 5 year period? (use course item)
c. How does student response to this module compare to non-PBL courses? For the 5 year period? (use
course item)
d. How consistent has student response been over the 5 year period of use? (no stat test; just use
course item and chart the results on a graphic analysis)
e. To what extent does the student response depend upon the instructor? (run correlation, then test for
differences; also graph the differences among the 3 instructors term by term over time also showing
the PBL and non-pbl means on the same graph term by term)
1-What has been the overall student response to the Organizational Change PBL course over the past 5
years?
a)What is the overall level of student response for 5 year period? (use course item)

Average of 3. Overall Academic

Course Rating Year The Table shows the changes in overall
Year 2001 2002 2003 2004 2005 Average course rating over 5 years. The first 2
NonPBL 3.69824 3.91593 3.93862 4.02331 3.96712 3.89640 years OC rating was lower than 3.5 and
PBL 3.72281 3.65429 3.95987 4.07856 4.08798 3.90550
in the year 2003, the rating is higher
Average 3.70369 3.86196 3.94403 4.03672 3.99628 3.89852
than 3.9. Interestingly, the standard
StdDev of 3. Overall deviation of OC rating has been
Course Rating Academic Year decreased over the past 5 years. This
Year 2001 2002 2003 2004 2005 implies that the teaching methods,
NonPBL 0.45973 0.35053 0.44910 0.45291 0.42638 teachers and curriculum have started to
PBL 0.47032 0.37464 0.31939 0.27301 0.26325 be in place and stable.
 PBL Course Overall Rating Standard Deviation of Over All PBL Class Rating:

4.15000 0.50000
4.10000 0.45000
4.05000 0.40000
4.00000
0.35000
3.95000
0.30000
3.90000
PBL 0.25000 PBL
3.85000
0.20000
3.80000
0.15000
3.75000
3.70000 0.10000
3.65000 0.05000
3.60000 0.00000
2000 2001 2002 2003 2004 2005 2006 2000 2001 2002 2003 2004 2005 2006

Considering details in each term over the past 5 years, there are fluctuations in early 2002
2001/1 2001/2 2001/3 2002/1 2002/2 2002/3 2003/1 2003/2 2003/3 2004/1 2004/2 2004/3 2005/1 2005/2 2005/3
nonPBL 3.59902 3.71917 3.81484 3.92064 3.89753 4.04361 4.00784 3.96400 4.04052 4.07159 4.00365 4.10037 4.02426 3.99967 4.13914
other PBL 3.57261 3.66773 4.05158 3.83975 3.42724 3.71241 3.92421 4.01406 4.10069 4.26484 4.09966 4.06654 4.17255 4.27825 4.20276
PBL:OC 4.10201 4.30420 4.08333 3.96673 3.95452 4.00000 4.17628 4.29014 4.13506 4.12892 4.17371 4.40000 4.40417 4.39167
Table [1] : average course rating over time (2001/1-2005/3)
 4.60000
4.40000
4.20000
4.00000 nonPBL
3.80000 other PBL
3.60000 PBL:OC
3.40000
3.20000
3.00000
1

3
/

/
01

01

02

03

05
03

04

05
20

20

20

20

20

20

20

20
Figure [1] average course rating over time (2001/1-2005/3)

The average course rating over 5 years shows that PBL and OC have higher average than non-PBL courses.
While OC it self has, on average, higher scores than other PBL courses
 2001/1 2001/2 2001/3 2002/1 2002/2 2002/3 2003/1 2003/2 2003/3 2004/1 2004/2 2004/3 2005/1 2005/2 2005/3
nonPBL 0.44478 0.41253 0.40932 0.35533 0.37693 0.33597 0.4004 0.47688 0.41214 0.3986 0.50954 0.47416 0.44188 0.47279 0.36403
PBL 0.34959 0.37396 0.25886 0.35643 0.51534 0.30737 0.34346 0.28424 0.39609 0.19201 0.39174 0.31355 0.37461 0.2393 0.34752
PBLOC 0.45507 0.35985 0.21067 0.49329 0.30318 0.38713 0.0447 0.12426 0.36287 0.0766 0.35707
Table [2] : Standard Deviation of course rating over time (2001/1-2005/3)

0.6 0.6

0.5 0.5

0.4 0.4
PBL
0.3 0.3 PBLOC
nonPBL
0.2 0.2

0.1 0.1

0 0
2001/1
2001/2

2002/1

2002/3
2003/1
2003/2
2003/3
2004/1

2004/3
2005/1
2005/2
2001/3

2002/2

2004/2

2005/3
Figure [2] Standard Deviation of course rating over time (2001/1-2005/3)
OC , in general has a lower standard deviation than other courses (other PBL and Non-PBL)
 Figure
4.90000
Average: Over All Instructor Rating
4.70000

4.50000

4.30000 Patchanee
Philip
4.10000
Pornkasem

3.90000

3.70000

3.50000
2000.5 2001 2001.5 2002 2002.5 2003 2003.5 2004 2004.5 2005 2005.5

0.35000
Standard Deviation: Over All Instructor Rating
0.30000

0.25000

0.20000 Patchanee
Philip
0.15000
Pornkasem
0.10000

0.05000

0.00000
2000 2001 2002 2003 2004 2005 2006
2. To what extent has the module developed student understanding of the desired content?
a. Overall mean/SD response on develop understanding item
b. Test mean of non-PBL against PBL on same item
• question No.9 was used ONLY in the last term of 2005

3. To what extent has the module encouraged active learning?

a. Overall mean/SD response on active learning item
b. Test mean of non-PBL against PBL on same item
Active Learning
Q13
Average of 13. Ability to actively involve Student In learning Academic_Year Academic Term
2001 2002 2003 2004 2005
PBL? 1 2 3 1 2 3 1 2 3 1 2 3 1 2 3
nonPBL 3.59902 3.71917 3.81484 3.92064 3.89753 4.04361 4.00784 3.964 4.04052 4.07159 4.00365 4.10037 4.02426 3.99967 4.13914
PBL 3.67849 3.77381 4.05385 3.86797 3.55278 3.7535 3.98023 4.05859 4.1056 4.23623 4.11288 4.09433 4.20151 4.29639 4.20276
avg 3.61544 3.73343 3.85945 3.90817 3.81335 4.01032 3.99974 3.98972 4.05236 4.11275 4.03486 4.09932 4.06311 4.08118 4.15305

4.4
Over the years, PBL gains higher average scores
4.2
4
3.8 nonPBL
3.6 PBL

3.4
3.2
3
1

3
/

/
01

02

03

03

04

05
01

05
20

20

20
20

20

20

20

20
 Active Learning Q13 std
4.3 2001 2002 2003 2004 2005 avg
nonPBL 3.695624 3.94967 4.000356 4.054658 4.048077 3.935038
PBL
4.2 3.796094 3.706659 4.038346 4.148829 4.244956 3.991532
avg4.1 3.717915 3.899542 4.010021 4.077523 4.09557 3.94824

4
3.9 nonPBL
3.8 PBL
3.7
3.6
3.5
3.4
2001 2002 2003 2004 2005 avg

Standard Deviation over the years

PBL? 0.5 2001 2002 2003 2004 2005 avg

nonPBL 0.431877 0.361295 0.434547 0.465884 0.435082 0.449826
PBL 0.450.418848 0.45644 0.334651 0.317537 0.309908 0.415568
avg 0.40.430387 0.394245 0.411205 0.435814 0.416419 0.442547
0.35
0.3
nonPBL
0.25
PBL
0.2
0.15
0.1
0.05
0
2000 2001 2002 2003 2004 2005 2006
4. To what extent has the module encouraged students to learn from each other?
a. Overall mean/SD response on encouraged students item
b. Test mean of non-PBL against PBL on same item
5. To what extent has the module made the content practical?
a. Overall mean/SD response on made the content practical item
b. Test mean of non-PBL against PBL on same item
6. Finally, create a graph that plots the mean responses to 1a, 2a, 3a, 4a, 5a against the non-pbl mean for
each term for 5 years.
Appendix
Descriptive Statistics of Data Set:
The dataset consists of:
-Questionnaire responses from students between 2001-2006
-The questionnaire has 15 questions: Only 6 questions address PBL features
-All courses are taught in English
-Consult/Research courses are
Count of Course Academic
Code Year similar to independent study
Grand -Foundation courses are courses
Course Category 2001 2002 2003 2004 2005 Total that all students are required to
take
Consult 1 1 3 5 -Foundation and specialization
Core 63 68 70 70 62 333
are electives in each field
CP: Consulting -Specialization courses are
Practice 69 46 72 59 55 301 electives
-Core courses are courses
Foundation 52 42 47 43 45 229 required in each field of study
Foundation &
-CP consulting practice are
Specialization 13 13 13 7 9 55
courses that required students
Research 18 3 2 2 2 27 to practice/participate in
activities (PBL)
Specialization 96 51 78 61 52 338 - OC: Organizational Change is
Grand Total 311 223 283 243 228 1288
CP (Consulting Practice) Module
that uses Computer Simulation
in class
Questions:
1_Communicate_clearly_in_English
2_Helpfilness_Outside_Class
3_Overall_Course_Rating
4. Instructor's Knowledge
5. Preparation for Class
6. Punctuality Starting Class on time
7. Feedback on assignment
8. Overall Instructor Rating
9. Ability to develop Student understand in subject
10. Clarity in Responding to Student Question
11. Handouts & Reading Material Effectiveness
12. Ability to Make content practical
13. Ability to actively involve Student In learning
14. Assignments assess student Understanding
15. Encouragement to learn from each other
Count of Course Title Academic Year
Course Title 2001 2002 2003 2004 2005 Total Sessions
Applications of Emerging Telecommunications 2 2
Technology
Applied Electronic Commerce 4 1 1 1 7
Business Communications 4 1 1 6
Comp. Strategy 1 1
Competitive Strategy 1 2 3 3 1 10
Consulting Internship 1 1 3 5
Corp Strategy 2 2
Corporate Communications and Networking 7 1 1 9
Corporate Strategy and Performance 7 4 6 5 2 24
Measurement
CP (D2I-1st half) 1 1
CP (D2I-2nd half) 1 1
CP (ES -2nd half) 1 1
CP (ES-1st half) 1 1
CP (NP-1st half) 1 1
CP (NP-2nd half) 1 1
CP (OC-1st half) 3 3
CP (R2E-1st half) 1 1
CP (RfC-2nd half) 2 2
CP (SfS-1st half) 1 1
CP (SfS-2nd half) 1 1
CP CC 8 8
CP D2I 8 11 8 10 6 43
CP ES 10 2 4 16
CP NPP 7 7
CP OC 11 10 13 10 6 50
CP R2E 31 15 26 19 7 98
CP RfC 7 12 7 26
CP SfS 11 10 8 6 4 39
Customer Relationship Management 3 1 4 1 1 10
Decision Skills 5 2 4 11 14 36
Dispute Solution 1 1
ECON 3 3
Electronic Business Management 3 3
Ent. Finance 1 1
Enterprise Resource Management 4 6 8 6 1 25
Entrepreneurial Finance Management 2 3 2 2 2 11
ERM 1 1
FINANCE 3 3
Finance Modelling for Telecommunications 1 1
Business
Financial Planning and Control 13 13 15 14 9 64
Franchise Management 2 1 3 2 2 10
Fundamentals of Management of Technology 2 2
Good Governance 3 2 5
Human Resour. 1 1
Human Resources Planning & Development 1 1 1 1 4
Independent Study 18 1 2 2 2 25
Information Exploitation 4 4 2 2 12
Inno.and Ind. Mgmt. 1 1
Innovation and Industrial Venturing 1 3 2 2 1 9
Management
Innovation and Strategies for Electronic 1 1 1 3
Commerce
Innovation Mgmt 1 1
International Business Management 4 5 5 5 1 20
International Financial Planning and Control 2 1 3 3 1 10
Internet and the World Wide Web 2 2 1 5
Internet Marketing 1 2 2 5
Internet Security 3 3
Introduction to Business and Management Research 3 2 5
Introduction to Business Plan 2 3 5
Knowledge Management 1 1 1 3
Knowledge Mgmt 1 1
Leadership & 1 1
Leadership and Team Management 5 3 6 2 1 17
Management in Research & Development in 1 1
Science & Technology
Management Information Systems 12 14 14 13 10 63
Management of Innovation of Science & 2 2 1 5
Technology
Managerial Decision Science 5 5 6 1 17
Managerial Negotiation Strategy 3 2 2 1 2 10
Managing Enterprises in a Digital Economy 6 1 7
Master Thesis (A) 2 2
MIS 4 4
OB&HR 3 3
OD&Mgmt for Changes 1 1
Operation Management 2 2
Organization Behavior and Human Resource 8 11 8 10 7 44
Management
Organization Development and Management 2 1 3 3 2 11
for Changes
Organizational Structure & Design 1 1 1 3
Policy Analysis 4 4
Princ. Of E-Com. 2 2
Principles of Electronic Commerce 7 6 8 5 3 29
Principles of Management 11 14 13 14 13 65
Process Eng. 1 1
Process Engineering 4 1 2 1 1 9
Product Design and Engineering 1 1
Product Development 4 2 3 2 3 14
Project Management 13 13 13 7 8 54
Public Participation Management 1 1
Quality Management 2 2 4 8
Reward & Performance Management 2 1 1 4
Sales Logistics 2 1 1 4
Selected Topic in Electronic Commerce 3 2 5
Management
Seminar in Management 3 9 10 8 30
Seminar in Mgmt 1 1
Seminar in Mgmt 2 2
Small Business Management 6 2 2 3 1 14
Small Business Mgmt. 1 1
Strate. Marketing Mgmt 3 3
Strate. Mgmt. 4 4
Strategic Management 10 6 7 7 5 35
Strategic Marketing Management 14 14 13 14 9 64
Struc. Found of N.V. 2 2
Supply Chain Management 5 3 3 2 1 14
Technology Transfer Management 1 1
Telecommunications Regulation 1 1
Telecommunications Service Costing 1 1
Thai Economy in Global Context 13 13 15 15 8 64
Value Chain and Process Reengineering 1 1 1 3
Management
Grand Total 311 223 283 243 228 1288

Category/Courses
Acade
mic
Year
G
Course 20 20 20 20 rand
Category Course Title 2001 02 03 04 05 Total

Consult Consulting Internship 1 1 3 5

Consult Total 1 1 3 5

Core ECON 3 3

FINANCE 3 3

Financial Planning and Control 13 13 15 14 9 64

Management Information Systems 12 14 14 13 10 63

MIS 4 4

Principles of Management 11 14 13 14 13 65

Strate. Marketing Mgmt 3 3

Strategic Marketing Management 14 14 13 14 9 64

Thai Economy in Global Context 13 13 15 15 8 64

Core Total 63 68 70 70 62 333

CP CP (D2I-1st half) 1 1

CP (D2I-2nd half) 1 1

CP (ES -2nd half) 1 1

CP (ES-1st half) 1 1

CP (NP-1st half) 1 1

CP (NP-2nd half) 1 1

CP (OC-1st half) 3 3

CP (R2E-1st half) 1 1

CP (RfC-2nd half) 2 2

CP (SfS-1st half) 1 1

CP (SfS-2nd half) 1 1

CP CC 8 8

CP D2I 8 11 8 10 6 43
 CP ES 10 2 4 16

CP NPP 7 7

CP OC 11 10 13 10 6 50

CP R2E 31 15 26 19 7 98

CP RfC 7 12 7 26

CP SfS 11 10 8 6 4 39

CP Total 69 46 72 59 55 301
Applications of Emerging
Foundation Telecommunications Technology 2 2

Comp. Strategy 1 1

Competitive Strategy 1 2 3 3 1 10
Corporate Communications and
Networking 7 1 1 9

Decision Skills 5 2 4 11 14 36

Enterprise Resource Management 4 6 8 6 1 25

ERM 1 1
Finance Modelling for
Telecommunications Business 1 1

Good Governance 3 2 5

Innovation Mgmt 1 1

Managerial Decision Science 5 5 6 1 17

OB&HR 3 3

Operation Management 2 2
Organization Behavior and Human
Resource Management 8 11 8 10 7 44

Princ. Of E-Com. 2 2

Principles of Electronic Commerce 7 6 8 5 3 29

Strate. Mgmt. 4 4

Strategic Management 10 6 7 7 5 35

Struc. Found of N.V. 2 2

Foundation Total 52 42 47 43 45 229

Foundation &
Specializatio
n Product Development 1 1

Project Management 13 13 13 7 8 54

Foundation & Specialization Total 13 13 13 7 9 55

Research Independent Study 18 1 2 2 2 25

Master Thesis (A) 2 2

Research Total 18 3 2 2 2 27
Specializatio
n Applied Electronic Commerce 4 1 1 1 7
Business Communications 4 1 1 6

Corp Strategy 2 2
Corporate Strategy and
Performance Measurement 7 4 6 5 2 24
Customer Relationship
Management 3 1 4 1 1 10

Dispute Solution 1 1

Electronic Business Management 3 3

Ent. Finance 1 1
Entrepreneurial Finance
Management 2 3 2 2 2 11

Franchise Management 2 1 3 2 2 10
Fundamentals of Management of
Technology 2 2

Human Resour. 1 1
Human Resources Planning &
Development 1 1 1 1 4

Information Exploitation 4 4 2 2 12

Inno.and Ind. Mgmt. 1 1

Innovation and Industrial Venturing
Management 1 3 2 2 1 9
Innovation and Strategies for
Electronic Commerce 1 1 1 3
International Business
Management 4 5 5 5 1 20
International Financial Planning
and Control 2 1 3 3 1 10

Internet and the World Wide Web 2 2 1 5

Internet Marketing 1 2 2 5

Internet Security 3 3
Introduction to Business and
Management Research 3 2 5

Introduction to Business Plan 2 3 5

Knowledge Management 1 1 1 3

Knowledge Mgmt 1 1

Leadership & 1 1

Leadership and Team Management 5 3 6 2 1 17

Management in Research &
Development in Science &
Technology 1 1
Management of Innovation of
Science & Technology 2 2 1 5

Managerial Negotiation Strategy 3 2 2 1 2 10

Managing Enterprises in a Digital
Economy 6 1 7

OD&Mgmt for Changes 1 1

Organization Development and
Management for Changes 2 1 3 3 2 11

Organizational Structure & Design 1 1 1 3

 Policy Analysis 4 4

Process Eng. 1 1

Process Engineering 4 1 2 1 1 9

Product Design and Engineering 1 1

Product Development 4 2 3 2 2 13

Public Participation Management 1 1

Quality Management 2 2 4 8
Reward & Performance
Management 2 1 1 4

Sales Logistics 2 1 1 4
Selected Topic in Electronic
Commerce Management 3 2 5

Seminar in Management 3 9 10 8 30

Seminar in Mgmt 1 1

Seminar in Mgmt 2 2

Small Business Management 6 2 2 3 1 14

Small Business Mgmt. 1 1

Supply Chain Management 5 3 3 2 1 14

Technology Transfer Management 1 1

Telecommunications Regulation
Telecommunications Service
Costing
Value Chain and Process
Reengineering Management
1 1
1 1
1 1 1 3

Specialization Total 96 51 78 61 52 338

22 28 24 22 1
Grand Total 311 3 3 3 8 288