Professional Documents
Culture Documents
ination scores did not differ significantly. National standardized examination grades significantly decreased
pre-Katrina to post-Katrina in Biochemistry, Pharmacology, Pathology, Medicine, Pediatrics and Psychiatry
(P 0.05). There was no statistical change in USMLE
scores. Conclusions: Tulane students had a statistically
significant decline in performance on many course and
clerkship examinations, though overall performance on
licensing examinations was unchanged. Many stresses
may have affected students ability to perform. KEY
INDEXING TERMS: Disaster; Learning; Medical Students; Assessment. [Am J Med Sci 2008;336(2):142
146.]
administration. Though the ability to resume medical education so quickly was remarkable, this was
an especially challenging period for students, faculty, and their families as reflected in Table 1.3,4 The
faculty were very concerned about the effect of additional stresses on student performance and implemented new programs and policies to minimize student stress as outlined in Table 2.3,4
There are very few studies on the effects of disastrous events on learning, and little is known about
the specific effects on medical students.57 We therefore studied the effect of abruptly moving the educational programs to Houston, after Hurricane Katrina, on the academic performance of the first,
second, and third-year Tulane students.
142
Methods
Participants
This study met Internal Review Board (IRB) exemption criteria. The population consisted of first, second, third, and fourthyear students enrolled at Tulane School of Medicine during the
2004 2005 (pre-Katrina), 20052006, (Katrina), and 2006 2007
(post-Katrina) academic years. Each class was compared with the
previous class, and the fourth year class was used as a control
group for previous clerkship exams and United States Medical
Licensing Examination (USMLE), Step 2Clinical Knowledge
(CK) scores. Class profiles of all years were similar, with equivalent Medical College Admission Test (MCAT) class means, average student age of 28 and similar demographics.
August 2008 Volume 336 Number 2
Crawford et al
Materials
The National Board of Medical Examiners (NBME) produces
standardized, objective discipline-based exams that can be
used to assess knowledge in the basic and clinical sciences
throughout the medical school curriculum known as shelf
exams.
USMLE is a 3-step standardized examination that must be
passed to practice medicine in the United States. Step 1 assesses
the ability to understand and apply concepts of the sciences to the
practice of medicine and is usually taken at the end of their
second year. Step 2CK, measures application of medical knowledge, skills, and understanding of clinical sciences and is usually
taken during their fourth year.
Pre-Katrina and post-Katrina students took the NBME basic
and clinical sciences shelf exams at Tulane School of Medicine
during their regularly scheduled examination time. Results on
the basic sciences exams were available in the content areas of
Biochemistry, Pathology, and Pharmacology. Internal examination grades were used in basic science courses that did not
utilize NBME standardized exams including Anatomy, Histology, and Physiology. For the clinical science exams, results
were available in the following subject areas: Medicine, Pediatrics, Psychiatry, Surgery, and Obstetrics/Gynecology. Results were also available for the USMLE Step 1 and Step
2CK exams. NBME and USMLE test results were available
to senior administrators.
Design and Data Analysis
For NBME and internal exams in the basic sciences, a one-way
analysis of variance (ANOVA) was used to determine if mean
examination scores differed from pre-Katrina to post-Katrina.
For NBME clinical science shelf exams, 2-tailed unpaired Students t tests were used for the same purpose. For USMLE
Results
In the basic science comparison, post-Katrina students (first- and second-year students) who took
these examinations (basic science NBME Shelf Exams and USMLE, Step 1) on a post-Katrina date
were compared with students who took these exams
pre-Katrina. In the clinical rotations, third- and
fourth-year students who took the exams (clinical
clerkship shelf and USMLE, Step 2CK) post-Katrina were compared with students who took these
examinations pre-Katrina.
Basic Sciences (NBME)
A one-way analysis of variance (ANOVA) was
calculated on student NBME shelf examination
scores in the basic science content areas of Pathology, Biochemistry, and Pharmacology. For the
NBME Pathology examination, the main effect
was significant, F(2,455) 3.12, P 0.04. Planned
comparisons revealed that Pathology grades declined from pre-Katrina to post-Katrina, t(455)
2.44, P 0.02. For Pharmacology, the main effect of
year was again significant, F(2,444) 5.50, P
0.05. Specifically, when compared with pre-Katrina
scores, student performance was significantly lower
in the Katrina academic year, t(444) 3.21, P
0.004. In Biochemistry, the main effect yielded significant results, F(2,467) 7.88, P 0.001. Planned
comparisons revealed that when compared with preKatrina scores, student performance significantly
declined during the post-Katrina academic year,
t(467) 3.47, P 0.001. These findings are summarized in Figure 1.
Basic Sciences (Internal Exams)
Mean examination scores in Histology, Anatomy,
and Physiology did not differ from pre-Katrina to
post-Katrina time periods (P 0.05).
Clinical Science Exams (NBME)
Two-tailed unpaired Students t tests were performed on the NBME clinical sciences shelf examination scores. In the subject area of Medicine, the
comparison revealed that student grades declined
significantly from pre-Katrina to post-Katrina,
t(317) 2.42, P 0.02. For Pediatrics and Psychiatry, the same held true; there were significant
declines in mean scores from pre-Katrina to postKatrina, t(301) 2.06, P 0.04 and t(290) 2.99,
143
144
Crawford et al
also considered new learning. Problems with explicit memory have been associated with traumatic/
stressful events along with dissociative amnesia
that involves breaks of memory that occur for limited time because of hippocampus damage.8 Studies
have not shown that implicit memory is affected by
stress or trauma. This study did not measure hippocampal damage.
Comparative Analysis
The comparative analysis revealed a significant
decline in the clinical subject exams (Pediatrics,
Psychiatry, and Medicine). In the clinical years, students are applying knowledge learned in the preclinical years. Although students are still developing
explicit memory, they apply previous knowledge reflexively. It is proposed that previously learned
knowledge might be affected by stress and traumatic events explaining the decline in grades.
Grades in Obstetrics/Gynecology (Ob-Gyn) significantly increased, possibly secondary to other unmeasurable factors.
Results of the analysis from the basic science
courses are similar to the clinical clerkship exams.
Standardized examination grades significantly declined in Biochemistry post-Katrina. Even though
postdisaster class means significantly dropped in
Pharmacology and Pathology, when compared with
predisaster class means, they remained above the
national means in both topics. Learning content in
these 2 courses requires extensive explicit memory.
In addition, it requires recall of recently learned
material or new learning. It has been estimated
that approximately one-third of the students exhibited some degree of post-traumatic stress syndrome
or depression post-Katrina.4 One might hypothesize
that the reduction in the class means in these exams
result from hippocampus/medial prefrontal cortex injury and/or dysfunction of explicit type memory. Further research is needed to determine if the reduction in
class means is due to memory dysfunction.
Review of the comparison analysis of the USMLE,
Step 1 scores reveals no significant difference in the
Tulane pass rate and the national average for the
Katrina year or in the after post-Katrina year. Comparison of USMLE Step 2CK also reveals no difference in the pass rate. Step 2 pass rates exceeded
or were equal to national pass rates.
Study Limitations and Strengths
Determining the etiology of the changes in students
grades is multifactorial. Additional stress plays a role,
but there are many other variables that were not
measured including qualitative and quantitative postdisaster faculty variability, disaster timing in particular students curriculum (first year versus second year
versus third year), and the move back to New Orleans
with the repetitive process of reorganizing personal
lives, the curriculum and clinical rotations.
145
Because this study only compared 1 class to another class, it did not evaluate individual students
that may have revealed additional variables affecting student learning. However, this study did involve 3 separate classes and compared them to standardized exams with national data instead of only
limited internal data.
In conclusion, the effects of Hurricane Katrina
resulted in additional student stress that did not
alter internal examination scores. This study evaluated and compared national standardized exams to
determine if there was significant reduction in academic achievement of these students. The results
support that there were significant class differences
in learning/test performance in multiple areas including Biochemistry, Pharmacology, Pathology,
Medicine, Pediatrics, and Psychiatry. The results
support the hypothesis that some students may
have experienced stress-related events that affected
their ability to perform utilizing explicit memory or
declarative memory resulting in lower basic science
scores. Despite the changes in individual course
scores, overall performance was not significantly
altered for the students in the Katrina year in the
basic sciences or during the clinical clerkships based
on these NBME shelf exams, USMLE Step exams,
and internal examinations.
References
1. Krane NK, DiCarlo RP, Kahn MJ. Medical education in
post-Katrina New Orleans JAMA 2007;298:10521055.
146