Professional Documents
Culture Documents
net/publication/12136068
CITATIONS READS
80 6,403
4 authors, including:
Some of the authors of this publication are also working on these related projects:
Advanced Cognitive Training for Independent and Vital Elderly (ACTIVE) View project
All content following this page was uploaded by Guohua Li on 03 September 2014.
LI G, BAKERSP, GRABOWSKIJG, REBOKGW. Factors associated has made it difficult, if not impossible, to develop ef-
w i t h p i l o t error in aviation crashes. Aviat Space Environ Med 2001; fective interventions.
72:52-8.
Background: The importance of pilot error in aviation crashes has In this study, we examined the prevalence and cor-
long been recognized. However, understanding and preventing pilot relates of pilot error in a large sample of aviation
error remains the foremost challenge in aviation safety. Objective: This crashes, using multiple data files compiled by the Na-
study aims to identify pilot characteristics and crash circumstances that tional Transportation Safety Board (NTSB) over an ex-
are associated with the presence of pilot error in a large sample of tended period. The results indicate that the likelihood
aviation crashes. Methods: Different data files compiled by the National
Transportation Safety Board for 329 major airline crashes, 1,627 com-
of pilot error in a given crash is a function of both
muter/air taxi crashes, and 27,935 general aviation crashes for the years endogenous and exogenous factors. In contrast to the
1983-96 were merged; and the presence of pilot error was analyzed in widely accepted notion that pilot error is entirely an
relation to variables indicating the characteristics of the pilot-in-com- intrinsic phenomenon of human behavior, this study
mand, crash circumstance, and aircraft. Multivariate logistic regression reveals that extrinsic attributes, such as weather condi-
modeling was performed to assess the associations of individual vari-
ables with the likelihood of pilot error given a crash. Results: Pilot error
tion, are important determinants of pilot error as well.
was a probable cause in 38% of the major airline crashes, 74% of the
commuter/air taxi crashes, and 85% of the general aviation crashes. METHODS
Among the factors examined, instrument meteorological condition and
on-airport location were each associated with a significantly increased The NTSB reports all civilian aviation crashes using a
odds of pilot error. The likelihood of pilot error decreased as pilot
certificate rating increased in commuter/air taxi and general aviation set of standard forms. A crash ("accident" in NTSB
crashes. Neither pilot age nor gender was independently associated with terminology) is defined as an event associated with
the odds of pilot error. With adjustment for pilot characteristics and operation of an aircraft that results in personal death or
crash circumstances, flight experience as measured in total flight time serious injury, or substantial aircraft damage. The Fac-
showed a significant protective effect on pilot error in general aviation tual Report (NTSB Form 6120.4) is the main data form
crashes. Conclusions: The prevalence and correlates of pilot error in
aviation crashes vary with the type of flight operations. Adverse weather for recording information collected from field investi-
is consistently associated with a significantly elevated likelihood of pilot gations. There are over 200 data items in the Factual
error, possibly due to increased performance demand. Report, providing detailed information about the crash
Keywords: aviation safety, human factors, pilot error. circumstances, aircraft, and pilot-in-command. Also in-
cluded in the Factual Report is a narrative statement of
the facts, conditions and other findings pertinent to the
HE IMPORTANCE OF H U M A N factors, particu- crash.
T larly pilot error, in aviation crashes has long been
recognized (9). Overall, about 80% of aviation crashes
Based on information in the Factual Report, the se-
quence-of-events of each crash is delineated by NTSB
and 50% of aviation incidents are attributed to pilot investigators according to established protocols. For
error (5,11). As aviation hardware becomes more reli-
able due to advanced technology, the relative impor-
From the Department of Emergency Medicine (S. P. Baker, J. G.
tance of human factors in aviation safety is likely to Grabowski, G. Li), Johns Hopkins University School of Medicine,
further increase (15). Baltimore, M.D.; and Departments of Health Policy and Management
Empirical research on pilot error has been limited (S.P. Baker, G. Li), and Mental Hygiene (G.W. Rebok), Johns Hopkins
primarily to describing the detailed operational and University School of Hygiene and Public Health, Baltimore, M.D.
This manuscript was received for review in November 1999. It was
behavioral acts that contribute to aviation mishaps and revised in September 2000. It was accepted for publication in Septem-
to classifying those deviant acts according to various ber 2000.
taxonomies (15). Although these studies have helped to Address reprint requests to: Guohua Li, M.D., Dr.P.H., who is an
delineate the profiles and patterns of pilot error, they associate professor, Department of Emergency Medicine, Johns Hop-
kins University School of Medicine, 1830 East Monument Street, Suite
are descriptive in essence and provide little information 6-100, Baltimore, M.D. 21205; ghli@jhmi.edu.
about the etiology of pilot error. The lack of epidemio- Reprint & Copyright 9 by Aerospace Medical Association, Alexan-
logic data on etiological factors underlying pilot error dria, VA.
52 Aviation, Space, and Environmental Medicine ~ Vol. 72, No. 1 ~ January 2001
CORRELATES OF PILOT ERROR--LI ET AL.
Aviation, Space, and Environmental Medicine ~ Vol. 72, No. 1 ~ January 2001 53
CORRELATES OF PILOT ERROR--LI ET AL.
TABLE I. PROPORTIONS OF AVIATION CRASHES WITH PILOT ERROR BEING A PROBABLE CAUSE BY PILOT CHARACTERISTIC,
CRASH CIRCUMSTANCE AND AVIATION CATEGORY, U.S., 1983-96.
aviation crashes and commuter/air taxi crashes (Table in the lowest quartile to 79% in the highest quartile
I). O f t h e g e n e r a l a v i a t i o n c r a s h e s i n v o l v i n g p i l o t s u n - ( p < 0.001) ( T a b l e I). A f u r t h e r e x a m i n a t i o n re-
d e r a g e 20, 9 4 % w e r e a t t r i b u t e d t o p i l o t e r r o r , c o m p a r e d vealed that the protective effect of total flight time
with about 85% of general aviation crashes involving against pilot error existed only in general aviation
o l d e r p i l o t s (p < 0.001) ( F i g . 2). A g e - r e l a t e d v a r i a t i o n i n crashes under visual meteorological conditions (VMC)
t h e p r e v a l e n c e r a t e s o f p i l o t e r r o r w a s s t a t i s t i c a l l y in- (Fig. 3).
significant for major airline crashes and commuter/air General aviation crashes involving student/private
taxi crashes. pilots were more likely to be attributed to pilot error
Total flight time showed an effect on pilot error than other g e n e r a l a v i a t i o n c r a s h e s ( T a b l e I). A l o w e r
only in general aviation crashes, with the prevalence prevalence of pilot error was also observed in commut-
rate decreasing progressively from 91% for pilots er/air taxi crashes involving pilots who held airline
54 Aviation, Space, and Environmental Medicine ~ Vol. 72, No. 1 ~ January 2001
CORRELATES OF PILOT ERROR--LI ET AL.
113o
level. Since the correlates of pilot error identified in the
90 bivariate analysis varied with the type of aviation, a
8o logistic regression model was fitted separately for major
airline crashes, commuter/air taxi crashes, and general
SO
aviation crashes (Table II). With adjustment for pilot
characteristics and other covariates, crashes under IMC
were significantly more likely to involve pilot error than
4o
crashes under VMC, with an estimated odds ratio of 3.9
3o for major airline crashes, 2.9 for commuter/air taxi
20 crashes, and 3.8 for general aviation crashes. Other risk
-o- General Aviation
10
Co~/AJr Taxi factors of pilot error identified from the multivariate
-o- Major Aidines logistic models included on-airport location for major
o
<20 20-29 30~3e 4O-49 5O-59 >6O airline crashes and general aviation crashes, and being
Pilot Age (years) fatal for commuter/air taxi crashes and general aviation
Fig. 2. Prevalence rates of pilot error in aviation crashes by pilot age crashes (Table II).
and aviation category,UnitedStates, 1983-1996. The effects of pilot characteristics on the likelihood of
pilot error was primarily limited to general aviation
transport certificates, as compared with commuter/air crashes (Table II). The odds of pilot error in general
taxi crashes involving commercial pilots. aviation crashes decreased as pilots' total flight time
Female pilots accounted for 0.3% of major airline and certificate rating increased. The interaction effect of
crashes, 3% of commuter/air taxi crashes, and 4% of total flight time and basic weather condition on pilot
general aviation crashes. Partly reflecting the effect of error was assessed during the modeling and was not
lesser flight experience, a higher proportion of general included in the final model because of statistical insig-
aviation crashes and commuter/air taxi crashes involv- nificance. With regard to pilot age, a significantly ele-
ing female pilots were caused by pilot error than those vated odds ratio existed only among pilots younger
involving rnale pilots (Table I). Female pilots who were than 20 yr in general aviation crashes. There was not an
involved in general aviation crashes recorded an aver- independent gender effect on pilot error. Among vari-
age 888 total flight hours (SD 2,845 h), compared with ables indicating pilot characteristics in commuter/air
2,411 h (SD 4,426 h) for their male counterparts (p < taxi crashes, certificate rating was the only one that
0.001). A striking gender discrepancy in total flight time showed a significant effect on pilot error, with an esti-
also existed among pilots who were involved in com- mated odds ratio of 0.7 for airline transport pilots rela-
muter/air taxi crashes [mean total flight time: 5,795 h tive to commercial pilots (Table II). In the multivariate
(SD 4,891 h) for males and 3,257 h (SD 2,269) for fe- logistic regression model for major airline crashes, there
males, p < 0.001]. were only two pilot characteristics (age and total flight
With regard to crash circumstances, instrument me- time) feasible for analysis. Whereas the odds of pilot
teorological conditions (IMC) were associated with a error in major airline crashes appeared to be greater for
significantly higher prevalence of pilot error, irrespec- pilots in the lowest total flight time quartile, there was
tive of the type of flight operations (Table I). An ele- not a significant age effect (Table II). Goodness-of-fit
vated prevalence of pilot error was found in major
tests based on the Hosmer-Lemshow statistic indicated
airline crashes and general aviation crashes occurring
on airports, as compared with crashes away from air- that the estimated logistic models presented in Table II
ports (Table I). Whereas the proportion (40%) of major fit the data well.
airline crashes that occurred at nighttime (6 p m to 5:59
a.m.) was considerably higher than that for c o m m u t e r /
air taxi crashes (33%) and for general aviation crashes
(22%), the prevalence of pilot error was similar between
daytime and nighttime crashes in each of the three
aviation categories (Table I).
Helicopters constituted 18% of commuter/air taxi
crashes and 6% of general aviation crashes; and pilot
error was less prevalent in helicopter crashes than in
airplane crashes. More than half (53%) of the fatal major
airline crashes were attributed to pilot error, compared
with 36% of the nonfatal major airline crashes (p =
0.03). The prevalence of pilot error was also signifi- --o- IMC
VMC
cantly higher in fatal commuter/air taxi crashes and
fatal general aviation crashes (Table I).
1 2 3 4
* Reference group.
+Significant at p < 0.01 level.
Significant at p < 0.05 level.
56 Aviation, Space, and Environmental Medicine ~ Vol. 72, No. 1 ~ January 2001
CORRELATES OF PILOT ERROR--LI ET AL.
conditions aimed at localizing cognitive performance in crashes is, in fact, plausible and supported by several
information processing resources, such as memory ca- other studies (3,12,20). Characterizing the relation be-
pacity, and attentional and reasoning abilities (18). tween flight experience and safety performance is a
Studies from this approach are imperative for under- nonlinear function: the safety benefit of flight experi-
standing the mechanisms of pilot error and for assess- ence is greater in the early, experience-building stage,
ing the effects of physiological and behavioral factors and diminishes as total flight time increases (12). Over-
(e.g., aging and alcohol use) on pilot performance all, general aviation pilots are far less experienced than
(13,14). Limitations of this approach are that it over- those flying commercial operations. The finding that the
emphasizes the importance of intrinsic factors in pilot beneficial effect of total flight time on pilot error is
error and that its findings are not necessarily valid limited only to general aviation can thus be explained
when extrapolated to the real-world flight environment b y the relative inadequacy of experience in general
(4). aviation pilots. It does not imply that flight experience
Results of this study indicate that among factors re- is unimportant to commercial pilots. Rather, it reflects
lated to the pilot, aircraft and crash circumstance, in- the nonlinear nature of the experience-performance re-
strument meteorological condition is most predictive of lation and the fact that all commercial pilots have al-
pilot error. This finding holds true for all three catego- ready accumulated a large number of flight hours. That
ries of aviation included in the study, and appears to be the protective effect of advanced certificate rating
consistent with previous reports (2,6,21). Based on an against pilot error remains significant in commuter/air
examination of 400 fatal crashes of "public transport taxi crashes illustrates the persistence, albeit diminish-
aircraft," Shuckburgh (21) found that 30% of human ing, of the benefit of flight experience. It is worth noting
errors identified are incorrect operations in instrument that neither pilot age nor gender is independently as-
meteorological conditions. In a survey of German Air sociated with pilot error in major airline crashes or
Force pilots, Gerbert and Kemmler (6) found that the commuter/air taxi crashes. The only significant age
most frequently reported extrinsic factors associated effect found in this study is a higher risk of pilot error
with pilot error is restricted visibility due to poor among pilots under age 20 who were involved in gen-
weather conditions. Baker and colleagues (2) compared eral aviation crashes.
a group of pilots who had multiple crash records with While the findings of this study are strengthened by
a group of pilots who each had only one crash record the large sample size, the inclusion of three major cat-
during the same period, and concluded that exposure to egories of aviation, and the multivariate statistical tech-
hazardous environmental conditions, such as adverse nique, there is a limitation with the research design that
weather and unpaved runways, is a major determinant warrants special attention. The analysis of pilot error
of crash frequency. was conditional to the occurrence of a crash. The factors
In addition to basic weather condition, crash location associated with pilot error identified in this study are
also is associated with the likelihood of pilot error. correlates in essence, and thus do not necessarily rep-
Crashes occurring at an airport are significantly more resent risk factors. Aviation crashes are rare events.
likely than crashes away from an airport to involve Presumably, the overwhelming majority of pilot errors
pilot error. The findings with weather and crash loca- and encounters with adverse weather and other haz-
tion can easily be explained by the stress model, pro- ardous conditions do not result in an incident or a crash
posed by Selye (19) and refined by Hannkonson (8), and thus are unreported. Unless surveillance data on
Green (7), and Alkov et al. (1). According to the stress pilot error and exposures to hazardous conditions, re-
model, reaction to stressors is a process of adaptation, gardless of the flight outcome, become available, risk
which occurs in three stages: the alarm reaction, the factors of pilot error cannot be adequately assessed.
resistance, and the exhaustion. Flight safety is the bal- Nevertheless, this study provides valuable data for
ance between performance ability and performance de- understanding the etiology of pilot error and for for-
mand. Green (7) outlined three types of stressors that mulating prevention strategies. It provides evidence
that pilot error is not merely a function of human na-
pilots confront, environmental, acute reactive, and life
ture. Rather, it is determined by both endogenous and
events. These stressors affect flight safety b y either in-
exogenous variables in ways that are understandable
creasing performance demand or reducing pilot perfor-
and predictable. Environmental stressors that increase
mance ability. A crash occurs at the exhaustion stage of
performance demand often play an important role in
adaptation when performance demand exceeds perfor-
the causation of pilot error and aviation mishaps (2,6).
mance ability. Increased pilot error in instrument
To minimize pilot error, enhancing performance ability
weather conditions and during takeoff and landing is
through safety training may be beneficial but has its
likely due, to a large extent, to increased performance limits. Developing and applying technologies that re-
demand. duce pilot performance demand in dangerous situa-
The results of this study suggest that certain pilot tions appear to be more effective, and may have con-
characteristics, particularly variables concerning flight tributed to the significant decline in the prevalence of
experience, may play a significant role in pilot error, but pilot error in major airline crashes over the past four
in general, intrinsic factors appear to be less important decades.
than environmental factors. The seemingly perplexing
finding that the protective effect of total flight time ACKNOWLEDGMENTS
against pilot error exists in general aviation crashes but Funding for this research was provided primarily by Grants
not in commuter/air taxi crashes and major airline R01AG13642and R01AA09963from the National Institutes of Health
Aviation, Space, and Environmental Medicine ~ Vol. 72, No. 1 ~ January 2001 57
CORRELATES OF PILOT ERROR--LI ET AL.
and in part by Grant R49CCR302484 from the Centers for Disease 9. Herbolsheimer AJ. A study of three hundred non-selected avia-
Control and Prevention. The authors thank Stanley Smith, Chief of the tion accidents. J Aviat Med 1942; 13:256-66.
Analysis and Data Division, National Transportation Safety Board, 10. Hosmer DW, Lemeshow S. Applied logistic regression. New
for data assistance and helpful comments; and Ruth Nelson for sec- York, NY: Wiley & Sons, 1989.
retarial support. 11. Li G. Pilot-related factors in aircraft crashes: a review of epide-
miologic studies. Aviat Space Environ Med 1994; 65:944-52.
12. Li G, Baker SP. Prior crash and violation records of pilots in
REFERENCES commuter and air taxi crashes: a case-control study. Aviat
1. Alkov RA, Gaynor JA, Borowsky MS. Pilot error as a symptom of Space Environ Med 1994; 65:979-85.
inadequate stress coping. Aviat Space Environ Med 1985; 56: 13. Morrow D, Leirer V, Yesavage J. The influence of alcohol and
244 -7. aging on radio communication during flight. Aviat Space En-
2. Baker SP, Li G, Lamb MW, Warner M. Pilots involved in multiple vrion Med 1990; 61:12-20.
crashes: "accident proneness" revisited. Aviat Space Environ 14. Morrow D, Yesavage J, Leirer V, Tinklenberg J. Influence of aging
Med 1995; 66:6-10.
and practice on piloting tasks. Exp Aging Res 1993; 19:53-70.
3. Bennett CT, Schwirzke M. Analysis of accidents during instru-
15. Nagel DC. Human error in aviation operations. In: Wiener EL,
ment approaches. Aviat Space Environ Med 1992; 63:253-61.
4. Billings CE, Gerke RJ, Wick RL, Jr. Comparisons of pilot perfor- Nagel DC, eds. Human factors in aviation. San Diego, CA:
mance in simulated and actual flight. Aviat Space Environ Med Academic Press, 1988:263-303.
1975; 46:304-8. 16. National Safety Council. Accident facts, 1998 edition. Itasca, IL:
5. Billings CE, Reynard WD. Human factors in aircraft incidents: Author, 1998. p. 124.
results of a 7-year study. Aviat Space Environ Med 1984; 17. National Transportation Safety Board. NTSB aviation coding
55:960-5. manual, http://www.ntsb.gov/aviation/codman_intro.htm.
6. Gerbert K, Kemmler R. The causes of causes: determinants and 18. Salthouse TA. Theoretical perspectives on cognitive aging. Hills-
background variables of human factor incidents and accidents, dale, NJ: Erlbaum, 1991: 301-49.
Ergonomics 1986; 29:1439-53. 19. Selye H. Stress without distress. Philadelphia, PA: Lippincott,
7. Green RG. Stress and accidents. Aviat Space Environ Med 1985; 1974: 33-44.
56:638-41. 20. Shuch HP. The influence of flight experience on midair collision
8. Haakonson NH. Investigation of life change as a contributing risk perception. Accid Anal Prev 1992; 24:655-60.
factor in aircraft accidents: a prospectus. Aviat Space Environ 21. Shuckburgh JS. Accident statistics and the human-factor element.
Med 1980; 51:981-8. Aviat Space Environ Med 1975; 46:76-9.
58 Aviation, Space, and Environmental Medicine ~ Vol. 72, No. 1 9 January 2001