You are on page 1of 5

Pediatr Surg Int (2014) 30:317–321

DOI 10.1007/s00383-014-3467-0

ORIGINAL ARTICLE

The evaluation of the validity of Alvarado, Eskelinen, Lintula


and Ohmann scoring systems in diagnosing acute appendicitis
in children
Arzu Sencan • Nail Aksoy • Melih Yıldız •
Özkan Okur • Yusuf Demircan • İrfan Karaca

Published online: 22 January 2014


Ó Springer-Verlag Berlin Heidelberg 2014

Abstract Introduction
Purpose To show whether Alvarado, Eskelinen, Lintula
and Ohmann scoring systems have predictive values in Appendicitis is the most common surgical emergency in
diagnosing acute appendicitis in children. childhood [1]. Despite advances in the diagnosis and sur-
Methods Sixty patients with suspected acute appendicitis gical treatment, diagnosing appendicitis still remains diffi-
were prospectively evaluated. Alvarado, Eskelinen, Lintula cult. Acute appendicitis is one of the few surgical diagnosis
and Ohmann scores were calculated separately for each that is made clinically and decision to undergo surgery is
patient at the time of admission. The specificity, sensitivity, often given without certainty of the definitive diagnosis.
positive and negative predictive values of the scores were The delay in the diagnosis increases morbidity and mor-
calculated. The predictive value of the scores was evalu- tality, whereas false positive diagnosis of appendicitis leads
ated with the receiver operating characteristic (ROC) curve to unnecessary surgery. Due to diagnostic delays, perfora-
and the consistency among the scores by Kappa test. tion rates are reported as 17–33 % and negative laparotomy
Results Twenty of the patients were female (33.3 %). The rates between 3 and 54 % [2, 3]. Although radiological
mean age of the patients was 9.9 years (3–16 years). Forty imaging techniques and laboratory tests are helpful in the
two patients were operated and appendectomies were per- diagnosis of appendicitis, several clinical diagnostic scores
formed with the diagnosis of acute appendicitis. The area have been developed to aid in the diagnosis of suspected
under the ROC curve showed that the scores had no pre- cases. Different results of these scoring systems have been
dictive value in diagnosing acute appendicitis. Kappa test reported in the literature. Some studies showed that the
showed that agreement between the scores was not good. scoring systems reduced the negative appendectomy rate by
Conclusion The sensitivity and specificity of the four 50 % [4, 5], while some others reported that the diagnostic
scoring systems were not sufficient enough in diagnosing accuracy of the scores was low [6, 7].
acute appendicitis in our patient group. We concluded that To our knowledge, four different scoring systems have
the most important factor affecting the decision for surgery not been compared all together in one study, so far.
in suspected acute appendicitis is the surgeon’s experience Therefore, we designed this study to show whether Alva-
combined with physical findings of repeated clinical rado, Eskelinen, Lintula and Ohmann scoring systems are
examinations. useful or not in the diagnosis of acute appendicitis in
children with abdominal pain and also to evaluate the
Keywords Acute appendicitis  Alvarado score  consistency of these four scores among each other.
Eskelinen score  Lintula score  Ohmann score  Children

Materials and methods


A. Sencan (&)  N. Aksoy  M. Yıldız  Ö. Okur 
Y. Demircan  İ. Karaca
Sixty patients who admitted to the pediatric surgery
Department of Pediatric Surgery, Dr. Behçet Uz Children’s
Trianing Hospital, Izmir, Turkey emergency department of our hospital with complaint of
e-mail: arzusencan71@yahoo.com.tr abdominal pain between February 2011 and August 2011,

123
318 Pediatr Surg Int (2014) 30:317–321

and who were hospitalized with suspected acute appendi- Table 1 Diagnostic performance parameters
citis were prospectively evaluated. Patients with a history Sensitivity (%) Specificity (%) PPV (%) NPV (%)
of previous surgery and those with acute abdominal trauma
were excluded. The study was approved by the Ethics Alvarado 76.19 38.89 74.42 41.18
Committee of our institution. The parents of the patients Eskelinen 73.81 50 77.5 45
were informed about the study and their approval was Lintula 16.67 66.67 53.85 25.53
obtained at the time of hospitalization. The history, clinical Ohmann 21.43 88.89 81.82 32.65
examination results, basic laboratory data (white blood PPV positive predictive value, NPV negative predictive value
cell; WBC) and routine radiologic imaging results
(abdominal ultrasonography; USG, plain abdominal gra-
Table 2 The Kappa statistics comparing the agreements between the
phy) were recorded on the previously prepared data sheets scores
at the time of admission. Alvarado, Eskelinen, Lintula and
Ohmann scores, described previously in the literature, were Kappa Eskelinen Lintula Ohmann
calculated separately for each patient. Physical examina- Alvarado 0.416* 0.144*** 0.111***
tions and the operations were performed by three experi- Eskelinen 0.131*** 0.202**
enced pediatric surgeons. An Alvarado score of 7 or greater Lintula 0.064***
[8], an Eskelinen score of 57 or greater [9], a Lintula score
* \0.6 moderate, ** \0.4 fair, *** \0.2 poor
of 21 or greater [10] and an Ohmann score of 12 or greater
[11] are indicative of appendicitis. The decision for surgery
was based on overall clinical judgement, together with the abdominal pain. No preoperative or postoperative compli-
laboratory findings and radiologic imaging results. Physical cations occured in neither of the patients. They were dis-
examination was repeated every 2 h for suspected cases. charged from the hospital on an average of 2 days
The scoring systems played no role on the decision to postoperatively.
operate in neither of the patients. Operations were per- For 60 patients, the sensitivity of Alvarado score was
formed by open surgical technique in all patients. Ampi- 76.19 %, the specificity was 38.89 %, the PPV was
cillin-Sulbactam was prescribed postoperatively. The 74.42 % and the NPV was 41.18 %. The sensitivity of
diagnosis of acute appendicitis was made by the intraop- Eskelinen score was 73.81 %, the specificity was 50 %, the
erative macroscopic appearance of the appendix; edema- PPV was 77.5 % and the NPV was 45 %. The sensitivity of
tous and hyperemic appendix was diagnosed as acute Lintula score was 16.67 %, the specificity was 66.7 %, the
appendicitis; and additional fibrinous appearance was PPV was 53.85 % and the NPV was 25.53 %. The sensi-
diagnosed as phlegmonous appendicitis. Intraoperative tivity of Ohmann score was 21.43 %, the specificity was
diagnosis was confirmed by histopathological examination. 88.89 %, the PPV was 81.82 % and the NPV was 32.65 %
Statistical analyses were performed with SPSS 13 for (Table 1). Kappa test showed that agreement between the
Windows Package Programme. The sensitivity, specificity, scores was not good (Table 2).
positive and negative predictive values (PPV, NPV) of The area under the ROC curve was 0.576 (95 % CI
each of the four scores were calculated separately. The 0.40–0.74) for Alvarado score (Fig. 1), 0.565 (95 % CI
receiver operating characteristic (ROC) curve was used to 0.39–0.73) for Eskelinen score (Fig. 2), 0.553 (95 %
evaluate the predictive value of the scores. The consistency CI 0.37–0.73) for Lintula score (Fig. 3) and 0.590 (95 %
among the scores was evaluated by Kappa test. CI 0.42–0.75) for Ohmann score (Fig. 4). As a result, these
findings showed that the scores had no predictive value in
diagnosing acute appendicitis.
Results

Twenty of the patients were female (33.3 %) and 40 were Discussion


male (66.7 %). The mean age of the patients was 9.9 years
(3–16 years). Forty two patients were operated and The average lifetime risk of appendicitis is 7 % [12].
appendectomies were performed with the diagnosis of Despite advances in the diagnosis and treatment tech-
acute appendicitis. The intraoperative diagnosis was cor- niques, appendicitis still remains a challenging surgical
related with histopathological examination. No negative emergency with significant morbidity and mortality. The
laparotomy was performed among the operated patients. delay in the diagnosis and the treatment of the condition
Eighteen patients were conservatively followed up and can lead to complications [13]. Radiologic imaging tech-
discharged from the hospital when their abdominal pain niques and various laboratory studies have diagnostic aid,
subsided. These patients were evaluated as nonspecific thus increasing the cost with additional radiation risk.

123
Pediatr Surg Int (2014) 30:317–321 319

Fig. 3 ROC curve for the Lintula scoring system: 0.553 (95 % CI
0.37–0.73)
Fig. 1 ROC curve for the Alvarado scoring system: 0.576 (95 % CI
0.40–0.74)

Fig. 4 ROC curve for the Ohmann scoring system: 0.590 (95 % CI
0.42–0.75)

Fig. 2 ROC curve for the Eskelinen scoring system: 0.565 (95 % CI
0.39–0.73) patients who presented with abdominal pain were exam-
ined by the pediatricians first and only the cases with
Therefore, searches for helpful diagnostic tools for acute suspected appendicitis were referred to pediatric surgery
appendicitis have been going on. For this purpose, a group department. In our study, Alvarado score had the highest
of authors have developed scoring systems based on clin- sensitivity (76.19 %). However, the specificity and the
ical findings and routine laboratory studies. In this study, NPV of the same score was low (specificity 38.89 %, NPV
we aimed to assess the validity of the four previously 41.18 %). In the original article by Alvarado [8], while the
defined scoring systems on our patient group who were sensitivity and the NPV of the score were similar to our
being evaluated for abdominal pain suggestive of acute results, the specificity (81 %) and the PPV (92 %) were
appendicitis, and to investigate the consistency of the four much higher. Different results about the performance of
scores among each other. this scoring system have been published in the literature.
Only a small number of patients who present with Some authors concluded that Alvarado score was helpful in
abdominal pain require surgical intervention. In this pres- the diagnosis of acute appendicitis [14, 15], while some
ent study, the number of patients who did not undergo others reported that the scoring system was not sufficient in
surgery is much less compared to the total number of the diagnosis of acute appendicitis [7, 16]. Limpawatt-
patients. This may be explained by the fact that all the anosiri et al. [14] in a prospective study assessing the

123
320 Pediatr Surg Int (2014) 30:317–321

accuracy of Alvarado score in predicting acute appendicitis 91 %, respectively. ROC analysis revealed an area index of
with 1,000 patients, reported the sensitivity of the score as 0.91. They concluded that the Eskelinen score might give
87.41 %, specificity as 74.39 %, PPV as 83.7 % and they acceptable clinical results only after calibration of the
concluded that Alvarado score is a helpful tool for the cutoff value [23]. Kiyak et al. [24] evaluated the Ohmann
admission criteria of acute appendicitis. Shera et al. [17] and Eskelinen scores for the diagnosis of appendicitis in
reported that Alvarado score was reliable in the early adult patients and they reported that there were significant
preoperative diagnosis of acute appendicitis. They reported differences in positive and negative appendectomies for
that PPV of the score was 93.1 % and it was helpful in women, but no difference for men. Another study showed
reducing the incidence of negative appendicectomy rate. that Ohmann scoring system was helpful in the diagnosis of
On contrary, subsequent prospective studies concluded that acute appendicitis [25].
this score alone was inadequate as a diagnostic test [18, As a result, this current study showed that the four
19]. Schneider et al. [16] evaluated appendicitis scoring scoring systems, used either alone or together, were not
systems using a prospective pediatric cohort and concluded predictive in diagnosing acute appendicitis. The area under
that Alvarado score did not provide sufficient PPV to be the ROC curve was 0.576 for Alvarado score, 0.565 for
used in clinical practice as the sole method for determi- Eskelinen score, 0.553 for Lintula score and 0.59 for Oh-
nation of the need for surgery. This is similar to the result mann score. These values showed that the scoring systems
of our current study. These disputes in the literature may be had no diagnostic value. Besides, the degree of agreement
due to the differences in the number of patients, patient between the scores was not good. The sensitivity of one
characteristics and the experience of the examining phy- score was high, while it was low in another score. Same
sicians. In our study, the Alvarado score had the highest results were also found for the specificity of the scores.
specificity and the sensitivity when compared with the Clinical scoring systems developed for the diagnosis of
other scores. However, the score alone was not useful acute appendicitis may have advantages because they are
enough to support the diagnosis of acute appendicitis. non-invasive and cost-effective. However, the results may
Lintula, the other scoring system that we tested in our differ depending on the patient population, age, time of
current study, did not have enough diagnostic value in admission to hospital, subjective evaluation of the symp-
acute appendicitis, either. There is no consensus about the toms and the experience of the physician. The course of
results of Lintula score in the literature. Lintula reported acute abdominal pain shows variations, especially in the
the sensitivity of the score as 87 % and specificity as 98 % pediatric age group. We think that the biggest confusion
on adult patients, emphasizing that it would be helpful for about the diagnostic scores in the literature arises from
general surgeons [20]. He stated that the score alone was these factors. Some variables of the scores such as location,
not helpful enough to diagnose acute appendicitis in duration and migration of pain, and right lower quadrant
pediatric age group [10]. In another randomized controlled tenderness may not be well described by young children or
trial where they evaluated whether diagnosis using Lintula their evaluation may be subjective. For example; the
score might improve clinical outcomes for children with parameter of ‘severe pain’ in Lintula score may differ
suspected appendicitis, Lintula concluded that the score depending on the patient and the examining physician.
reduced the unnecessary appendicectomy rate in children There are some limitations to our study. First, the total
[21]. Yoldas et al. [22] reported that Lintula score was a number of patients is small. Second, the parameter values
useful method to diagnose acute appendicitis with a sta- were calculated according to the findings at the time of
tistically significant predictive accuracy. In our study, admission. Repeated physical examinations in later hours
Lintula scoring system had the lowest sensitivity rate of might give different results. There were no negative
16 % and the minimum area under the ROC curve (0.553). appendectomies or perforations due to a delay in the
This result may be due to the fact that some variables in diagnosis in our current study. Repeated physical exami-
this score, such as intensity of pain and relocation of pain, nation of the patient who is being evaluated for suspected
may not be well described by the children. acute appendicitis, following the patient for at least 6–8 h
In this current study, Ohmann and Eskelinen scores were and the experience of the surgeon play an important role in
not found to be reliable enough for the diagnosis of acute giving decision for surgery. Ultrasonography and routine
appendicitis, either. Ohmann, in a multicentric prospective laboratory tests are also additional tools helping the sur-
study including 1,484 patients from eight departments, geon decide for surgery. We also took the ultrasonography
concluded that Ohmann score could not be recommended and laboratory findings into consideration when deciding
as a standard tool for diagnostic decision making in acute for surgery, but the exact decision was based on the find-
appendicitis [11]. In a study validating the diagnostic value ings of our repeated clinical examinations.
of Eskelinen scoring system, the sensitivity, specificity, In conclusion, the sensitivity and specificity of the four
PPV and NPV of the score were reported as 79, 85, 65 and scoring systems were not sufficient enough in diagnosing

123
Pediatr Surg Int (2014) 30:317–321 321

acute appendicitis in our patient group. Therefore, we think 12. Stevenson RJ (2003) Appendicitis. In: Ziegler MM, Azizkhan
that the most important factor affecting the decision for RG, Weber TR (eds) Operative pediatric surgery. McGrawHill,
New York, pp 671–689
surgery in suspected acute appendicitis is the surgeon’s 13. Neuspiel DR, Kuller LH (1987) Fatalities from undetected
experience combined with physical findings of repeated appendicitis in early childhood. Clin Pediatr 26:573–575
clinical examinations. 14. Limpawattanosiri C (2011) Alvarado score for the acute appen-
dicitis in a provincial hospital. J Med Assoc Thai 94:441–449
Conflict of interest The authors declare that they have no conflict 15. Escribe A, Gamell AM, Fernandes Y et al (2011) Prospective
of interest. validation of two systems of classification for the diagnosis of
acute appendicitis. Pediatr Emerg Care 27:165–169
16. Schneider C, Kharbanda A, Bachur R (2007) Evaluating appen-
dicitis scoring systems using a prospective pediatric cohort. Ann
References Emerg Med 49:778–784
17. Shera AH, Nizami FA, Malik AA et al (2011) Clinical scoring
1. Kosloske AM, Love CL, Rohrer JE et al (2004) The diagnosis of system for diagnosis of acute appendicitis in children. Indian J
appendicitis in children: outcomes of a strategy based on pedi- Pediatr 78:287–290
atric surgical evaluation. Pediatrics 113:29–34 18. Ohmann C, Yang Q, Franke C (1995) Diagnostic scores for acute
2. Paajonen H, Somppi E (1996) Early appendicitis is still a difficult appendicitis. Abdominal Pain Study Group. Eur J Surg
diagnosis. Acta Paediatr 85:459–462 161:273–281
3. Partrick DA, Janik JE, Janik JS et al (2003) Increased CT scan 19. Macklin CP, Radcliffe GS, Merei JM et al (1997) A prospective
utilization does not improve the diagnostic accuracy of appen- evaluation of the modified Alvarado score for acute appendicitis
dicitis in children. J Pediatr Surg 38:659–662 in children. Ann R Coll Surg Engl 79:203–205
4. Alvarado A (1986) A practical score for the early diagnosis of 20. Lintula H, Kokki H, Pulkkinen J et al (2010) Diagnostic score in
acute appendicitis. Ann Emerg Med 15:577–580 acute appendicitis. Validation of a diagnostic score (Lintula
5. Christian F, Christian GP (1992) A simple scoring system to score) for adults with suspected appendicitis. Langenbecks Arch
reduce the negative appendectomy rate. Ann R Coll Surg Engl Surg 395:495–500
74:281–284 21. Lintula H, Kokki H, Kettunen R et al (2009) Appendicitis score
6. Ohmann C, Yang Q, Franke K et al (1995) Diagnostic scores for for children with suspected appendicitis. A randomized clinical
acute appendicitis. Eur J Surg 161:273–276 trial. Langenbecks Arch Surg 394:999–1004
7. Mandeville K, Pottker T, Bulloch B et al (2011) Using appen- 22. Yoldaş O, Karaca T, Tez M (2012) External validation of Lintula
dicitis scores in the pediatric ED. Am J Emerg Med 29:972–977 score in Turkish acute appendicitis patients. Int J Surg 10:25–27
8. Alvarado A (1986) A practical score for the early diagnosis of 23. Sitter H, Hoffmann S, Hassan I et al (2004) Diagnostic score in
acute appendicitis. Ann Emerg Med 15:557–564 appendicitis. Validation of a diagnostic score (Eskelinen score) in
9. Eskelinen M, Ikonen J, Lipponen P (1992) A computer-based patients in whom acute appendicitis is suspected. Langenbecks
diagnostic score to aid in diagnosis of acute appendicitis. Theor Arch Surg 389:213–218
Surg 7:86–90 24. Kiyak G, Korukluoğlu B, Ozgün Y et al (2009) Evaluation of
10. Lintula H, Pesonen E, Kokki H et al (2005) A diagnostic score for Ohmann and Eskelinen scores, leukocyte count and ultrasonog-
children with suspected appendicitis. Langenbecks Arch Surg raphy findings for diagnosis of appendicitis. Ulus Travma Acil
390:164–170 Cerrahi Derg 15:77–81
11. Ohmann C, Franke C, Yang Q (1999) Clinical benefit of a 25. Zielke A, Sitter H, Rampp TA et al (1999) Validation of a
diagnostic score for appendicitis: results of a prospective inter- diagnostic scoring system (Ohmann score) in acute appendicitis.
ventional study. German Study Group of Acute Abdominal Pain. Chirurg 70:777–783
Arch Surg 134:993–996

123

You might also like