You are on page 1of 29

Update on the National Board Dental Examinations

American Dental Education Association San Diego, California March 2011

2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Research & Development/Psychometrics


Tsung-Hsun Tsai, Ph.D
tsait@ada.org

Updates
Research
the highest score reliability is found at the pass/fail point, high score reliability is found on the current content structure with 8-10 cases on Part II, and psychometrically defensible models and procedures are developed to detect aberrant responses for computer-based examinations.
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Updates
Planned 2011 Part II Practice Analysis
Domain of entry-level dentistry
65 revised, consolidated clinical competencies of the New General Dentistry criticality frequency

Survey ad hoc content review

Data analysis
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Updates
New Item Types Multiple correct answers, extended matching, and ordering are coming to National Board Examinations in 2012. These new item types will be scored objectively with a well defined scoring rubric. Responses on these new item types must match the scoring rubric exactly in order to get a score of "1" for the item. If there is no exact match, the score for the item will be "0". There is no partial credit.
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Updates For example, for an item with multiple correct answers and four options: A, B, C, and D, if the correct answers are B and D, both B and D and no other options must be selected to get a score of "1". Otherwise, the score for this item will be "0."

2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Updates
Multiple Correct Answers From the following list, select the three symptoms associated with candidosis. A. Small blisters B. Parasitic in nature C. Reduced prothrombin D. Fungal in nature E. Bruxism F. Maladsorption syndrome G. Bacterial in nature
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Updates Extended Matching


For each symptom listed below, select the correct disorder from the list provided.
Symptom ___ 1. White patches easily removed with light abrasion ___ 2. Buccal lesion with erythematosus surface ___ 3. Dorsal tongue carcinoma ___ 4. Paterson -Kelly Syndrome ___ 5. Abdominal pain, diarrhea, weight loss, fever ___ 6. Multiple bluish -purple macules or plaques on lower extremities ___ 7. Hairy tongue Disorder A. Squamous cell carcinoma B. Candidosis C. Syphilis D. Iron deficiency E. Crohns disease F. Sjgren syndrome G. Kaposi sarcoma H. Pagets disease I. Hypothyroidism J. Septicemia

2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Updates Ordering
Order the citric cycle as it occurs. Match each letter with its proper sequence number

2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Dont Forget The implementation of Pass/Fail reporting for candidate performance on National Boards will take effect on January 1, 2012. After that date, passing candidates will receive the status of Pass, P, while failing candidates will receive raw score information for each discipline with the status of Fail, F.
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Dont Forget The dental school profiles will be discontinued on January 1, 2012 when score reporting on the National Board examinations becomes Pass/Fail. The Joint Commission is developing a model for providing feedback to dental schools for evaluation purposes.
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Score Trends
Trends in candidate performance and failure rates on Part I and Part II based on reference groups are presented in Figures 1 to 4 below. A reference group is defined as candidates who took the examination for the first time and who enrolled in accredited dental schools in U.S and Canada.

2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Figure 1. Part I Average Scores


99 94 89 84 79 74 69 64 59 54 49 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

85.4

85.1 85.5 85.4

85.1 85.7

83.0 81.5

82.6 82.3

Figure 2. Part II Average Scores


99 94 89 84 79 74 69 64 59 54 49

81.9

82.0

81.7

81.5

82.7

81.2

81.1

81.6

79.2

79.8

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

Figure 3. Trend in the Failure Rates for Part I

80 70 60 50 40 30 20 10 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

8.2

10.5

9.7

10.0 13.4

7.8

3.5

7.4

5.3

5.3

Figure 4. Trend in the Failure Rates for Part II

80 70 60 50 40 30 20 10 0 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
2011 Joint Commission on National Dental Examinations, American Dental Association. All rights reserved.

7.0

7.2

8.0

7.3

4.7

6.0

6.4

13.7 5.3

10.6

Transition to a Single Exam Test Administration Updates

Laura M. Neumann, DDS, MPH Interim Secretary, JCNDE neumannl@ada.org

Transition to a Single Exam


Parts I & II will disappear; to be replaced by single, comprehensive exam JCNDE Committee for and Integrated Exam (CIE) leading process Information and progress
JCNDE Newsletters CIE website (pending) Questions and feedback to jcndecie@ada.org

Integrated Exam Current status


Model for domain of general dentistry defined

o 65 clinical competencies cross-link with 10 areas of scientific foundation knowledge o Validation in progress
Practice analysis planned for mid-2011 > establish test specifications Anticipated implementation at least 4 years

Policy Updates
Score reports effective 1/1/12: P or F no numerical score unless candidate tested prior to that date. Candidates who have passed may not retest unless required by state board DENTPIN required to apply/test.

DENTPIN
8-digit unique personal identifier Candidate/student must register him/herself Used by:
DAT, NBDE I & II, NBDHE ADEA AADSAS TMDSAS PASS CAAPID

35,221 DENTPINs assigned since 2009

Exam Administration Trends

2008 Part I Part II 8,044 6,232

2009 9,209 6,449

2010 7,696 7,185

NBDE Part I Volume by Month


2000 1800 1600 1400 1200 1000 800 600 400 200 0 2008 2009 2010

NBDE Part II Monthly Volume


2000 1800 1600 1400 1200 1000 800 600 400 200 0 2008 2009 2010

Testing Accommodations Volume


140 120 100 80 60 40 20 Jan Feb Mar Apr May June Jul Aug Sep Oct Nov Dec 2009 2010

Reschedule /No-Show Volume

NBDE I
Reschedule No-Show

NBDE II
Reschedule No-Show

5,483
71%

472

1,610
22%

180

Irregularities
NBDE I: 1,984 NBDE II: 2,551 Incidents resulting in action/penalty:

41 warning letters 31 notices of violation/penalty o30 appeals 4 granted 27 denied, including 8 wait time to retest reduced

See our video: Cheating Helps No One http://www.ada.org/2667.aspx

Questions
Joint Commission on National Dental Examinations 211 E. Chicago Ave., Suite 600 Chicago, Illinois 60611 Fax: (312) 587-4105 http://www.ada.org/JCNDE.aspx.

You might also like