Limits...
Correlation of the NBME advanced clinical examination in EM and the national EM M4 exams.

Hiller K, Miller ES, Lawson L, Wald D, Beeson M, Heitz C, Morrissey T, House J, Poznanski S - West J Emerg Med (2015)

Bottom Line: The R-squared values were 0.28 and 0.30 (0.18 and 0.13 scaled), respectively [corrected].There was significant cluster effect by institution.There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.

View Article: PubMed Central - PubMed

Affiliation: University of Arizona, Department of Emergency Medicine, Tucson, Arizona.

ABSTRACT

Introduction: Since 2011 two online, validated exams for fourth-year emergency medicine (EM) students have been available (National EM M4 Exams). In 2013 the National Board of Medical Examiners offered the Advanced Clinical Examination in Emergency Medicine (EM-ACE). All of these exams are now in widespread use; however, there are no data on how they correlate. This study evaluated the correlation between the EM-ACE exam and the National EM M4 Exams.

Methods: From May 2013 to April 2014 the EM-ACE and one version of the EM M4 exam were administered sequentially to fourth-year EM students at five U.S. medical schools. Data collected included institution, gross and scaled scores and version of the EM M4 exam. We performed Pearson's correlation and random effects linear regression.

Results: 305 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (281 and 24, respectively) [corrected].The mean percent correct for the exams were as follows: EM-ACE 74.9 (SD-9.82), V1 83.0 (SD-6.39), V2 78.5 (SD-7.70) [corrected]. Pearson's correlation coefficient for the V1/EM-ACE was 0.53 (0.43 scaled) and for the V2/EM-ACE was 0.58 (0.41 scaled) [corrected]. The coefficient of determination for V1/ EM-ACE was 0.73 and for V2/EM-ACE 0.71 (0.65 and .49 for scaled scores) [ERRATUM]. The R-squared values were 0.28 and 0.30 (0.18 and 0.13 scaled), respectively [corrected]. There was significant cluster effect by institution.

Conclusion: There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.

Show MeSH

Related in: MedlinePlus

Correlation of NBME EM-ACE and National EM M4 V1 and V2.EM, emergency medicine; V1, first version; V2, second version; NBME, National Board of Medical Examiners; EM-ACE, Advanced Clinical Exam in Emergency Medicine
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
getmorefigures.php?uid=PMC4307698&req=5

f1-wjem-16-138: Correlation of NBME EM-ACE and National EM M4 V1 and V2.EM, emergency medicine; V1, first version; V2, second version; NBME, National Board of Medical Examiners; EM-ACE, Advanced Clinical Exam in Emergency Medicine

Mentions: Five institutions administered both the NBME EM-ACE and one version of the EM M4 exam to 303 fourth-year students at the end of their EM rotation. V1 of the EM M4 was administered to 279 students, and V2 to 24 students. This profile is similar to the national distribution of students who took V1 and V2 in 2013–14 (5060 and 787, respectively).7 The mean NBME raw score was 74.8 (n=216; SD 8.83). The mean NBME scaled score for the entire cohort was 68.2 (SD 12.8). The mean EM M4 V1 raw score was 83.0 (n=279; SD 6.41), and the mean EM M4 V2 raw score was 78.5 (n=24, SD 7.80). We performed Pearson’s correlations and linear regression on the NBME raw and scaled scores and V1 and V2 of the EM M4 exams. There was moderate positive correlation for all comparisons (Figures 1 and 2). There was a cluster effect for institution, so it was retained in the linear regression analysis for both the EM M4 versions (Table 1).


Correlation of the NBME advanced clinical examination in EM and the national EM M4 exams.

Hiller K, Miller ES, Lawson L, Wald D, Beeson M, Heitz C, Morrissey T, House J, Poznanski S - West J Emerg Med (2015)

Correlation of NBME EM-ACE and National EM M4 V1 and V2.EM, emergency medicine; V1, first version; V2, second version; NBME, National Board of Medical Examiners; EM-ACE, Advanced Clinical Exam in Emergency Medicine
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
Show All Figures
getmorefigures.php?uid=PMC4307698&req=5

f1-wjem-16-138: Correlation of NBME EM-ACE and National EM M4 V1 and V2.EM, emergency medicine; V1, first version; V2, second version; NBME, National Board of Medical Examiners; EM-ACE, Advanced Clinical Exam in Emergency Medicine
Mentions: Five institutions administered both the NBME EM-ACE and one version of the EM M4 exam to 303 fourth-year students at the end of their EM rotation. V1 of the EM M4 was administered to 279 students, and V2 to 24 students. This profile is similar to the national distribution of students who took V1 and V2 in 2013–14 (5060 and 787, respectively).7 The mean NBME raw score was 74.8 (n=216; SD 8.83). The mean NBME scaled score for the entire cohort was 68.2 (SD 12.8). The mean EM M4 V1 raw score was 83.0 (n=279; SD 6.41), and the mean EM M4 V2 raw score was 78.5 (n=24, SD 7.80). We performed Pearson’s correlations and linear regression on the NBME raw and scaled scores and V1 and V2 of the EM M4 exams. There was moderate positive correlation for all comparisons (Figures 1 and 2). There was a cluster effect for institution, so it was retained in the linear regression analysis for both the EM M4 versions (Table 1).

Bottom Line: The R-squared values were 0.28 and 0.30 (0.18 and 0.13 scaled), respectively [corrected].There was significant cluster effect by institution.There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.

View Article: PubMed Central - PubMed

Affiliation: University of Arizona, Department of Emergency Medicine, Tucson, Arizona.

ABSTRACT

Introduction: Since 2011 two online, validated exams for fourth-year emergency medicine (EM) students have been available (National EM M4 Exams). In 2013 the National Board of Medical Examiners offered the Advanced Clinical Examination in Emergency Medicine (EM-ACE). All of these exams are now in widespread use; however, there are no data on how they correlate. This study evaluated the correlation between the EM-ACE exam and the National EM M4 Exams.

Methods: From May 2013 to April 2014 the EM-ACE and one version of the EM M4 exam were administered sequentially to fourth-year EM students at five U.S. medical schools. Data collected included institution, gross and scaled scores and version of the EM M4 exam. We performed Pearson's correlation and random effects linear regression.

Results: 305 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (281 and 24, respectively) [corrected].The mean percent correct for the exams were as follows: EM-ACE 74.9 (SD-9.82), V1 83.0 (SD-6.39), V2 78.5 (SD-7.70) [corrected]. Pearson's correlation coefficient for the V1/EM-ACE was 0.53 (0.43 scaled) and for the V2/EM-ACE was 0.58 (0.41 scaled) [corrected]. The coefficient of determination for V1/ EM-ACE was 0.73 and for V2/EM-ACE 0.71 (0.65 and .49 for scaled scores) [ERRATUM]. The R-squared values were 0.28 and 0.30 (0.18 and 0.13 scaled), respectively [corrected]. There was significant cluster effect by institution.

Conclusion: There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.

Show MeSH
Related in: MedlinePlus