Limits...
The construct validity and reliability of an assessment tool for competency in cochlear implant surgery.

Piromchai P, Kasemsiri P, Wijewickrema S, Ioannou I, Kennedy G, O'Leary S - Biomed Res Int (2014)

Bottom Line: The overall agreement was high.The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components.This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

View Article: PubMed Central - PubMed

Affiliation: Department of Otolaryngology, Royal Victorian Eye and Ear Hospital, University of Melbourne, East Melbourne, VIC 3002, Australia ; Department of Otorhinolaryngology, Faculty of Medicine, Khon Kaen University, Khon Kaen 40002, Thailand.

ABSTRACT

Introduction: We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery.

Methods: Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos.

Results: Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components.

Conclusion: Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

Show MeSH
Comparison of mean score with 95% CI for task-based checklist items.
© Copyright Policy
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4120485&req=5

fig2: Comparison of mean score with 95% CI for task-based checklist items.

Mentions: For the task-based checklist, 5 out of 7 items were significantly different in the two groups (P < 0.05). The items that showed the highest difference between the expert and resident groups were “remove bone on the anterior medial surface of the fallopian canal just below the pyramidal process” (mean difference 1.72, 95% CI 1.15 to 2.30, P < 0.001) and “facial recess is opened to visualize the round window niche” (mean difference 1.51, 95% CI 0.78 to 2.24, P < 0.001). The least significant items were “preserve a layer of bone overlying the facial nerve” and “preserve a layer of bone overlying the chorda tympani” (Figure 2).


The construct validity and reliability of an assessment tool for competency in cochlear implant surgery.

Piromchai P, Kasemsiri P, Wijewickrema S, Ioannou I, Kennedy G, O'Leary S - Biomed Res Int (2014)

Comparison of mean score with 95% CI for task-based checklist items.
© Copyright Policy
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4120485&req=5

fig2: Comparison of mean score with 95% CI for task-based checklist items.
Mentions: For the task-based checklist, 5 out of 7 items were significantly different in the two groups (P < 0.05). The items that showed the highest difference between the expert and resident groups were “remove bone on the anterior medial surface of the fallopian canal just below the pyramidal process” (mean difference 1.72, 95% CI 1.15 to 2.30, P < 0.001) and “facial recess is opened to visualize the round window niche” (mean difference 1.51, 95% CI 0.78 to 2.24, P < 0.001). The least significant items were “preserve a layer of bone overlying the facial nerve” and “preserve a layer of bone overlying the chorda tympani” (Figure 2).

Bottom Line: The overall agreement was high.The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components.This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

View Article: PubMed Central - PubMed

Affiliation: Department of Otolaryngology, Royal Victorian Eye and Ear Hospital, University of Melbourne, East Melbourne, VIC 3002, Australia ; Department of Otorhinolaryngology, Faculty of Medicine, Khon Kaen University, Khon Kaen 40002, Thailand.

ABSTRACT

Introduction: We introduce a rating tool that objectively evaluates the skills of surgical trainees performing cochlear implant surgery.

Methods: Seven residents and seven experts performed cochlear implant surgery sessions from mastoidectomy to cochleostomy on a standardized virtual reality temporal bone. A total of twenty-eight assessment videos were recorded and two consultant otolaryngologists evaluated the performance of each participant using these videos.

Results: Interrater reliability was calculated using the intraclass correlation coefficient for both the global and checklist components of the assessment instrument. The overall agreement was high. The construct validity of this instrument was strongly supported by the significantly higher scores in the expert group for both components.

Conclusion: Our results indicate that the proposed assessment tool for cochlear implant surgery is reliable, accurate, and easy to use. This instrument can thus be used to provide objective feedback on overall and task-specific competency in cochlear implantation.

Show MeSH