Limits...
Comparison of collegial individual and group reviews of general practice multiple choice questions.

Böhme K, Schelling J, Streitlein-Böhme I, Glassen K, Schübel J, Jünger J - GMS Z Med Ausbild (2012)

Bottom Line: We found no significant differences between the reliability and the validity of individual reviews versus group reviews.On average slightly more time was spent on group reviews compared with the individual reviews.The subjective assessments of the study participants regarding their satisfaction with the process and the efficiency and effectiveness of the reviews suggest a preference for group reviews.

View Article: PubMed Central - HTML - PubMed

Affiliation: University Hospital Freiburg, School of General Practice, Freiburg, Germany. klaus.boehme@uniklinik-freiburg.de

ABSTRACT

Aims: In most German medical faculties, credits in general practice can be earned via exams using multiple-choice questions (MCQ). Measures such as peer-reviews may help assure the quality of these exams. In order to use time and personnel intensive peer reviews effectively and efficiently, the procedures used are key. Therefore, we wanted to find out whether there are differences between group and individual reviews regarding defined parameters.

Methods: We conducted a controlled cross-over study with three GP reviewers from four different German universities. Each reviewed 80 MCQs, 40 individually and 40 within a group, including external assessments by a panel of experts. Furthermore all reviewers were asked to evaluate the review process and the time spent carrying out these reviews.

Outcomes: We found no significant differences between the reliability and the validity of individual reviews versus group reviews. On average slightly more time was spent on group reviews compared with the individual reviews. The subjective assessments of the study participants regarding their satisfaction with the process and the efficiency and effectiveness of the reviews suggest a preference for group reviews.

Conclusions: Based on this study, there are no definite recommendations for or against either approach. When choosing between the two, the specific work structures and organisation at the local faculty should be taken into account.

Show MeSH

Related in: MedlinePlus

Flow chart for review of general medical exam questions (Group A=MCQs 1-40, Group B=MCQs 41-80)
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
getmorefigures.php?uid=PMC3420119&req=5

T2: Flow chart for review of general medical exam questions (Group A=MCQs 1-40, Group B=MCQs 41-80)

Mentions: The “Brief Guide to Reviewing MC Questions”, which explains the checklist criteria for the review (see Table 1 (Tab. 1)), was made available to all study participants. No further training of the reviewers took place. According to the study design (see Table 2 (Tab. 2)), each site the three reviewers then assessed 40 MCQs 40 individually and 40 MCQs in review groups.


Comparison of collegial individual and group reviews of general practice multiple choice questions.

Böhme K, Schelling J, Streitlein-Böhme I, Glassen K, Schübel J, Jünger J - GMS Z Med Ausbild (2012)

Flow chart for review of general medical exam questions (Group A=MCQs 1-40, Group B=MCQs 41-80)
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
Show All Figures
getmorefigures.php?uid=PMC3420119&req=5

T2: Flow chart for review of general medical exam questions (Group A=MCQs 1-40, Group B=MCQs 41-80)
Mentions: The “Brief Guide to Reviewing MC Questions”, which explains the checklist criteria for the review (see Table 1 (Tab. 1)), was made available to all study participants. No further training of the reviewers took place. According to the study design (see Table 2 (Tab. 2)), each site the three reviewers then assessed 40 MCQs 40 individually and 40 MCQs in review groups.

Bottom Line: We found no significant differences between the reliability and the validity of individual reviews versus group reviews.On average slightly more time was spent on group reviews compared with the individual reviews.The subjective assessments of the study participants regarding their satisfaction with the process and the efficiency and effectiveness of the reviews suggest a preference for group reviews.

View Article: PubMed Central - HTML - PubMed

Affiliation: University Hospital Freiburg, School of General Practice, Freiburg, Germany. klaus.boehme@uniklinik-freiburg.de

ABSTRACT

Aims: In most German medical faculties, credits in general practice can be earned via exams using multiple-choice questions (MCQ). Measures such as peer-reviews may help assure the quality of these exams. In order to use time and personnel intensive peer reviews effectively and efficiently, the procedures used are key. Therefore, we wanted to find out whether there are differences between group and individual reviews regarding defined parameters.

Methods: We conducted a controlled cross-over study with three GP reviewers from four different German universities. Each reviewed 80 MCQs, 40 individually and 40 within a group, including external assessments by a panel of experts. Furthermore all reviewers were asked to evaluate the review process and the time spent carrying out these reviews.

Outcomes: We found no significant differences between the reliability and the validity of individual reviews versus group reviews. On average slightly more time was spent on group reviews compared with the individual reviews. The subjective assessments of the study participants regarding their satisfaction with the process and the efficiency and effectiveness of the reviews suggest a preference for group reviews.

Conclusions: Based on this study, there are no definite recommendations for or against either approach. When choosing between the two, the specific work structures and organisation at the local faculty should be taken into account.

Show MeSH
Related in: MedlinePlus