Limits...
Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation.

Kazubke E, Schüttpelz-Brauns K - GMS Z Med Ausbild (2010)

Bottom Line: There was no significant influence of the variables "form of review committee" and "facilitation".Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency.The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

View Article: PubMed Central - HTML - PubMed

Affiliation: Humboldt-Universität zu Berlin, Institut für Psychologie, Berlin, Deutschland.

ABSTRACT

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects.

Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality.

Results: There was no significant influence of the variables "form of review committee" and "facilitation". However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition "face to face without facilitation" was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task.

Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

No MeSH data available.


Reliabilities of the original test and the modified tests
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
getmorefigures.php?uid=PMC3140376&req=5

T1: Reliabilities of the original test and the modified tests

Mentions: The reliabilities of the respective tests which were modified by the RCs improve in comparison to the original test (see table 1 (Tab. 1)). Two of four tests show relevant higher reliability.


Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation.

Kazubke E, Schüttpelz-Brauns K - GMS Z Med Ausbild (2010)

Reliabilities of the original test and the modified tests
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
Show All Figures
getmorefigures.php?uid=PMC3140376&req=5

T1: Reliabilities of the original test and the modified tests
Mentions: The reliabilities of the respective tests which were modified by the RCs improve in comparison to the original test (see table 1 (Tab. 1)). Two of four tests show relevant higher reliability.

Bottom Line: There was no significant influence of the variables "form of review committee" and "facilitation".Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency.The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

View Article: PubMed Central - HTML - PubMed

Affiliation: Humboldt-Universität zu Berlin, Institut für Psychologie, Berlin, Deutschland.

ABSTRACT

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects.

Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality.

Results: There was no significant influence of the variables "form of review committee" and "facilitation". However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition "face to face without facilitation" was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task.

Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

No MeSH data available.