Limits...
Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation.

Kazubke E, Schüttpelz-Brauns K - GMS Z Med Ausbild (2010)

Bottom Line: There was no significant influence of the variables "form of review committee" and "facilitation".Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency.The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

View Article: PubMed Central - HTML - PubMed

Affiliation: Humboldt-Universität zu Berlin, Institut für Psychologie, Berlin, Deutschland.

ABSTRACT

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects.

Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality.

Results: There was no significant influence of the variables "form of review committee" and "facilitation". However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition "face to face without facilitation" was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task.

Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

No MeSH data available.


Increase and decrease of the item discrimination coefficients comparing the original test and tests modified by RC.
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
getmorefigures.php?uid=PMC3140376&req=5

T2: Increase and decrease of the item discrimination coefficients comparing the original test and tests modified by RC.

Mentions: The Wilcoxon test shows that the number of multiple-choice questions whose coefficient of discrimination is higher than originally after modification by the RCs differs only slightly from the number of multiple-choice questions whose coefficient of discrimination decreased. Changes into one of the two directions can be recognized in approximately 50% of the question sample per test condition. For the overall of the questions per test condition a change in the power of the test cannot be proved statistically (see table 2 (Tab. 2)).


Review of multiple-choice-questions and group performance - A comparison of face-to-face and virtual groups with and without facilitation.

Kazubke E, Schüttpelz-Brauns K - GMS Z Med Ausbild (2010)

Increase and decrease of the item discrimination coefficients comparing the original test and tests modified by RC.
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
Show All Figures
getmorefigures.php?uid=PMC3140376&req=5

T2: Increase and decrease of the item discrimination coefficients comparing the original test and tests modified by RC.
Mentions: The Wilcoxon test shows that the number of multiple-choice questions whose coefficient of discrimination is higher than originally after modification by the RCs differs only slightly from the number of multiple-choice questions whose coefficient of discrimination decreased. Changes into one of the two directions can be recognized in approximately 50% of the question sample per test condition. For the overall of the questions per test condition a change in the power of the test cannot be proved statistically (see table 2 (Tab. 2)).

Bottom Line: There was no significant influence of the variables "form of review committee" and "facilitation".Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency.The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

View Article: PubMed Central - HTML - PubMed

Affiliation: Humboldt-Universität zu Berlin, Institut für Psychologie, Berlin, Deutschland.

ABSTRACT

Background: Multiple choice questions (MCQs) are often used in exams of medical education and need careful quality management for example by the application of review committees. This study investigates whether groups communicating virtually by email are similar to face-to-face groups concerning their review process performance and whether a facilitator has positive effects.

Methods: 16 small groups of students were examined, which had to evaluate and correct MCQs under four different conditions. In the second part of the investigation the changed questions were given to a new random sample for the judgement of the item quality.

Results: There was no significant influence of the variables "form of review committee" and "facilitation". However, face-to-face and virtual groups clearly differed in the required treatment times. The test condition "face to face without facilitation" was generally valued most positively concerning taking over responsibility, approach to work, sense of well-being, motivation and concentration on the task.

Discussion: Face-to-face and virtual groups are equally effective in the review of MCQs but differ concerning their efficiency. The application of electronic review seems to be possible but is hardly recommendable because of the long process time and technical problems.

No MeSH data available.