Limits...
WikiBuild: a new online collaboration process for multistakeholder tool development and consensus building.

Gupta S, Wan FT, Newton D, Bhattacharyya OK, Chignell MH, Straus SE - J. Med. Internet Res. (2011)

Bottom Line: Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively.Use of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics.Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning.

View Article: PubMed Central - HTML - PubMed

Affiliation: Department of Medicine, University of Toronto, Toronto, Canada. guptas@smh.ca

ABSTRACT

Background: Production of media such as patient education tools requires methods that can integrate multiple stakeholder perspectives. Existing consensus techniques are poorly suited to design of visual media, can be expensive and logistically demanding, and are subject to caveats arising from group dynamics such as participant hierarchies.

Objective: Our objective was to develop a method that enables multistakeholder tool building while averting these difficulties.

Methods: We developed a wiki-inspired method and tested this through the collaborative design of an asthma action plan (AAP). In the development stage, we developed the Web-based tool by (1) establishing AAP content and format options, (2) building a Web-based application capable of representing each content and format permutation, (3) testing this tool among stakeholders, and (4) revising this tool based on stakeholder feedback. In the wiki stage, groups of participants used the revised tool in three separate 1-week "wiki" periods during which each group collaboratively authored an AAP by making multiple online selections.

Results: In the development stage, we recruited 16 participants (9/16 male) (4 pulmonologists, 4 primary care physicians, 3 certified asthma educators, and 5 patients) for system testing. The mean System Usability Scale (SUS) score for the tool used in testing was 72.2 (SD 10.2). In the wiki stage, we recruited 41 participants (15/41 male) (9 pulmonologists, 6 primary care physicians, 5 certified asthma educators, and 21 patients) from diverse locations. The mean SUS score for the revised tool was 75.9 (SD 19.6). Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively. The site was used actively for a mean of 32.0 hours per week, of which 3.1 hours per week (9.7%) constituted synchronous multiuser use (2-4 users at the same time). Participants averaged 23 (SD 33) minutes of login time and made 7.7 (SD 15) changes to the AAP per day. Among participants, 28/35 (80%) were satisfied with the final AAP, and only 3/34 (9%) perceived interstakeholder group hierarchies.

Conclusion: Use of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics. Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning. Potential uses of our method are broad, and further studies are required.

Show MeSH

Related in: MedlinePlus

Specific features of the wiki tool and wiki process. Responses were entered on a 5-point Likert scale labeled as follows: 1, disagree; 3, neutral; and 5, agree. For the purposes of this figure, scores of 1 and 2 were considered “disagree,” and 4 and 5 were considered “agree.” Each bar demonstrates the proportion of participants with each response, for each statement. This includes 35 participants (5 certified asthma educators, 5 primary care physicians, 6 pulmonologists, and 19 patients with asthma). (AAP = asthma action plan).
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
getmorefigures.php?uid=PMC3278094&req=5

figure6: Specific features of the wiki tool and wiki process. Responses were entered on a 5-point Likert scale labeled as follows: 1, disagree; 3, neutral; and 5, agree. For the purposes of this figure, scores of 1 and 2 were considered “disagree,” and 4 and 5 were considered “agree.” Each bar demonstrates the proportion of participants with each response, for each statement. This includes 35 participants (5 certified asthma educators, 5 primary care physicians, 6 pulmonologists, and 19 patients with asthma). (AAP = asthma action plan).

Mentions: Participant Likert scale responses are summarized in Figure 6, Figure 7, and Figure 8. Of 25 participants, 11 (44%) indicated that they changed their minds about one or more issue(s) based on other participants’ preferences.


WikiBuild: a new online collaboration process for multistakeholder tool development and consensus building.

Gupta S, Wan FT, Newton D, Bhattacharyya OK, Chignell MH, Straus SE - J. Med. Internet Res. (2011)

Specific features of the wiki tool and wiki process. Responses were entered on a 5-point Likert scale labeled as follows: 1, disagree; 3, neutral; and 5, agree. For the purposes of this figure, scores of 1 and 2 were considered “disagree,” and 4 and 5 were considered “agree.” Each bar demonstrates the proportion of participants with each response, for each statement. This includes 35 participants (5 certified asthma educators, 5 primary care physicians, 6 pulmonologists, and 19 patients with asthma). (AAP = asthma action plan).
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
Show All Figures
getmorefigures.php?uid=PMC3278094&req=5

figure6: Specific features of the wiki tool and wiki process. Responses were entered on a 5-point Likert scale labeled as follows: 1, disagree; 3, neutral; and 5, agree. For the purposes of this figure, scores of 1 and 2 were considered “disagree,” and 4 and 5 were considered “agree.” Each bar demonstrates the proportion of participants with each response, for each statement. This includes 35 participants (5 certified asthma educators, 5 primary care physicians, 6 pulmonologists, and 19 patients with asthma). (AAP = asthma action plan).
Mentions: Participant Likert scale responses are summarized in Figure 6, Figure 7, and Figure 8. Of 25 participants, 11 (44%) indicated that they changed their minds about one or more issue(s) based on other participants’ preferences.

Bottom Line: Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively.Use of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics.Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning.

View Article: PubMed Central - HTML - PubMed

Affiliation: Department of Medicine, University of Toronto, Toronto, Canada. guptas@smh.ca

ABSTRACT

Background: Production of media such as patient education tools requires methods that can integrate multiple stakeholder perspectives. Existing consensus techniques are poorly suited to design of visual media, can be expensive and logistically demanding, and are subject to caveats arising from group dynamics such as participant hierarchies.

Objective: Our objective was to develop a method that enables multistakeholder tool building while averting these difficulties.

Methods: We developed a wiki-inspired method and tested this through the collaborative design of an asthma action plan (AAP). In the development stage, we developed the Web-based tool by (1) establishing AAP content and format options, (2) building a Web-based application capable of representing each content and format permutation, (3) testing this tool among stakeholders, and (4) revising this tool based on stakeholder feedback. In the wiki stage, groups of participants used the revised tool in three separate 1-week "wiki" periods during which each group collaboratively authored an AAP by making multiple online selections.

Results: In the development stage, we recruited 16 participants (9/16 male) (4 pulmonologists, 4 primary care physicians, 3 certified asthma educators, and 5 patients) for system testing. The mean System Usability Scale (SUS) score for the tool used in testing was 72.2 (SD 10.2). In the wiki stage, we recruited 41 participants (15/41 male) (9 pulmonologists, 6 primary care physicians, 5 certified asthma educators, and 21 patients) from diverse locations. The mean SUS score for the revised tool was 75.9 (SD 19.6). Users made 872, 466, and 599 successful changes to the AAP in weeks 1, 2, and 3, respectively. The site was used actively for a mean of 32.0 hours per week, of which 3.1 hours per week (9.7%) constituted synchronous multiuser use (2-4 users at the same time). Participants averaged 23 (SD 33) minutes of login time and made 7.7 (SD 15) changes to the AAP per day. Among participants, 28/35 (80%) were satisfied with the final AAP, and only 3/34 (9%) perceived interstakeholder group hierarchies.

Conclusion: Use of a wiki-inspired method allowed for effective collaborative design of content and format aspects of an AAP while minimizing logistical requirements, maximizing geographical representation, and mitigating hierarchical group dynamics. Our method faced unique software and hardware challenges, and raises certain questions regarding its effect on group functioning. Potential uses of our method are broad, and further studies are required.

Show MeSH
Related in: MedlinePlus