Limits...
The feasibility of automating audit and feedback for ART guideline adherence in Malawi.

Landis Lewis Z, Mello-Thoms C, Gadabu OJ, Gillespie EM, Douglas GP, Crowley RS - J Am Med Inform Assoc (2011)

Bottom Line: Feedback reports may support workplace learning by increasing HCWs' opportunities to reflect on their performance.A moderate number of recommendations from Malawi's ART guidelines can be used to generate automated guideline adherence feedback using existing EMR data.Further study is needed to determine the receptivity of HCWs to peer comparison feedback and barriers to implementation of automated audit and feedback in low-resource settings.

View Article: PubMed Central - PubMed

Affiliation: Department of Biomedical Informatics, Center for Health Informatics for Underserved, University of Pittsburgh, Pittsburgh, Pennsylvania 15260, USA. zjl1@pitt.edu

ABSTRACT

Objective: To determine the feasibility of using electronic medical record (EMR) data to provide audit and feedback of antiretroviral therapy (ART) clinical guideline adherence to healthcare workers (HCWs) in Malawi.

Materials and methods: We evaluated recommendations from Malawi's ART guidelines using GuideLine Implementability Appraisal criteria. Recommendations that passed selected criteria were converted into ratio-based performance measures. We queried representative EMR data to determine the feasibility of generating feedback for each performance measure, summed clinical encounters representing each performance measure's denominator, and then measured the distribution of encounter frequency for individual HCWs across nurse and clinical officer groups.

Results: We analyzed 423,831 encounters in the EMR data and generated automated feedback for 21 recommendations (12%) from Malawi's ART guidelines. We identified 11 nurse recommendations and eight clinical officer recommendations. Individual nurses and clinical officers had an average of 45 and 59 encounters per month, per recommendation, respectively. Another 37 recommendations (21%) would support audit and feedback if additional routine EMR data are captured and temporal constraints are modeled.

Discussion: It appears feasible to implement automated guideline adherence feedback that could potentially improve HCW performance and supervision. Feedback reports may support workplace learning by increasing HCWs' opportunities to reflect on their performance.

Conclusion: A moderate number of recommendations from Malawi's ART guidelines can be used to generate automated guideline adherence feedback using existing EMR data. Further study is needed to determine the receptivity of HCWs to peer comparison feedback and barriers to implementation of automated audit and feedback in low-resource settings.

Show MeSH
Distribution of average monthly encounters for 21 auditable recommendations listed in table 2.
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
getmorefigures.php?uid=PMC3197989&req=5

fig3: Distribution of average monthly encounters for 21 auditable recommendations listed in table 2.

Mentions: The mean frequency for all nurses' auditable recommendations was 45.13, ranging from 0.03 to 580.44 encounters per month. The mean frequency for all clinical officers' auditable recommendations was 58.83, ranging from 0.37 to 341.75 encounters per month. Figure 3 shows the distribution of average encounter frequencies across auditable recommendations. Thirteen of the 21 recommendations (#1–3, 7–9, 12–15, and 17–19) have a mean frequency above four encounters per month, per HCW, making them suitable for providing individualized feedback for at least one encounter per week on average.


The feasibility of automating audit and feedback for ART guideline adherence in Malawi.

Landis Lewis Z, Mello-Thoms C, Gadabu OJ, Gillespie EM, Douglas GP, Crowley RS - J Am Med Inform Assoc (2011)

Distribution of average monthly encounters for 21 auditable recommendations listed in table 2.
© Copyright Policy - open-access
Related In: Results  -  Collection

License 1 - License 2
Show All Figures
getmorefigures.php?uid=PMC3197989&req=5

fig3: Distribution of average monthly encounters for 21 auditable recommendations listed in table 2.
Mentions: The mean frequency for all nurses' auditable recommendations was 45.13, ranging from 0.03 to 580.44 encounters per month. The mean frequency for all clinical officers' auditable recommendations was 58.83, ranging from 0.37 to 341.75 encounters per month. Figure 3 shows the distribution of average encounter frequencies across auditable recommendations. Thirteen of the 21 recommendations (#1–3, 7–9, 12–15, and 17–19) have a mean frequency above four encounters per month, per HCW, making them suitable for providing individualized feedback for at least one encounter per week on average.

Bottom Line: Feedback reports may support workplace learning by increasing HCWs' opportunities to reflect on their performance.A moderate number of recommendations from Malawi's ART guidelines can be used to generate automated guideline adherence feedback using existing EMR data.Further study is needed to determine the receptivity of HCWs to peer comparison feedback and barriers to implementation of automated audit and feedback in low-resource settings.

View Article: PubMed Central - PubMed

Affiliation: Department of Biomedical Informatics, Center for Health Informatics for Underserved, University of Pittsburgh, Pittsburgh, Pennsylvania 15260, USA. zjl1@pitt.edu

ABSTRACT

Objective: To determine the feasibility of using electronic medical record (EMR) data to provide audit and feedback of antiretroviral therapy (ART) clinical guideline adherence to healthcare workers (HCWs) in Malawi.

Materials and methods: We evaluated recommendations from Malawi's ART guidelines using GuideLine Implementability Appraisal criteria. Recommendations that passed selected criteria were converted into ratio-based performance measures. We queried representative EMR data to determine the feasibility of generating feedback for each performance measure, summed clinical encounters representing each performance measure's denominator, and then measured the distribution of encounter frequency for individual HCWs across nurse and clinical officer groups.

Results: We analyzed 423,831 encounters in the EMR data and generated automated feedback for 21 recommendations (12%) from Malawi's ART guidelines. We identified 11 nurse recommendations and eight clinical officer recommendations. Individual nurses and clinical officers had an average of 45 and 59 encounters per month, per recommendation, respectively. Another 37 recommendations (21%) would support audit and feedback if additional routine EMR data are captured and temporal constraints are modeled.

Discussion: It appears feasible to implement automated guideline adherence feedback that could potentially improve HCW performance and supervision. Feedback reports may support workplace learning by increasing HCWs' opportunities to reflect on their performance.

Conclusion: A moderate number of recommendations from Malawi's ART guidelines can be used to generate automated guideline adherence feedback using existing EMR data. Further study is needed to determine the receptivity of HCWs to peer comparison feedback and barriers to implementation of automated audit and feedback in low-resource settings.

Show MeSH