Limits...
Disseminating quality improvement: study protocol for a large cluster-randomized trial.

Quanbeck AR, Gustafson DH, Ford JH, Pulvermacher A, French MT, McConnell KJ, McCarty D - Implement Sci (2011)

Bottom Line: Effectiveness is defined as reducing waiting time (days between first contact and treatment), increasing program admissions, and increasing continuation in treatment.Opportunity costs will be estimated for the resources associated with providing the services.We are fitting a mixed-effect regression model to each program's average monthly waiting time and continuation rates (based on aggregated client records), including terms to isolate state and intervention effects.

View Article: PubMed Central - HTML - PubMed

Affiliation: Center for Health Enhancement Systems Studies, Industrial and Systems Engineering Department, University of Wisconsin-Madison, Madison, WI 53706, USA. andrew.quanbeck@chess.wisc.edu

ABSTRACT

Background: Dissemination is a critical facet of implementing quality improvement in organizations. As a field, addiction treatment has produced effective interventions but disseminated them slowly and reached only a fraction of people needing treatment. This study investigates four methods of disseminating quality improvement (QI) to addiction treatment programs in the U.S. It is, to our knowledge, the largest study of organizational change ever conducted in healthcare. The trial seeks to determine the most cost-effective method of disseminating quality improvement in addiction treatment.

Methods: The study is evaluating the costs and effectiveness of different QI approaches by randomizing 201 addiction-treatment programs to four interventions. Each intervention used a web-based learning kit plus monthly phone calls, coaching, face-to-face meetings, or the combination of all three. Effectiveness is defined as reducing waiting time (days between first contact and treatment), increasing program admissions, and increasing continuation in treatment. Opportunity costs will be estimated for the resources associated with providing the services.

Outcomes: The study has three primary outcomes: waiting time, annual program admissions, and continuation in treatment. Secondary outcomes include: voluntary employee turnover, treatment completion, and operating margin. We are also seeking to understand the role of mediators, moderators, and other factors related to an organization's success in making changes.

Analysis: We are fitting a mixed-effect regression model to each program's average monthly waiting time and continuation rates (based on aggregated client records), including terms to isolate state and intervention effects. Admissions to treatment are aggregated to a yearly level to compensate for seasonality. We will order the interventions by cost to compare them pair-wise to the lowest cost intervention (monthly phone calls). All randomized sites with outcome data will be included in the analysis, following the intent-to-treat principle. Organizational covariates in the analysis include program size, management score, and state.

Discussion: The study offers seven recommendations for conducting a large-scale cluster-randomized trial: provide valuable services, have aims that are clear and important, seek powerful allies, understand the recruiting challenge, cultivate commitment, address turnover, and encourage rigor and flexibility.

Trial registration: ClinicalTrials. govNCT00934141.

Show MeSH

Related in: MedlinePlus

The organization and design of the NIATx 200 cluster-randomized trial.
© Copyright Policy - open-access
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC3108336&req=5

Figure 1: The organization and design of the NIATx 200 cluster-randomized trial.

Mentions: NIATx 200 is a cluster-randomized trial with four interventions: interest circle calls, coaching, learning sessions, and the combination of interest circle calls, coaching, and learning sessions. Figure 1 shows the study's organization and design.


Disseminating quality improvement: study protocol for a large cluster-randomized trial.

Quanbeck AR, Gustafson DH, Ford JH, Pulvermacher A, French MT, McConnell KJ, McCarty D - Implement Sci (2011)

The organization and design of the NIATx 200 cluster-randomized trial.
© Copyright Policy - open-access
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC3108336&req=5

Figure 1: The organization and design of the NIATx 200 cluster-randomized trial.
Mentions: NIATx 200 is a cluster-randomized trial with four interventions: interest circle calls, coaching, learning sessions, and the combination of interest circle calls, coaching, and learning sessions. Figure 1 shows the study's organization and design.

Bottom Line: Effectiveness is defined as reducing waiting time (days between first contact and treatment), increasing program admissions, and increasing continuation in treatment.Opportunity costs will be estimated for the resources associated with providing the services.We are fitting a mixed-effect regression model to each program's average monthly waiting time and continuation rates (based on aggregated client records), including terms to isolate state and intervention effects.

View Article: PubMed Central - HTML - PubMed

Affiliation: Center for Health Enhancement Systems Studies, Industrial and Systems Engineering Department, University of Wisconsin-Madison, Madison, WI 53706, USA. andrew.quanbeck@chess.wisc.edu

ABSTRACT

Background: Dissemination is a critical facet of implementing quality improvement in organizations. As a field, addiction treatment has produced effective interventions but disseminated them slowly and reached only a fraction of people needing treatment. This study investigates four methods of disseminating quality improvement (QI) to addiction treatment programs in the U.S. It is, to our knowledge, the largest study of organizational change ever conducted in healthcare. The trial seeks to determine the most cost-effective method of disseminating quality improvement in addiction treatment.

Methods: The study is evaluating the costs and effectiveness of different QI approaches by randomizing 201 addiction-treatment programs to four interventions. Each intervention used a web-based learning kit plus monthly phone calls, coaching, face-to-face meetings, or the combination of all three. Effectiveness is defined as reducing waiting time (days between first contact and treatment), increasing program admissions, and increasing continuation in treatment. Opportunity costs will be estimated for the resources associated with providing the services.

Outcomes: The study has three primary outcomes: waiting time, annual program admissions, and continuation in treatment. Secondary outcomes include: voluntary employee turnover, treatment completion, and operating margin. We are also seeking to understand the role of mediators, moderators, and other factors related to an organization's success in making changes.

Analysis: We are fitting a mixed-effect regression model to each program's average monthly waiting time and continuation rates (based on aggregated client records), including terms to isolate state and intervention effects. Admissions to treatment are aggregated to a yearly level to compensate for seasonality. We will order the interventions by cost to compare them pair-wise to the lowest cost intervention (monthly phone calls). All randomized sites with outcome data will be included in the analysis, following the intent-to-treat principle. Organizational covariates in the analysis include program size, management score, and state.

Discussion: The study offers seven recommendations for conducting a large-scale cluster-randomized trial: provide valuable services, have aims that are clear and important, seek powerful allies, understand the recruiting challenge, cultivate commitment, address turnover, and encourage rigor and flexibility.

Trial registration: ClinicalTrials. govNCT00934141.

Show MeSH
Related in: MedlinePlus