Limits...
Does modality of survey administration impact data quality: audio computer assisted self interview (ACASI) versus self-administered pen and paper?

Reichmann WM, Losina E, Seage GR, Arbelaez C, Safren SA, Katz JN, Hetland A, Walensky RP - PLoS ONE (2010)

Bottom Line: We then compared ACASI and SAQ with respect to unusable data for domains that address sensitive topics.In the ED setting there may be a tradeoff between increased participation with SAQ versus better data quality with ACASI.Future studies of novel approaches to maximize the use of ACASI in the ED setting are needed.

View Article: PubMed Central - PubMed

Affiliation: Department of Orthopedic Surgery, Brigham and Women's Hospital, Boston, Massachusetts, United States of America. wreichmann@partners.org

ABSTRACT

Background: In the context of a randomized controlled trial (RCT) on HIV testing in the emergency department (ED) setting, we evaluated preferences for survey modality and data quality arising from each modality.

Methods: Enrolled participants were offered the choice of answering a survey via audio computer assisted self-interview (ACASI) or pen and paper self-administered questionnaire (SAQ). We evaluated factors influencing choice of survey modality. We defined unusable data for a particular survey domain as answering fewer than 75% of the questions in the domain. We then compared ACASI and SAQ with respect to unusable data for domains that address sensitive topics.

Results: Of 758 enrolled ED patients, 218 (29%) chose ACASI, 343 chose SAQ (45%) and 197 (26%) opted not to complete either. Results of the log-binomial regression indicated that older (RR = 1.08 per decade) and less educated participants (RR = 1.25) were more likely to choose SAQ over ACASI. ACASI yielded substantially less unusable data than SAQ.

Conclusions: In the ED setting there may be a tradeoff between increased participation with SAQ versus better data quality with ACASI. Future studies of novel approaches to maximize the use of ACASI in the ED setting are needed.

Show MeSH

Related in: MedlinePlus

Proportion of unusable data from the survey by threshold for unusable data and section of the questionnaire.Unusable data was defined as having responded to less than 75% of the questions for the selected domains of the survey. The dark gray bars represent participants who chose SAQ, while the white bars represent participants who chose the ACASI version of the survey. Error bars in Figure 1 represent the 95% confidence interval. 95% confidence intervals that do not overlap imply a statistical difference in unusable data by survey modality for that particular domain. CES-D: Center for Epidemiologic Studies Depression Scale. AUDIT: Alcohol Use Disorders Identification. STD: Sexually Transmitted Disease. ACASI: Audio Computer Assisted Self-Interview. SAQ: Self-Administered Questionnaire.
© Copyright Policy
Related In: Results  -  Collection


getmorefigures.php?uid=PMC2806918&req=5

pone-0008728-g001: Proportion of unusable data from the survey by threshold for unusable data and section of the questionnaire.Unusable data was defined as having responded to less than 75% of the questions for the selected domains of the survey. The dark gray bars represent participants who chose SAQ, while the white bars represent participants who chose the ACASI version of the survey. Error bars in Figure 1 represent the 95% confidence interval. 95% confidence intervals that do not overlap imply a statistical difference in unusable data by survey modality for that particular domain. CES-D: Center for Epidemiologic Studies Depression Scale. AUDIT: Alcohol Use Disorders Identification. STD: Sexually Transmitted Disease. ACASI: Audio Computer Assisted Self-Interview. SAQ: Self-Administered Questionnaire.

Mentions: Results examining the impact of survey modality on the magnitude of unusable data were examined across four different domains (sexual history; depression; alcohol use; and illicit drug use) are displayed in Figure 1 and Table 3. Figure 1 displays the proportion of unusable data by section of the survey for our base case threshold of unusable data of 75%. For the sexual history and depression domains the proportion of unusable data were 25% and 25% for the SAQ modality compared to 13% and 17% for the ACASI modality respectively. The smallest difference between the two modalities occurred in the alcohol use domain. Twenty-four percent of the participants who chose ACASI had unusable data for this domain compared to 30% for those who chose SAQ. The greatest disparity between the two modalities with respect to unusable data was for the illicit drug use domain with 18% of ACASI participants having unusable data compared to 36% of the SAQ participants.


Does modality of survey administration impact data quality: audio computer assisted self interview (ACASI) versus self-administered pen and paper?

Reichmann WM, Losina E, Seage GR, Arbelaez C, Safren SA, Katz JN, Hetland A, Walensky RP - PLoS ONE (2010)

Proportion of unusable data from the survey by threshold for unusable data and section of the questionnaire.Unusable data was defined as having responded to less than 75% of the questions for the selected domains of the survey. The dark gray bars represent participants who chose SAQ, while the white bars represent participants who chose the ACASI version of the survey. Error bars in Figure 1 represent the 95% confidence interval. 95% confidence intervals that do not overlap imply a statistical difference in unusable data by survey modality for that particular domain. CES-D: Center for Epidemiologic Studies Depression Scale. AUDIT: Alcohol Use Disorders Identification. STD: Sexually Transmitted Disease. ACASI: Audio Computer Assisted Self-Interview. SAQ: Self-Administered Questionnaire.
© Copyright Policy
Related In: Results  -  Collection

Show All Figures
getmorefigures.php?uid=PMC2806918&req=5

pone-0008728-g001: Proportion of unusable data from the survey by threshold for unusable data and section of the questionnaire.Unusable data was defined as having responded to less than 75% of the questions for the selected domains of the survey. The dark gray bars represent participants who chose SAQ, while the white bars represent participants who chose the ACASI version of the survey. Error bars in Figure 1 represent the 95% confidence interval. 95% confidence intervals that do not overlap imply a statistical difference in unusable data by survey modality for that particular domain. CES-D: Center for Epidemiologic Studies Depression Scale. AUDIT: Alcohol Use Disorders Identification. STD: Sexually Transmitted Disease. ACASI: Audio Computer Assisted Self-Interview. SAQ: Self-Administered Questionnaire.
Mentions: Results examining the impact of survey modality on the magnitude of unusable data were examined across four different domains (sexual history; depression; alcohol use; and illicit drug use) are displayed in Figure 1 and Table 3. Figure 1 displays the proportion of unusable data by section of the survey for our base case threshold of unusable data of 75%. For the sexual history and depression domains the proportion of unusable data were 25% and 25% for the SAQ modality compared to 13% and 17% for the ACASI modality respectively. The smallest difference between the two modalities occurred in the alcohol use domain. Twenty-four percent of the participants who chose ACASI had unusable data for this domain compared to 30% for those who chose SAQ. The greatest disparity between the two modalities with respect to unusable data was for the illicit drug use domain with 18% of ACASI participants having unusable data compared to 36% of the SAQ participants.

Bottom Line: We then compared ACASI and SAQ with respect to unusable data for domains that address sensitive topics.In the ED setting there may be a tradeoff between increased participation with SAQ versus better data quality with ACASI.Future studies of novel approaches to maximize the use of ACASI in the ED setting are needed.

View Article: PubMed Central - PubMed

Affiliation: Department of Orthopedic Surgery, Brigham and Women's Hospital, Boston, Massachusetts, United States of America. wreichmann@partners.org

ABSTRACT

Background: In the context of a randomized controlled trial (RCT) on HIV testing in the emergency department (ED) setting, we evaluated preferences for survey modality and data quality arising from each modality.

Methods: Enrolled participants were offered the choice of answering a survey via audio computer assisted self-interview (ACASI) or pen and paper self-administered questionnaire (SAQ). We evaluated factors influencing choice of survey modality. We defined unusable data for a particular survey domain as answering fewer than 75% of the questions in the domain. We then compared ACASI and SAQ with respect to unusable data for domains that address sensitive topics.

Results: Of 758 enrolled ED patients, 218 (29%) chose ACASI, 343 chose SAQ (45%) and 197 (26%) opted not to complete either. Results of the log-binomial regression indicated that older (RR = 1.08 per decade) and less educated participants (RR = 1.25) were more likely to choose SAQ over ACASI. ACASI yielded substantially less unusable data than SAQ.

Conclusions: In the ED setting there may be a tradeoff between increased participation with SAQ versus better data quality with ACASI. Future studies of novel approaches to maximize the use of ACASI in the ED setting are needed.

Show MeSH
Related in: MedlinePlus