Developing a patient-centered outcome measure for complementary and alternative medicine therapies II: Refining content validity through cognitive interviews

Persistent Link:
http://hdl.handle.net/10150/610360
Title:
Developing a patient-centered outcome measure for complementary and alternative medicine therapies II: Refining content validity through cognitive interviews
Author:
Thompson, Jennifer; Kelly, Kimberly; Ritenbaugh, Cheryl; Hopkins, Allison; Sims, Colette; Coons, Stephen
Affiliation:
Division of Biological Sciences, University of Georgia, Athens, GA, USA; Department of Family and Community Medicine, School of Medicine, University of Arizona, Tucson, AZ, USA; School of Anthropology, University of Arizona, Tucson, AZ, USA; Patient-Reported Outcome Consortium, Critical Path Institute, Tucson, AZ, USA
Issue Date:
2011
Publisher:
BioMed Central
Citation:
Thompson et al. BMC Complementary and Alternative Medicine 2011, 11:136 http://www.biomedcentral.com/1472-6882/11/136
Journal:
BMC Complementary and Alternative Medicine
Rights:
© 2011 Thompson et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0)
Collection Information:
This item is part of the UA Faculty Publications collection. For more information this item or other items in the UA Campus Repository, contact the University of Arizona Libraries at repository@u.library.arizona.edu.
Abstract:
BACKGROUND:Available measures of patient-reported outcomes for complementary and alternative medicine (CAM) inadequately capture the range of patient-reported treatment effects. The Self-Assessment of Change questionnaire was developed to measure multi-dimensional shifts in well-being for CAM users. With content derived from patient narratives, items were subsequently focused through interviews on a new cohort of participants. Here we present the development of the final version in which the content and format is refined through cognitive interviews.METHODS:We conducted cognitive interviews across five iterations of questionnaire refinement with a culturally diverse sample of 28 CAM users. In each iteration, participant critiques were used to revise the questionnaire, which was then re-tested in subsequent rounds of cognitive interviews. Following all five iterations, transcripts of cognitive interviews were systematically coded and analyzed to examine participants' understanding of the format and content of the final questionnaire. Based on this data, we established summary descriptions and selected exemplar quotations for each word pair on the final questionnaire.RESULTS:The final version of the Self-Assessment of Change questionnaire (SAC) includes 16 word pairs, nine of which remained unchanged from the original draft. Participants consistently said that these stable word pairs represented opposite ends of the same domain of experience and the meanings of these terms were stable across the participant pool. Five pairs underwent revision and two word pairs were added. Four word pairs were eliminated for redundancy or because participants did not agree on the meaning of the terms. Cognitive interviews indicate that participants understood the format of the questionnaire and considered each word pair to represent opposite poles of a shared domain of experience.CONCLUSIONS:We have placed lay language and direct experience at the center of questionnaire revision and refinement. In so doing, we provide an innovative model for the development of truly patient-centered outcome measures. Although this instrument was designed and tested in a CAM-specific population, it may be useful in assessing multi-dimensional shifts in well-being across a broader patient population.
EISSN:
1472-6882
DOI:
10.1186/1472-6882-11-136
Keywords:
Complementary and alternative medicine (CAM); patient-reported outcomes (PROs); cognitive interviewing; patient-centered care; non-specific outcomes; questionnaire development; retrospective pre-test; well-being
Version:
Final published version
Additional Links:
http://www.biomedcentral.com/1472-6882/11/136

Full metadata record

DC FieldValue Language
dc.contributor.authorThompson, Jenniferen
dc.contributor.authorKelly, Kimberlyen
dc.contributor.authorRitenbaugh, Cherylen
dc.contributor.authorHopkins, Allisonen
dc.contributor.authorSims, Coletteen
dc.contributor.authorCoons, Stephenen
dc.date.accessioned2016-05-20T09:05:06Z-
dc.date.available2016-05-20T09:05:06Z-
dc.date.issued2011en
dc.identifier.citationThompson et al. BMC Complementary and Alternative Medicine 2011, 11:136 http://www.biomedcentral.com/1472-6882/11/136en
dc.identifier.doi10.1186/1472-6882-11-136en
dc.identifier.urihttp://hdl.handle.net/10150/610360-
dc.description.abstractBACKGROUND:Available measures of patient-reported outcomes for complementary and alternative medicine (CAM) inadequately capture the range of patient-reported treatment effects. The Self-Assessment of Change questionnaire was developed to measure multi-dimensional shifts in well-being for CAM users. With content derived from patient narratives, items were subsequently focused through interviews on a new cohort of participants. Here we present the development of the final version in which the content and format is refined through cognitive interviews.METHODS:We conducted cognitive interviews across five iterations of questionnaire refinement with a culturally diverse sample of 28 CAM users. In each iteration, participant critiques were used to revise the questionnaire, which was then re-tested in subsequent rounds of cognitive interviews. Following all five iterations, transcripts of cognitive interviews were systematically coded and analyzed to examine participants' understanding of the format and content of the final questionnaire. Based on this data, we established summary descriptions and selected exemplar quotations for each word pair on the final questionnaire.RESULTS:The final version of the Self-Assessment of Change questionnaire (SAC) includes 16 word pairs, nine of which remained unchanged from the original draft. Participants consistently said that these stable word pairs represented opposite ends of the same domain of experience and the meanings of these terms were stable across the participant pool. Five pairs underwent revision and two word pairs were added. Four word pairs were eliminated for redundancy or because participants did not agree on the meaning of the terms. Cognitive interviews indicate that participants understood the format of the questionnaire and considered each word pair to represent opposite poles of a shared domain of experience.CONCLUSIONS:We have placed lay language and direct experience at the center of questionnaire revision and refinement. In so doing, we provide an innovative model for the development of truly patient-centered outcome measures. Although this instrument was designed and tested in a CAM-specific population, it may be useful in assessing multi-dimensional shifts in well-being across a broader patient population.en
dc.language.isoenen
dc.publisherBioMed Centralen
dc.relation.urlhttp://www.biomedcentral.com/1472-6882/11/136en
dc.rights© 2011 Thompson et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0)en
dc.subjectComplementary and alternative medicine (CAM)en
dc.subjectpatient-reported outcomes (PROs)en
dc.subjectcognitive interviewingen
dc.subjectpatient-centered careen
dc.subjectnon-specific outcomesen
dc.subjectquestionnaire developmenten
dc.subjectretrospective pre-testen
dc.subjectwell-beingen
dc.titleDeveloping a patient-centered outcome measure for complementary and alternative medicine therapies II: Refining content validity through cognitive interviewsen
dc.typeArticleen
dc.identifier.eissn1472-6882en
dc.contributor.departmentDivision of Biological Sciences, University of Georgia, Athens, GA, USAen
dc.contributor.departmentDepartment of Family and Community Medicine, School of Medicine, University of Arizona, Tucson, AZ, USAen
dc.contributor.departmentSchool of Anthropology, University of Arizona, Tucson, AZ, USAen
dc.contributor.departmentPatient-Reported Outcome Consortium, Critical Path Institute, Tucson, AZ, USAen
dc.identifier.journalBMC Complementary and Alternative Medicineen
dc.description.collectioninformationThis item is part of the UA Faculty Publications collection. For more information this item or other items in the UA Campus Repository, contact the University of Arizona Libraries at repository@u.library.arizona.edu.en
dc.eprint.versionFinal published versionen
All Items in UA Campus Repository are protected by copyright, with all rights reserved, unless otherwise indicated.