To view endorsement decisions for each measure derived from this instrument, please refer to the individual measure pages.
The Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician & Group Survey 3.1 (CG-CAHPS) is a standardized survey instrument that asks patients to report on their experiences with primary or specialty care received from providers and their staff in ambulatory care settings over the preceding 6 months. CG-CAHPS Survey Version 1.0 was endorsed by NQF in July 2007 (NQF #0005) and version 2.0 received maintenance endorsement in early 2015. Version 3.0 was released in July 2015 and was last endorsed in 2019. The 3.1 version of the survey updates the 3.0 version to prompt respondents to consider in-person, phone, and video visits when they answer the questions and to report which type(s) of visits they had. The survey is part of the CAHPS family of patient experience surveys and is available at https://www.ahrq.gov/cahps/surveys-guidance/cg/index.html
The Adult CG-CAHPS Survey 3.1 is administered to patients aged 18 and over who had at least one visit to a selected provider during the past 6 months. The survey has 32 questions including one overall rating of the provider and 12 questions used to create four (4) composite measures.
The Child CG-CAHPS Survey 3.1 is administered to the parents or guardians of pediatric patients under the age of 18. The survey has 40 questions including one overall rating of the provider and 11 questions used to create four (4) composite measures.
The composite measures are:
- Getting Timely Appointments, Care, and Information (Access)
- How Well Providers Communicate With Patients (Provider Communication)
- Helpful, Courteous, and Respectful Office Staff (Office Staff)
- Providers’ Use of Information to Coordinate Patient Care (Care Coordination)
The survey also has a single-item rating measure:
- Rating of Provider
A guidance document is available on the AHRQ CAHPS website (https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…) which explains how to administer the survey including how to choose the sample, maintain confidentiality, collect the data, track returned questionnaires, and calculate the response rate.
Measure Specs
General Information
The CAHPS Clinician & Group (CG-CAHPS) Survey assesses aspects of health care delivery that are important to patients and for which patients are the best or only source of information (Cleary, 2016). Further, the CG-CAHPS survey focuses on patient-centered care (Cleary, Edgman-Levitan, 1997; Cleary, 2016), one of the six central aims identified by the Institute of Medicine for improving the health care system (IOM, 2001). A focus on the patient experience has the potential to enhance clinical outcomes, improve patient safety, and reduce unnecessary medical services. Moreover, assessing patient experience through surveys that include data on the demographic characteristics of respondents, such as race and ethnicity, can help identify the extent to which positive experiences are distributed equitably across patients (Haviland et al., 2003).
Use of this measure will benefit both patients, providers, and medical groups:
- Patients can use information from the measures to help make more informed choices about which practice or medical group to use.
- Medical groups and their providers can use data from the surveys for quality improvement initiatives and incentives.
- Researchers can use data files from the surveys to help answer important health services research questions.
Patient experience encompasses the range of interactions that patients have with the healthcare system. The terms patient satisfaction and patient experience are often used interchangeably, but they are not the same. CAHPS surveys ask patients to report on what they experienced in a healthcare encounter—for example, whether something happened or how often it happened. Patient experience of care surveys provide actionable, objective information for quality improvement. Patient satisfaction surveys, on the other hand, use ratings to measure whether a patient’s expectations about a health encounter were met.
The CG-CAHPS Survey is a standardized survey instrument for measuring patients’ perspectives on their care. The survey is generally administered annually to patients who have received care in the last 6 months.
References
Cleary, PD, Edgman-Levitan, S. (1997). Health care quality. Incorporating consumer perspectives. JAMA. 278(19), 1608-12.
Cleary, PD. (2016). Evolving concepts of patient-centered care and the assessment of patient care experiences; optimism and opposition. J Health Pol, Policy & Law, 41 (4), 675-696.
Haviland, M. et al, (2003). Do health care ratings differ by race or ethnicity? Joint Commission Journal on Quality and Safety. 29(3), 134-145.
Institute of Medicine. (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Accessible at https://nap.nationalacademies.org/catalog/10027/crossing-the-quality-ch….
The data were obtained from the Centers for Medicare & Medicaid Services (CMS) Center for Medicare and Medicaid Innovation (CMMI) Primary Care First (PCF) Patient Experience of Care Survey (PECS), which is based on the Adult CG-CAHPS Survey and adds Patient-Centered Medical Home Supplemental items (https://pcfpecs.org/Survey-and-Protocols) The survey is administered annually via mail with phone follow-up. The 2023 survey data included 2,490 practice sites and 238,204 respondents. For testing and performance scores, practice sites with less than 10 surveys were excluded. After the restriction, the number of sites is 2,486.
Measure Calculation
Respondents report on their experiences accessing and using care over the past 6 months.
AHRQ calculates CG-CAHPS Survey this composite measure scores using a top box scoring method.
Composite Measures:
There are two basic steps to calculating a composite measure score for a practice site:
- Calculate the proportion of responses in the top box or most positive response category for each question in a composite measure.
- Calculate the mean or average top box scores across all questions in a composite measure to determine the composite measure’s top box score.
For the top box or “top proportion” score, the numerator is the number of respondents who answered that they “Always” received the desired care or service for a given measure. For example, if 400 out of 1,000 total respondents answered “Always” to a composite measure item, the top box score for that item would be 40 percent [i.e., (400 ÷ 1,000)*100 = 40%].
Lower proportion and middle proportion composite measure scores can also be calculated following the same methodology where the lower proportion is the proportion answering “Never” or “Sometimes” and the middle proportion is the proportion answering “Usually”.
Rating Item:
For the rating item, the numerator for the top box score is the number of respondents who responded 9 or 10 on the 0-10 scale (where 10 is the “Best” and 0 is the “Worst”). For example, if 600 out of 1,000 total respondents answered “9” or “10” to a rating item, the top box score for that item would be 60 percent [i.e., (600 ÷ 1,000)*100 = 60%].
Lower proportion and middle proportion rating scores can also be calculated where the lower proportion is the proportion answering 0-6 on the 0-10 scale and the middle proportion is the proportion answering 7 or 8.
Users may also choose to calculate mean scores or linearized mean scores.
Note the survey includes screener items to identify respondents who meet the target process for each measure, such as whether the individual needed care right away. Measures are only calculated using respondents who experienced a particular service/process.
Users can also case-mix adjust the results for characteristics such as respondent age, education, general health status, and mental health status. The CAHPS Analysis Program—often referred to as the CAHPS Macro—is a free program written in SAS (version 6.0 or later) that enables survey users to case-mix adjust their data. The program also generates a distribution of survey results for each of the measures, calculates the mean score for both individual survey items and composite measures, and indicates whether an entity’s scores are statistically different from the average. The results presented in these analyses are based on unadjusted top box scores unless otherwise noted.
More information about the calculation of proportion scores and mean scores can be found in these documents:
- Instructions for Preparing Data for Analysis: https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…
- Instructions for Analyzing Data from CAHPS Survey: https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…
Users should choose a data collection protocol that maximizes the survey response rate at an acceptable cost. Some sponsors, as well as researchers conducting field tests, have found that the mail with telephone follow-up method is most effective or email with mail or telephone follow-up.
AHRQ provides protocols for collecting responses though users can adapt it to meet their needs. The protocols include mail only, telephone only, mail with phone follow-up, or email (web) with mail or phone follow-up. AHRQ provides detailed instructions for these different protocols in the “Guidelines for Using the CAHPS Clinician & Group Survey” document survey available on the AHRQ CAHPS website: https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…;
There is no minimum response rate requirement on the CG-CAHPS Survey. The CAHPS consortium has found that higher response rates are achievable if users take steps to ensure the accuracy of the sample frame and carefully follow the recommended data collection protocol, including one or more attempts to follow up with non-respondents.
In its simplest form, the response rate is the total number of completed questionnaires divided by the total number of individuals selected for the sample. Calculating the response rate is helpful in determining a more accurate starting sample size for future survey administration. For the CG-CAHPS Survey, the goal is a response rate of at least 40 percent or at least 50 completed surveys per provider.
To calculate the response rate, use the following formula: Number of completed returned questionnaires divided by the total number of respondents selected minus the sum of deceased + ineligibles.
AHRQ makes the CG-CAHPS Survey available in English and Spanish.
The sample is drawn from a list of individuals (adults aged 18 and older, or children 17 and younger) who have received care from a given provider, practice site, or medical group during a six-month time period. The list is called a sample frame.
The source of sample information will vary by survey sponsor. The data to identify individual patients may be found in the records of medical practices or health systems.
Defining the Sample Frame: Eligibility Guidelines:
- The adult questionnaires include all adults 18 years or older.
- The child questionnaire includes all children 17 years or younger.
- Include only patients who have had at least one visit to the selected practice in the last 6 months. This time frame is also known as the look back period.
- To identify the sampling frame, use the anticipated start date of data collection to determine the reference period. For example, if your anticipated start date is September 1, 2026, include all those who have had at least one visit since March 1, 2026.
- The sampling frame is a person-level list and not a visit-level list. Therefore, patients should appear only once in the sampling frame regardless of how many visits they have had in the look back period.
- Draw the sample irrespective of reason for visit and duration of patient-provider relationship, so that the full range of patients is represented.
- Include all patients who meet the sampling criteria even if they are no longer receiving care from the practice, site/clinic or provider.
- Allow the sample frame to include multiple individuals from the same household, but the sample you draw should not have more than one person (adult or child) per household. In other words, the sample that is selected for data collection should be de-duplicated to ensure that only one person per household receives a survey. The final sample must contain only one respondent per household. Where a duplicate household is sampled, it is discarded and replaced by another random draw from the frame.
- All CAHPS survey items have been designed for the general population. Appropriate screening items are included for items targeted to assess a specific experience. In order to ensure that results are comparable to those produced by other sponsors and vendors, targeted sampling, such as selecting only patients with particular conditions or experiences, is not recommended. Targeted sampling should only be used to supplement the general population sample, if desired.
- In order to administer the survey, the name of the provider must be available, even if surveying at the site/clinic or practice level. If the sampling frame does not accurately identify the provider that the patient saw, select a larger sample to account for errors in connecting health care received to a specific provider. For example, errors can occur if administrative billing data are used for the sampling frame and visits with physician assistants or nurse practitioners are billed under the supervisory physician.
Calculating the Sample Size for the Adult (Child) Questionnaire
The sample size varies depending on whether sampling is done at the level of the individual provider, practice, or medical group. In general, to produce statistically valid comparisons, the sample needs to be large enough to yield 50 completed questionnaires per provider or 300 completed questionnaires per medical group. The recommended sample size when sampling at the practice level depends on the number of providers at each site. The document Guidelines for Using the CAHPS Clinician & Group Survey has a table for recommended sample sizes based on the number of providers, and it ranges from 50 to 300 completed questionnaires. (https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…)
Data are not reported for any item or measure with fewer than 10 valid responses and practice sites with fewer than 10 responses were not included. AHRQ recommends that there needs to be approximately 50 completed questionnaires per provider to have a sufficient number of responses for results to be statistically reliable.
Proxy Respondents
The CG- CAHPS Survey Plan does allow for proxy respondents for mail and web-based mode. At the end of the survey, there is an item that asks “Did someone help you complete this survey?” If the answer is Yes, the follow-up question is “How did that person help you?” and they are to mark one or more of these response items:
- Read the questions to me
- Wrote down the answers I gave
- Answered the questions for me
- Translated the questions into my language
- Helped in some other way
However, these the last two questions of the core questionnaire are not included in telephone scripts because telephone interviews should not be conducted with proxy respondents.
Supplemental Attachment
Measure Record
Point of Contact
CAHPS® is a registered trademark of the U.S. Department of Health and Human Services and managed by AHRQ
Karen Chaves
Rockville, MD
United States
Naomi Yount
Westat
Rockville, MD
United States
Importance
Evidence
The CG-CAHPS Survey measures key components of patient experience, such as provider communication and ease of access, that are consistent with patient-centered care. The CAHPS Surveys focus on aspects of care that consumers have identified as important and for which patients are the best or only source of information. Measuring patients’ perceptions of their healthcare experience is not just a means to improve services—it’s a recognition that the patient’s voice matters in and of itself. Listening to patients affirms their role as active participants in their care, and their insights are essential to truly understanding the quality and impact of healthcare delivery. In 2023, over 238,000 patients completed the CG-CAHPS Survey as part of the PCF PECS survey. It is possible that more practices are administering and using the CG-CAHPS survey beyond the practices participating in PCF. We reviewed the literature on the determinants of patient care experiences measured by CAHPS and their associations with other indicators of health care quality. CAHPS is also an actionable measure that helps clinicians and health plans target interventions that will improve the quality and patient-centeredness of care.
Review of the Evidence
Prior research has identified several features of healthcare delivery structure, including clinic accessibility, patient flow, and management, that are associated with patient experiences. Two major systematic reviews have examined the relationships among patient experience, clinical processes, and patient outcomes. A systematic review performed by researchers in the U.K. found that patient experience is favorably associated with adherence to recommended medications and treatments, preventive care such as screenings and immunizations, patient-reported health outcomes, clinical outcomes, reduced hospitalizations and primary care visits, and reduced adverse events (Doyle et al., 2013). Anhang Price et al. (2014) reviewed evidence on the association between patient experiences and other measures of health care quality in the U.S. They similarly found that better patient care experiences are associated with higher levels of adherence to recommended prevention and treatment processes, better clinical outcomes, and less health care utilization.
Health Care Process and Quality Improvement Influence on Patient Experience
Providers routinely use patient-reported measures such as CAHPS to guide quality improvement (QI) activities to improve their patients’ experience with care (Friedberg et al., 2011; Davies, Shaller, et al., 2013; Quigley et al., 2015).
For example, to improve scores for “how often the office staff were as helpful as you thought they should be”, Dean Clinic, a large integrated health care delivery system in Wisconsin, further surveyed their patients to ask them what “helpfulness” means to them and to ask how office staff could be more helpful. From this feedback, the Clinic learned about ways that the office staff can be more welcoming, friendly, and appreciative of patients. With input from both staff and management, Dean Clinic developed action plans to improve patient experience. The service department shadowed staff and provided feedback. To improve consistency in service across all sites, the Clinic developed an orientation for all new employees on customer service expectations. They also offered ongoing training in the form of service workshops, videos, and Webinars, as well as targeted interventions for the lowest scoring offices (AHRQ, 2013). Several quality improvement initiatives to improve provider communication and engagement include shadowing, coaching, and training (AHRQ, 2013; Hardee & Kasper, 2008; Quigley, Palimaru, et al., 2017). Lastly, Friedberg et al. (2011) found that physician groups that aim to improve access, communication with patients, and customer service do so by addressing office workflow, providing additional training for nonclinical staff, and adopting or enhancing an electronic health record.
Using data from the CAHPS survey and a newly installed electronic health record system, in 2015, leaders of Northeast Valley Health Corporation (Los Angeles County) pinpointed interventions including reallocating staff resources and not scheduling well-child visits first thing in the morning. System leaders found that when the first appointments of the day ran long, there was a cascading effect on the rest of the day's schedule. By 2015, NEVHC instituted changes systemwide. By 2017, total average cycle time was reduced from 82 minutes to 65 minutes; the proportion of patients with a cycle time under 60 minutes rose from 34 percent to 48 percent; and the proportion of patients seen within 15 minutes of appointment time rose from 38 percent to 47 percent. Case study found at https://www.ahrq.gov/news/newsroom/case-studies/201718.html
More examples of interventions to improve patient experience with primary and specialty care as measured by the CG-CAHPS Survey can be found in the CAHPS Improvement Guide available at https://www.ahrq.gov/cahps/quality-improvement/index.html. The Guide also includes information on analyzing survey results and identifying root causes of performance problems.
The Centers for Medicare and Medicaid Services Merit-based Incentive Payment System (MIPS) Quality Payment Program measures Medicare Part B providers in four performance categories to derive a score that could affect a provider's Medicare reimbursement positively or negatively starting at 4% in 2019 (based on 2017 performance). MIPS has a performance category called “Improvement Activities” that includes an inventory of activities that assess how a physician group can improve care processes, enhance patient engagement in care, and increase access to care. Several of these activities are geared to improve patient experience of care as measured by CG-CAHPS. A list of MIPS activities can be found at https://qpp.cms.gov/mips/improvement-activities.
Structure
Physician clinic hours of operation and availability for appointments have been found to predict patient experience in several studies. In a study with survey data from 61,839 patients of 1729 primary care physicians in California, system-level factors, such as belonging to a larger medical group and the physician’s zip code-based Primary Care Services Areas, explained between 28% to 48% of variation in patient care experience, with the highest proportion explained for the access to care composite (Rodriguez et al., 2009). Improving the infrastructure supporting certain aspects of care may have broad effects because system changes can influence multiple outcomes (Cleary, 2016).
“Expanded practice access” is a highly weighted CMS MIPS improvement activity. To improve the patient experience in access to care, practices may consider providing 24/7 access to clinicians, groups, or care teams for advice about urgent and emergent care (e.g., eligible clinician and care team access to medical record, cross-coverage with access to medical record, or protocol-driven nurse line with access to medical record). Access expansion can include one of the following: 1) expanded hours in evenings and weekends with access to the patient medical record (e.g., coordinate with small practices to provide alternate hour office visits and urgent care); 2) use of alternatives to increase access to care team by clinicians and groups, such as e-visits, phone visits, group visits, home visits and alternate locations (e.g., senior centers and assisted living centers); and/or 3) provision of same-day or next-day access to a consistent clinician, group or care team when needed for urgent care or transition management. Another example is implementation of “open access” scheduling, in which some physician time is always reserved for same-day appointments, to improve patient access to care (Murray & Tantau, 1998).
Health-related Patient Behavior and Disease Management
One dimension of the CG-CAHPS measure captures the patients’ perceptions of how well providers communicate with them. Better patient-provider communication promotes healthcare-related patient behaviors (Fuertes, Boylan, et al., 2009). A 2009 meta-analysis of 127 studies assessing the link between patient treatment adherence and physician-patient communication found a 19% higher risk of non-adherence among patients whose physician communicated poorly (Zolnierek and Dimatteo, 2009). Doyle’s (2013) meta-analysis showed positive associations between the quality of clinician-patient communications and adherence to medical treatment in 125 of 127 studies analyzed. Studies using the CAHPS measure have found that better provider communication is positively associated with adherence to hypoglycemic medications among diabetics (Ratanawongsa, Karter, et al., 2013), adherence to tamoxifen among breast cancer patients (Liu, Malin, et al., 2013), and higher rates of colorectal cancer screening among adults in the US (Carcaise-Edinboro and Bradley, 2008). Sequist and colleagues (2008) found that measures of patient experience, including doctor-patient communication, clinical team interactions, and health promotion support, were positively associated with some prevention and disease management clinical process measures in clinical practices and among individual clinicians.
Outcomes
Out of 40 evidence papers with outcome measures, Doyle’s (2013) meta- analysis found 29 studies with positive associations between patient experience and clinical outcomes, 11 with no associations, and none with negative associations. The lack of more evidence may be due to complexity between a patient’s illness level, their level of care, and their likelihood for a poor outcome such as mortality, morbidity or a readmission. Often, such associations have more than one plausible direction of causality. For example, clinicians may be especially attentive to the needs of sicker patients (Kahn et al., 2007) and patients near the end of life (Elliott, Haviland, et al., 2013; Xu et al., 2014).
Moreover, substantial evidence points to a positive association between various components of patient experience, such as good communication between clinicians and patients, and several important processes and outcomes. These include lower utilization of unnecessary healthcare services; better patient adherence to medical advice; better process of care measures for acute myocardial infarction (AMI), congestive heart failure, pneumonia and surgery; lower inpatient mortality among acute myocardial infarction (AMI) patients; lower infection rates (Anhang Price, et al., 2014); and better clinician and staff perceptions of patient safety culture (Sorra et al., 2012).
Utilization
Research suggests an association between better patient experiences and lower healthcare utilization. Children with asthma were less likely to visit the emergency department, make urgent office visits, or be hospitalized if their physicians had reviewed a long-term therapeutic plan with their parents (Clark, Cabana, et al., 2008). Among African Americans with Type 2 diabetes, those who reported that doctors or nurses usually listened carefully or spent enough time with them were significantly less likely to visit the emergency department in the 12 months following completion of a patient experience survey (Gary, Maiese, et al., 2005). Children whose parents report longer waits for primary care visits were more likely to visit the emergency department for non-urgent reasons than those who report waiting for less time (Brousseau, Bergholte, et al., 2004).
References
Agency for Healthcare Research and Quality (AHRQ). How Two Provider Groups Are Using the CAHPS® Clinician & Group Survey for Quality Improvement. Brief available at https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/quality-improvem….
Anhang Price, R, Elliott, MN, Zaslavsky, AM, Hays, RD, Lehrman, WG, Rybowski, L, Edgman-Levitan, S, Cleary, PD. (2014). Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev. 71(5), 522-54.
Brousseau, DC., Bergholte, J., et al. (2004). The effect of prior interactions with a primary care provider on nonurgent pediatric emergency department use. Archives of Pediatrics & Adolescent Medicine. 158(1), 78-82.
Carcaise-Edinboro, P. and Bradley, CJ. (2008). Influence of patient-provider communication on colorectal cancer screening. Medical Care. 46(7), 738-745.
Clark, NM., Cabana, MD., et al. (2008). The clinician-patient partnership paradigm: Outcomes associated with physician communication behavior. Clinical Pediatrics. 47(1), 49-57.
Cleary, PD. (2016). Evolving concepts of patient-centered care and the assessment of patient care experiences; optimism and opposition. J Health Pol, Policy & Law. 41(4), 675-696.
Davies, E, Shaller, D, Edgman-Levitan, S, Safran, DG, Oftedahl, G, Sakowski, J, Cleary, PD. (2008). Evaluating the use of a modified CAHPS survey to support improvements in patient-centered care: lessons from a quality improvement collaborative. Health Expect. 11(2), 160-76.
Doyle, C., Lennox, L., et al. (2013). A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 3(1). http://bmjopen.bmj.com/content/3/1/e001570.full
Elliott, MN., Haviland, AM., et al. (2013). Care experiences of managed care Medicare enrollees near the end of life. Journal of the American Geriatrics Society 61(3), 407-412.
Friedberg, MV, SteelFisher, GK, Karp, M, and Schneider, EC. (2011). Physician groups’ use of data from patient experience surveys. J Gen Intern Med. 26(5), 498-504.
Fuertes, J N., Boylan, LS., et al. (2009). Behavioral indices in medical care outcome: The working alliance, adherence, and related factors. Journal of General Internal Medicine. 24(1), 80-85.
Gary, TL., Maiese, EM., et al. (2005). Patient satisfaction, preventive services, and emergency room use among African-Americans with type 2 diabetes. Disease Management. 8(6), 361-371.
Hardee, JT, Kasper, IK. (2008). A clinical communication strategy to enhance effectiveness and CAHPS scores: The ALERT model. Perm J. Summer. 12(3), 70-4.
Kahn, KL., Tisnado, DM., et al. (2007). Does ambulatory process of care predict health-related quality of life outcomes? Health Services Research. 42, 63-83.
Liu, Y., Malin, JL., et al. (2013). Adherence to adjuvant hormone therapy in low-income women with breast cancer: The role of provider-patient communication. Breast Cancer Research and Treatment. 137(3), 829-836.
Murray, M and Tantau, C. (1998). Must patients wait? Jt Comm J Qual Improv. 24(8), 423-5.
Quigley, DD, Mendel, PJ, Predmore, ZS, Chen, AY, Hays, RD. (2015). Use of CAHPS™ patient experience survey data as part of a patient-centered medical home quality improvement initiative. J Healthc Leadersh. 7, 41-54.
Quigley, DD., Palimuru, AI., Chen AY., & Hays, RD. (2017). Implementation of practice transformation: Patient experience according to practice leaders. Quality Management in Health Care. 26 (3), 140-151.
Ratanawongsa, N., Karter, AJ., et al. (2013). Communication and medication refill adherence: the Diabetes Study of Northern California. JAMA Internal Medicine. 173(3), 210-218.
Rodriguez, HP, Scoggins, JF, von Glahn, T, Zaslavsky, AM, Safran, DG. (2009). Attributing sources of variation in patients' experiences of ambulatory care. Med Care. 47(8), 835-41.
Sequist, TD., Schneider, EC., et al. (2008). Quality monitoring of physicians: linking patients' experiences of care to clinical quality and outcomes. Journal of General Internal Medicine. 23(11), 1784-1790.
Sorra, J, Khanna, K, Dyer, N, Mardon, R, Famolaro, T. (2012). Exploring relationships between patient safety culture and patients’ assessments of hospital care. Journal of Patient Safety. 8(3), 131–139.
Xu, X., Buta, E., Anhang Price, R., Elliott. NN., Hays, RD., & Cleary, PD. (2014). Methodological considerations when studying the association between patient-reported care experiences and mortality. Health Services Research. 50(4), 1146-61.
Zolnierek, KB. and Dimatteo, MR. (2009). Physician communication and patient adherence to treatment: a meta-analysis. Medical Care. 47(8), 826-834.
Measure Impact
The CAHPS measures, developed to complement more technical quality measures, are measures for which the patients are the best or only source of information and/or perspective, such as the degree to which care felt patient-centered (Anhang Price et al., 2014). Several studies provide evidence that patients value the CAHPS measures and find them meaningful. For example, Safran et al. (2001) found that patients who reported the poorest-quality relationships with their physicians were three times more likely to voluntarily leave the physicians’ practice than patients with the highest-quality relationships.
Collins et al. (2017) found that a patient’s “most important CAHPS domain” varied across subgroups; racial and ethnic patient subgroups differentially valued various aspects of the care experience. To efficiently reduce disparities and improve quality, Collins et al recommend tailoring quality improvement programs to the factors most important to the racial, ethnic, and language mix of the patient population of interest. Quigley et al. (2014) found that the importance of provider communication varied significantly by practice specialty type, yet respectful treatment was consistently import across all specialties.
Patients also use information from patient experience measures to make decisions about their healthcare providers and plans. One study found that seeing publicly reported quality information was a determinant of choosing higher quality-rated health plans, although the weight given to quality information also depended on other features, such as cost and provider choice (Faber et al., 2009).
References
Anhang Price, R, Elliott, MN, Zaslavsky, AM, Hays, RD, Lehrman, WG, Rybowski, L, Edgman-Levitan, S, Cleary, PD. (2014) Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev 71(5), 522-54.
Collins, RL, Haas, A, Haviland, AM, Elliott, MN. (2017). What matters most to whom: Racial, ethnic, and language differences in the health care experiences most important to patients. Med Care. Nov;55(11), 940-947.
Faber, M, Bosch, M., Wollersheim, H, Leatherman, S, and Grol, R. (2009). Public reporting in health care: how do consumers use quality-of-care information? A systematic review. Med Care 47(1), 1-8.
Quigley, DD, Elliott, MN., Burkhart, Q, Farley, DO., Skootsky, SA., & Hays, RD. (2014). Specialties differ in which aspects of doctor communication predict overall physician ratings. Journal of General Internal Medicine, 29, 447-454.
Safran, DG, Montgomery, JE, Chang, H, Murphy, J, Rogers, WH. (2001). Switching doctors: predictors of voluntary disenrollment from a primary physician’s practice. J Fam Practice. 50(2), 130–6.
Care Gaps
Feasibility
Feasibility
The CG-CAHPS Survey is a standardized instrument designed to assess patient experience of care. As these patient-experience data are collected from patients, the structured data are not available in electronic sources outside of the data collection by the practice site or medical group.
The data are collected through a survey instrument that is administered directly to patients, not during care delivery. Surveys are generally mailed to the sampled patients, and those survey results can be entered into structured databases (e.g., Excel, SPSS, SAS). No proprietary platform is required to administer the survey. Though mixed-mode administration (i.e., mail and phone) is a viable strategy for the collection of CAHPS surveys, mail continues to be the most frequent mode for most CAHPS surveys. Users then create electronic databases of results after receipt of the completed hard copy survey through scanning or data entry. However, vendors may set up their database before data collection by populating the frame to assist in identifying nonresponse.
Traditionally, the rationale for not using electronic sources more broadly is that mail and telephone are the best ways to obtain representative samples of patients based on the contact information that is available for sampling and data collection. E-mail has been added as a mixed mode strategy for physician groups with reliable email addresses for their patient population.
Structured or unstructured fields. All items are structured and on a 4 -item Likert-type response option scale (1-4) or for the rating items on a 0-10 scale. All responses are numeric.
Electronic feasibility. CG-CAHPS Survey users can offer a web survey to respondents to complete the survey though that option should not be the only option as it may exclude patients who have limited or no access to the web and/or who do not have an email address to send an electronic version of the survey.
Missing data. Item level missing data is low on the CG-CAHPS Survey however, some items will have fewer response than others due to gate or filter questions. For example, if a respondent did not need urgent care in the last 6 months, they are skipped through items about their experiences with getting urgent care. As a result, some CG-CAHPS Survey items have higher percentages of missing data overall, but when skip patterns are considered, the percentages of inappropriate missing data are much lower (<5%).
Measure susceptibility to inaccuracies and ability to audit data: The CG-CAHPS Survey is self-reported perceptions or experiences with the care received and therefore cannot be assessed to determine if the results are accurate. The protocol for administering CG-CAHPS Survey is outlined by AHRQ and vendors normally collect the data in a standardized format. The data that has been collected can be audited to ensure no data entry errors have occurred, there are no out of range values, and skip patterns are followed.
Change to the Instrument. Since the instrument was last endorsed, there was only one change to the survey and that was to add text to the instrument to allow for respondents to include care that was done virtually (i.e., phone or by video) to account for changes in care delivery due to the COVID-19 pandemic. For example, instructions now included “by phone, or by video”: “The questions in this survey will refer to the provider named in Question 1 as “this provider.” As you answer these questions, please think of the in-person, phone, and video visits you had with that person in the last 6 months.” This change did not impact data structure or availability.
Data Collection Burden
For respondents: The survey takes approximately 15 minutes to complete, dependent on the individual.
For medical groups and practice sites: Survey sampling uses administrative enrollment data that is maintained by all medical groups/practice sites and easily accessible to produce a sampling frame. Practice sites/medical groups generally hire a survey vendor to administer, track, and analyze their survey data resulting in lower burden for the practice sites/medical groups.
Cost Considerations
The CG-CAHPS Survey is freely available for use with no proprietary fees.
The cost to hire a vendor varies based on the size of the medical group and desired number of completed surveys. AHRQ provides guidance for hiring a vendor and resources for finding a certified vendor (https://www.ahrq.gov/cahps/surveys-guidance/helpful-resources/hiring/in…).
Impact on Clinician Workflow
The CG-CAHPS Survey does not interfere with diagnostic thought processes or patient -physician interactions as the survey is retrospective after care has been given, not during the visit.
Potential Barriers and Mitigation Strategies
Achieving a desired response rate may be difficult for users. Phone is not optimal as the only mode of survey administration, but it is commonly used as a follow-up for CAHPS mail surveys. Phone follow-up can improve CAHPS response rates compared to mail-only (Burkhart et al., 2014; Fowler et al., 2002; Gallagher et al., 2005; Klein et al., 2011). A study of Medicare beneficiaries found that response rates continue to improve when up to 4 follow-up calls are made (Burkhart et al., 2014). In addition, phone follow-up calls help to achieve better representation of patients in terms of income, literacy/education, health status, age, gender, and race/ethnicity, above and beyond mail surveys alone (Tesler and Sorra, 2017). The CAHPS Consortium continues to conduct research to develop and test survey administration methods that can improve the efficiency of data collection, enhance response rates, and gather more information about the experiences of those segments of the patient population that are hard to reach through more traditional means. This research includes: 1) studies comparing the effect of administration modes on response rates, survey scores, and data collection costs (e.g., mode comparisons have included in-office distribution vs. mail; email vs. mail); 2) studies assessing the effect of survey length on response rates and survey scores; 3) studies examining the impact of incentives on response rates; and 4) studies comparing the effect of different survey formats and design on survey responses. AHRQ also provided a webinar on how to achieve higher response rates (https://www.ahrq.gov/cahps/news-and-events/events/webinar-011124.html).
Analysis and Reporting: AHRQ makes available many resources to assist with analysis and reporting. For instance, there is a free CAHPS Analysis Program which is written for SAS that enables survey users to conduct the analyses needed to produce valid comparisons of performance across similar health care organizations. Users can also review documentation on how to prepare data for analysis (https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…). Further, vendors usually conduct all analyses and reports.
References
Burkhart, Q, Haviland, A, Kallaur, P, et al. (2014). How much do additional mailings and telephone calls contribute to response rates in a survey of Medicare beneficiaries. Field Methods. 27(4):409-25.
Fowler, FJ, Gallagher, PM, Stringfellow, VL, et al. (2002). Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Med Care 40(3):190-200.
Gallagher, PM, Fowler, FJ, Stringfellow, VL. (2005). The nature of nonresponse in a Medicaid survey: causes and consequences. J Off Stat 21(1):73-87.
Klein, DJ, Elliott, MN, Haviland, AM, et al. (2011). Understanding nonresponse to the 2007 Medicare CAHPS survey. Gerontologist. 51(6):843-55.
Tesler, R. and Sorra, J. CAHPS Survey Administration: What We Know and Potential Research Questions. (Prepared by Westat, Rockville, MD, under Contract No. HHSA 290201300003C). Rockville, MD: Agency for Healthcare Research and Quality: October 2017. AHRQ Publication No. 18-0002-EF. Accessible at https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/about-cahps/rese….
Most vendors have established methods for tracking the sample. The Consortium suggests setting up a system to track the returned surveys by the unique ID number that is assigned to each respondent in the sample. This ID number should be placed on every questionnaire that is mailed and/or on the call record of each telephone case.
To maintain respondent confidentiality, the tracking system should not contain any of the survey responses. The survey responses should be entered in a separate data file linked to the sample file by the unique ID number. (This system will generate the weekly progress reports that should be review closely.) Data should be stored securely—preferably on encrypted or password-protected systems—with access limited. If paper responses are used, they should be shredded following de-identified data entry.
The CG-CAHPS Survey data is therefore de-identified upon data collection with a focus on protecting the confidentiality of respondents. Vendors are trained on maintaining confidentiality.
The CG-CAHPS Survey has a long history of use dating back to 2007. The CG-CAHPS Survey has gone through two main revisions since that time, using field and psychometric testing conducted by multiple partners and other stakeholders to increase the scientific rigor and relevance of the survey and the usability of the data (for more development information refer to https://www.ahrq.gov/cahps/surveys-guidance/cg/about/Develop-CG-Surveys…)
Steps which have contributed to the content and design of the CG-CAHPS Survey over time have included:
- Literature review and review of existing measures
- Development and consultation with technical expert panels
- Focus groups with consumers
- Cognitive testing of survey questions to ensure they will be understood by respondents
- Field testing to assess the reliability of the survey results
- Cognitive testing of measure labels to ensure that survey results are communicated clearly to providers and the public
- Public comment
- On-going collaboration and harmonization with key partners and stakeholders
The CAHPS Consortium continues to conduct research to develop and test survey administration methods that can improve the efficiency of data collection, enhance response rates, and gather more information about the experiences of those segments of the patient population that have been hard to reach through more traditional means. This research includes: 1) studies comparing the effect of administration modes on response rates, survey scores, and data collection costs (e.g., mode comparisons have included in-office distribution vs. mail; email vs. mail); 2) studies assessing the effect of survey length on response rates and survey scores; 3) studies examining the impact of incentives on response rates; and 4) studies comparing the effect of different survey formats and design on survey responses.
To address data collection efficiency and to improve response rates, the CAHPS Consortium endorsed e-mail notification for web-based surveys as an additional mode of data collection. The CAHPS Consortium recommends a mixed mode that would have two e-mail reminders and a follow-up by mail or telephone to all who are in the survey sample. The follow-up to the entire sample is necessary to get a representative set of responses from a practice’s population, as not all patients may have e-mail.
Proprietary Information
Scientific Acceptability
Testing Data
The data used for these analyses are from the CMMI Primary Care First (PCF) Patient Experience of Care (PEC) Survey) which includes a combination of items from the Adult CG-CAHPS Survey as well as from the Patient-Centered Medical Home CAHPS Supplement. The survey is available on the CMMI PCF website: https://pcfpecs.org/Survey-and-Protocols.
For evidence of performance gap demonstrating persistent gaps over time, we also include top box statistics on the 2022 Adult CG-CAHPS Survey data administered as part of the PCF PEC survey.
The data used to support extrapolation of Adult data to Child data, is based the 2019 maintenance endorsement submission, when both Adult and Child data were available. Using data from surveys administered from January 2016- March 2017, the Child survey included 77 practice sites and over 12,000 responses and the Adult survey included 635 practice sites and over 110,000 respondents. To support extrapolating adult data in the absence of child data, we compared characteristics between respondents from the prior child and adult CG-CAHPS Surveys.
Data were included in the analysis if they had at least one reportable item from the CG-CAHPS survey.
Unless noted otherwise, the top box scores presented are unadjusted since the results are not being used to compare entities, but rather for descriptive and scientific acceptability purposes.
The 2023 survey data was collected between October 3, 2023, through December 19, 2023.
The 2022 survey data was collected between October 6, 2022, through December 19, 2022.
None.
The CG-CAHPS Survey is specified for both individual clinician and group/practice. However, we only have testing for the group or “practice site” because the clinician-level identification in the CG-CAHPS database is not available. The site-level measured entity is referred to as a “practice site.” The practice site is an outpatient facility in a specific location. Practice site level survey results are calculated across the respondents within a specific site.
The data included 2,490 practice sites. For testing and performance scores, practice sites with less than 10 surveys were excluded. After the restriction, the number of sites is 2,486.
The 2022 data used exclusively in the performance gap section to demonstrate persistent gaps over time included 2,806 practice sites. For testing and performance scores, practice sites with less than 10 surveys were excluded. After the restriction, the number of sites is 2,801.
Practices in the 2023 data come from 23 states and the District of Columbia, as shown in 5.1.3a available in the Supplemental 7.1 zip file.
Due to the lack of access to Child CG-CAHPS data, we present the data for Adult CG-CAHPS Survey measures which can be extrapolated to provide evidence for the Child CG-CAHPS Survey measures. The Adult CG-CAHPS Survey and Child CG-CAHPS Survey are equivalent with only minor wording changes (refer to the crosswalk between Adult and Child measures included with the instruments in Attachment 1.21). The wording changes directed attention to the experiences for the child rather than the respondent.
For example, on the Adult Survey one question is worded:
- “In the last 6 months, when you contacted this provider’s office to get an appointment for care you needed right away, how often did you get an appointment as soon as you needed?
On the Child Survey, the question is worded (bolded added to differentiate):
- “In the last 6 months, when you contacted this provider’s office to get an appointment for care your child needed right away, how often did you get an appointment as soon as your child needed?”
Both the Adult and Child survey capture the experience of care from an adult perspective — either directly from the patient (Adult CG-CAHPS) or the parent/guardian (Child CG-CAHPS). Both surveys have adult respondents; the child survey is completed by the child’s parent, relative, or legal guardian.
The data includes 238,204 adult respondents. For testing and performance scores, practice sites with less than 10 surveys were excluded. After the restriction (N=4 sites), the total number of respondents was 238,181, the average number of respondents per site was 96, ranging from 14 to 272 respondents per site.
Tables 5.1.4a through g, available in the Supplemental 7.1 zip file, show descriptive characteristics of the respondents (sex, race/ethnicity, age, self-reported health status, survey mode, and survey language). Practice sites had adult respondents that were predominantly white and non-Hispanic (79%) and older than 54 (83%). Over 40% of respondents had at least a 4-year college degree (41%). Most responded via mail (89%) compared to by phone (11%). Most respondents completed the survey in English (99%), and only 1% completed it in Spanish.
Both the Adult and Child survey capture the experience of care from an adult perspective — either directly from the patient (Adult CG-CAHPS) or the parent/guardian (Child CG-CAHPS).
Both surveys have adult respondents; the child survey is completed by the child’s parent, relative, or legal guardian.
In the prior maintenance endorsement in 2019, using data from surveys administered from January 2016- March 2017, we had access to data from 77 practice sites and over 12,000 responses for the Child survey and 635 practice sites and over 110,000 respondents for the Adult survey. To support extrapolating adult data in the absence of child data, we compared characteristics between respondents from the prior child and adult CG-CAHPS Surveys.
Respondent education distributions were similar across child and adult CAHPS surveys. For example, in the 2016-2017 CG-CAHPS data, 65% of respondents to the Adult Survey had at least some college and 76% of respondents to the child survey had at least some college. Additionally, 21% of respondents to the Adult survey and 25% of respondents to the Child survey had more than a 4-year college degree. The Adult survey respondents had a slightly higher percentage of respondents with lower levels of education (27% high school graduate or GED or less versus 16% for the Child survey). Overall, these results support the appropriateness of extrapolating adult data in the absence of child data.
Respondents to both the Adult and Child 2016-2017 CG-CAHPS Surveys tended to be female (over 50% for both), with more females responding to the Child Survey (82%) than the Adult Survey (53%).
Patient general and mental health status distributions differ between the child and adult CG-CAHPS surveys when examining the 2016-2017 CG-CAHPS child survey data. For the child survey, 78% of respondents reported the general health status of the child to be very good or excellent while only 43% of respondents to the adult survey reported their general health status as very good or excellent. Similarly, 77% of respondents reported the mental health status of the child to be very good or excellent compared with 62% of respondents to the adult CG-CAHPS survey reported their mental health status as very good or excellent.
More respondents of Child CG-CAHPS Survey were aged 25-44 than respondents of the Adult surveys (61% versus 14%).
Keeping these differences in mind, we extrapolate adult data in the absence of child data. Further, as shown in the other sections, the scientific acceptability results (reliability and validity) between Adult and Child tended to align in the past maintenance endorsement package, further justifying extrapolation. Additionally, both surveys have the same usability and goal of assessing and improving the quality of care by gathering patient or parent/legal guardian feedback on key aspects of patient experience.
Reliability
We estimated internal consistency reliability using the Cronbach’s coefficient alpha for each composite measure. A reliability of at least 0.70 is considered acceptable for group-level comparisons (Nunnally and Bernstein, 1994). For composites with more than two items, we show the impact on Cronbach’s alpha of deleting one of the items from the composite. However, CAHPS scores are designed to evaluate care across units of care such as plans, physician groups, and hospitals, not individual patients.
For the Access, Provider Communication, and Office Staff composite measures, all items had less than 3% of records with missing values. For the Care Coordination composite measure, all items had less than 4% of records with missing values. We ran the Cronbach’s alpha excluding all missing data as well as with listwise deletion and the results were the same, except for the Access composite measure in which excluding all missing data increased Cronbach’s alpha by .01. Given the similarity of results, we have presented the Cronbach’s alpha values with the inclusion of cases with missing values (listwise deletion) in section 5.2.3.
Reference
Nunnally JC, Bernstein IH. (1994). Psychometric Theory. New York: McGraw Hill.
Table 5.2.3a (attached in 5.2.3a) shows the Cronbach’s alpha for each composite measure in the Adult CG-CAHPS Survey. For items within composite measures consisting of 3 or more items, the Cronbach’s alpha if the item were deleted is provided to determine if there was room for improving coefficient alpha by dropping an item. The table also shows the standardized correlation for the standardized item to total correlations.
All Cronbach’s alphas in the adult survey were above 0.70 except for the Care Coordination composite measure with a Cronbach’s alpha of 0.61. As shown in Table 5.2.3a, removal of any questions in this composite measure would not result in a higher Cronbach's alpha and Care Coordination is an important concept to patients in their experience of care. Further, all the item to total correlations were above 0.40. While Cronbach’s alpha fell below the conventional threshold for several composite measures, it is not the most critical metric in this context. More important is the reliability at the unit level (e.g., plan-level reliability), which better reflects the measure’s utility for quality improvement. Nonetheless, internal consistency remains a relevant consideration in health care, and the Consortium will keep this in mind when implementing future revisions of the instrument.
Validity
Several model fit indices were examined to determine how well the hypothesized factor structure, or composite measures fit the data, including chi-square divided by its degrees of freedom (𝝌𝟐/𝒅𝒇 ) (criteria: values less than 5.0; Schumacker & Lomax, 2004), comparative fit index (CFI) (criteria: values 0.95 or greater; Hu & Bentler, 1999), root mean square error of approximation (RMSEA) (criteria: values less than 0.06; Kline, 2005), and the standardized root mean square residual (SRMR) (criteria: values less than 0.08; Kenny, 2020).
We examined standardized factor loadings for each item on its respective composite measure. Factor loadings above 0.40 indicate that the item’s relationship to the composite measure is acceptable (Stevens, 2002).
References
Hu, L., & Bentler, PM. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. http://dx.doi.org/10.1080/10705519909540118
Kenny, DA. (2020, June 5). Measuring model fit. Available at http://davidakenny.net/cm/fit.htm. Accessed October 2025.
Kline, RB. (2005). Principles and practice of structural equation modeling (2nd ed.) New York: The Guilford Press.
Schumacker R., & Lomax, R. (2004). A beginner’s guide to structural equation modeling
(2nd ed.). Lawrence Erlbaum.
Stevens, JP. (2002). Applied multivariate statistics for the social sciences (4th ed.). Mahwah, NJ: Lawrence Erlbaum
Tables 5.3.4a and 5.3.4b (attached in section 5.3.4a) show results for the model fit indices and standardized factor loadings for the adult dataset.
The Confirmatory Factor Analysis results for the Adult CG-CAHPS survey demonstrate strong model fit based on established criteria. The chi-square divided by degrees of freedom (χ²/df) was 127.28, exceeding the recommended threshold of less than 5.0, which is common in large samples due to the sensitivity of this index. However, the other fit indices all fall well within acceptable ranges: the Comparative Fit Index (CFI) was 0.98, surpassing the criterion of 0.95 or greater, indicating excellent model fit. The Root Mean Square Error of Approximation (RMSEA) was 0.05, meeting the standard of less than 0.06, and the Standardized Root Mean Square Residual (SRMR) was 0.04, comfortably below the threshold of 0.08.
The estimates for each standardized factor loading on the items in the composite measures assess convergent validity. All standardized factor loadings are at least 0.5, with the majority above 0.8, and all are statistically significant (p < 0.001), demonstrating the convergent validity of the measures.
These results support the hypothesized factor structure for the measures in the survey.
Use & Usability
Use
Provides patient experience, clinical quality and total cost of care ratings for medical groups in 44 CA counties. The patient experience ratings come from the Patient Assessment Survey (PAS) based on CG-CAHPS for adult and child practices. The program is reportedly being sunset in 2025 (https://www.pbgh.org/program/patient-assessment-survey/).
A total of 204 medical groups are included in the 44 California counties. Only 14 counties in the state do not have any medical groups reported. Number of patients: Information not available.
Medical group practice level of analyses, outpatient primary care practices
Through MIPS, clinicians can earn performance-based payment adjustments for services they provide to Medicare patients. The CG-CAHPS for MIPS survey is an optional quality measure that groups participating in MIPS can administer to their adult population.
MIPS is a national program that includes most physicians and group practices in the U.S who provide services to Medicare patients. The CAHPS sample frame includes all patients from a practice-supplied roster from groups participating in MIPS. Number of patients: Information not available.
Group practice level
Medicare Shared Savings Program ACOs collaborate to give coordinated high-quality care to people with Medicare. They are required to report the CAHPS for MIPS Survey, which is a version of the Adult CG-CAHPS Survey.
Over 470 ACOs are participating in the Shared Savings Program for Performance Year 2025. ACOs are located in almost all states and the District of Columbia. Number of patients: Information not available.
Medicare Shared Savings Program Accountable Care Organizations (ACOs)
NCQA recognizes clinicians and practices in key areas of performance. The recognition program includes optional reporting for practices that use the Adult CG-CAHPS survey with PCMH items.
The NCQA PCMH Recognition program is the most widely adopted PCMH evaluation program in the country. More than 13,000 practices (with more than 67,000 clinicians) are Recognized by NCQA. Number of patients: Information not available.
Group practice level
Primary Care First was a voluntary alternative payment model (through December 2025) that rewarded value and quality by offering an innovative payment structure to support the delivery of advanced primary care and administered a version of the Adult CG-CAHPS survey.
26 US regions and approximately 1,700 participant practices. Number of patients: Information not available.
Group practice level
UCLA Health, a large health system in southern California, administers the CAHPS Clinician & Group Survey on an ongoing basis to adult patients and the parents or guardians of pediatric patients (12 and younger) (Adult and Child). The organization has developed a set of data displays to manage and convey the tremendous amount of information they collect for quality improvement purposes.
Southern California as part of the University of California system. They collect data from over 1300 reporting physicians, 279 reporting offices, and 28 reporting clinical departments. Number of patients: Information not available.
Physician and office/clinic level
Usability
Actions to Improve Patient Experience
CAHPS® surveys play an important role as a quality improvement (QI) tool for healthcare organizations that use the standardized data to:
- Identify relative strengths and weaknesses in their performance.
- Determine where they need to improve.
- Track their progress over time.
AHRQ has made available a CAHPS Ambulatory Care Improvement Guide which is a comprehensive resource for health plans, medical groups, and other providers seeking to improve their performance in the domains of patient experience measured by CAHPS surveys. AHRQ also has created a short video to help improve patient experience https://www.ahrq.gov/cahps/quality-improvement/index.html#:~:text=CAHPS….
The steps are:
- Compare CAHPS survey scores to other health care organizations to determine how the plan is doing in comparison to others.
- Examine how CAHPS scores are changing over time.
- Identify priorities based on these comparisons
- Confirm these priorities based on other sources of information (e.g., patient complaints, patient comments)
- Find out what is actually happening with patients and why.
- Brainstorm with staff to determine the best strategies for improvement.
In addition, AHRQ held a research meeting in 2020 to discuss how to improve patient experience and provided summaries of the presentations: https://www.ahrq.gov/cahps/news-and-events/events/2020-meeting-summary…
Difficulty in Increasing Response Rates
Users are also provided advice for improving response rates:
- Improve initial contact rates by making sure that addresses and phone numbers are current and accurate (e.g., identify sources of up-to-date sample information, run a sample file through a national change-of-address database, send a sample to a phone number look-up vendor).
- Use all available tracking methods (e.g., Lexis-Nexis, Internet database services and directories).
- Improve contact rates after data collection has begun (e.g., increase maximum number of calls, ensure that calls take place at different day and evening times over a period of days, mail second reminders, use experienced and well-trained interviewers).
- Consider using a mixed-mode protocol. In field tests, the combined approach was more likely to achieve a desired response rate than did one mode alone.
- Train interviewers on how to deal with gatekeepers.
- Train interviewers on refusal aversion/conversion techniques.
Throughout the development process, the CAHPS Consortium has incorporated the data or input from these various sources in an incremental process of revision and refinement to develop measurement that is more precise and to produce survey data that would better meet the information needs of consumers and other stakeholders. Between versions 1.0 and 2.0 of Child CG-CAHPS, pediatric experts felt that the Child version of the CG-CAHPS Survey would benefit from a more comprehensive measurement of development and prevention. The CAHPS Consortium worked with the American Academy of Pediatrics and other key stakeholders to develop 11 new items that address development and prevention. These items were grouped into new two composite measures for the Child Survey version 2.0 (Gallagher et al., 2009).
The CG-CAHPS Survey was initially developed with the standard CAHPS 4-point response scale. The field test data that was used for the initial endorsement consisted of several testing sites in the US. One of the larger field tests was conducted in Massachusetts as part of the Massachusetts Health Quality Partners (MHQP) statewide surveying initiative. At that time, MHQP used a 6-point response scale instead of the standard CAHPS 4-point scale. Based on that evidence, the CG-CAHPS Survey was endorsed with a 6-point response scale. Affirmed by significant user feedback, additional testing was conducted to add to the other field test data to confirm the properties and function of the standard CAHPS 4-point response scale and the CG-CAHPS Survey was updated to the 4-point response scale so that results could be aligned across other CAHPS surveys (e.g., CAHPS Health Plan Survey, CAHPS Hospital Survey (HCAHPS)). Drake et al. (2014) examined how different response scales affect responses to the CG-CAHPS survey among 6,500 patients. They found that compared to the 4-category response options surveys, respondents to the 6-category response options surveys had 41 percent more missing items. There were no significant differences between the 4-category and 6-category response option surveys’ average composite measure score or provider-level reliability.
For the 3.0 version, the survey switched from a 12-month recall period to a 6-month recall period to improve accuracy of recall and focus on more recent visits.
The CAHPS Consortium hears user feedback during research studies and development. Users can contact the CAHPS Database team with questions or comments by phone at 888-808-7108 or email at [email protected]. The CAHPS consortium also solicits feedback via focus groups with patients in developing survey content and design. When changes are proposed to the survey, the changes also often go through a public comment period and those comments are summarized and posted on the AHRQ site (e.g., https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/surveys-guidance…)
References
Drake, KM, Hargraves, JL, Lloyd, S, Gallagher, PM, Cleary, PD. (2014). The effect of response scale, administration mode, and format on responses to the CAHPS Clinician and Group Survey. Health Serv Res. 49(4), 1387-99.
Gallagher, P, Ding, L, Ham, HP, Schor, EL, Hays, RD, Cleary, PD. (2009). Development of a new patient-based measure of pediatric ambulatory care. Pediatrics. 124(5), 1348-54.
In late 2009, version 2.0 addressed the fact that many people receive care in the ambulatory setting from non-physician providers such as nurse practitioners and physicians´ assistants. This change to “this provider” was in response to requests from the medical community for a survey instrument that would allow patients to report on their experiences with all their health care practitioners.
The items designed to identify chronic conditions were moved from the core survey version 2.0 to a supplemental item set.
After extensive testing and receiving feedback from users, with the release of CG-CAHPS Version 2.0, the CAHPS consortium endorsed e-mail notification for web-based surveys as an additional mode of data collection. The CAHPS consortium recommends a mixed mode that would have two e-mail reminders and a follow-up by mail or telephone to all who are surveyed.
Based on the stakeholder and user feedback obtained through public comment, technical expert review, and further testing, the following key changes were made in the release of the CG-CAHPS 3.0 version:
- One instrument, in contrast to the three instruments available for the 2.0 version.
- Use of a 6-month reference time period rather than a 12-month reference period.
- New and modified composite measures:
- New composite measure for "Care Coordination."
- Modified the composite measure for "Access."
- Modified the composite measure for "Communication."
- A modified Patient-Centered Medical Home Item Set.
- Shift of development and prevention items from the core Child Survey to the Patient-Centered Medical Home Item Set.
- Overall reduced length.
For the 3.1 version, with the COVID-19 pandemic changing how some health care was delivered (e.g., video or phone rather than in-person), the instrument was updated again to change instructions and gate question wording to include these types of visits.
No unexpected findings.
Public Comments