- Open Access
Public assessment of key performance indicators of healthcare in a Canadian province: the effect of age and chronic health problems
SpringerPlus volume 3, Article number: 28 (2014)
This study explores the effect of age and chronic conditions on public perceptions of the health system, as measured by the Key Performance Indicators (KPIs) of healthcare, in the province of Alberta in Canada. Drawing from data collected by Government of Alberta’s Department of Health and Wellness, this research examines two key questions: (1) Do people in the 65+ age group rate the KPIs of healthcare (i.e., availability, accessibility, quality, outcome, and satisfaction) more favorably compared to people in younger age groups in Alberta? (2) Does the rating of KPIs of healthcare in Alberta vary with different chronic conditions (i.e., no chronic problem, chronic illnesses without pain, and chronic pain)? The findings indicate that people in the older age group tend to rate the KPIs of healthcare more favorably compared to younger age groups in Alberta, net of socio-demographic factors, self-reported health status, and knowledge and utilization of health services. However, people experiencing chronic pain are less likely to rate the KPIs of healthcare favorably compared to people with no chronic health problem in Alberta. Discussion includes implications of the findings for the healthcare system in the province.
Performance indicators of healthcare are important measures of public confidence in and satisfaction with the healthcare system. Furthermore, patients can provide valuable information about key aspects of healthcare (Draper et al., 2001). Pelone et al. (2008) suggested that performance indicators of healthcare should include assessments of effectiveness, technical efficiency, accessibility, equity of access, timeliness, and safety. Performance indicators foster the use of patients’ views for identifying problems and difficulties encountered in health services and gaps in the quality of care, and thus allow health authorities to formulate better strategies and management procedures for the healthcare system (Mpinga and Chastonay, 2011). Therefore, at present, there is a growing research interest in patients’ perceptions of their care (Infante et al., 2004).
Previous research on public perceptions of healthcare includes the effects of general health status, chronic conditions (e.g., arthritis, chronic back and neck pain), mental health conditions (e.g., depression), and socio-demographic factors on various performance indicators (e.g., availability, accessibility, utilization, quality, and satisfaction). These studies on patient assessment of their care often report inconsistent findings.
Patients’ age and assessment of healthcare
Existing research suggests that older patients, on average, are more likely to be satisfied with healthcare services that they have received compared to younger patients, and this is consistent across cultures and nations (Bleich et al., 2009; Campbell et al., 2001; Cohen, 1996; Crow et al., 2002; Hall and Dornan, 1990; Lyratzopoulos et al., 2012; Moret et al., 2007; Quintana et al., 2006; Rahmqvist, 2001; Rahmqvist and Bara, 2010; Sixma et al., 1998; Sofaer and Firminger, 2005; Tucker and Kelley, 2000; Young et al., 2000). Studies have suggested that older patients are more satisfied because they may be more unwilling to criticize the service they receive and may be more tolerant compared to younger patients (Agoritsas et al., 2009; Hall and Dornan, 1990). Jayasinghe et al. (2008) suggested that patients who are younger may have higher expectations of the service, and when those expectations are not met, they may tend to assess the service negatively. However, a few studies found either a negative association or no significant relationship between age and patient satisfaction (Boudreaux et al., 2000; Jaipaul and Rosenthal, 2003; Kane et al., 1997; Moret et al., 2007).
Other socio-demographic characteristics such as patients’ sex, education, income, ethnicity, marital status, family size, living condition (i.e., living alone or living with others) etc. failed to show a consistent trend in predicting patient satisfaction because findings were often contradictory (Crow et al., 2002; Glynn et al., 2004; Hall and Dornan, 1990; Quintana et al., 2006; Rahmqvist and Bara, 2010; Sofaer and Firminger, 2005; Upmark et al., 2007; Zhang et al., 2007).
Previous research indicated that positive experience related to access to healthcare increased with age, with older patients being more satisfied with access to care compared to younger ones (Jayasinghe et al., 2008; Kontopantelis et al., 2010; Wilson and Rosenberg, 2004). In addition, older age was related to greater utilization of medical services (Field and Briggs, 2001; Pappa and Niakas, 2006). Some studies have suggested that some older patients may not accurately recall their difficulty in accessing healthcare services in the past 12 months due to cognitive impairment (Kasman and Badley, 2004; Raina et al., 2002).
Chronic health conditions and assessment of healthcare
People experiencing chronic health conditions such as chronic pain spend more days in hospital or other care facilities, and are more in need of medical care than those who do not have chronic conditions (Millar, 1996). Chronic health problems affect most aspects of one’s life ranging from work to social relationships (Millar, 1996). Studies have showed consistently that factors associated with increased prevalence of chronic pain include female sex, increasing age, being divorced or separated, higher body mass index, poor self-reported health, and indicators of lower socioeconomic status, such as less education, low income, being unemployed, and residence in public housing (Boulanger et al., 2007; Johannes et al., 2010; Millar, 1996; Moulin et al., 2002; Ramage-Morin and Gilmour, 2010; Reitsma et al., 2011; Schopflocher et al., 2011; Tripp et al., 2006).
Researchers have suggested that people with chronic pain are regular users of a variety of healthcare services and are more likely to assess their self-reported health negatively than individuals without chronic pain (Ramage-Morin and Gilmour, 2010; Tripp et al., 2006). Chronic pain is associated with sleep deficiency, activity and mobility limitations, cognitive impairment, other chronic diseases, anxiety, social withdrawal, loneliness, depression, negative affects (e.g., a tendency to view the world as threatening), loss of self-confidence and self-esteem, and poor physical and mental health (Millar, 1996; Ohayon and Schatzberg, 2010; Ramage-Morin, 2008; Toblin et al., 2011; Tsang et al., 2008). Constraint on leading a normal life was identified as the main problem of chronic pain (Smith et al., 1999). People with one or more chronic conditions were more likely than those without a chronic condition to report not receiving healthcare when required (Kontopantelis et al., 2010; Wilson and Rosenberg, 2004). Furthermore, patients with multiple chronic illnesses reported a higher level of hassles in accessing health care system compared to patients with a single chronic illness (Parchman et al., 2005). A study conducted by Bentur et al. (2004) found that chronic illness was associated with longer wait times for an appointment with a specialist.
Self-reported health status in general influences public assessment of healthcare. Studies have shown that satisfaction scores are higher in those patients who had better self-reported overall health (Cohen, 1996; Crow et al., 2002; Hall et al., 1990; Jaipaul and Rosenthal, 2003; Rahmqvist and Bara, 2010; Sofaer and Firminger, 2005; Wendt et al., 2009; Xiao and Barber, 2008). Previous studies generally suggest that patients who are in poor health tend to be less satisfied with the care that they receive (Al-Mandhari et al., 2004; Bleich et al., 2009; Crow et al., 2002; Glynn et al., 2004; Hall et al., 1999; Lyratzopoulos et al., 2012; Schoenfelder et al., 2011; Tucker, 2002; Wensing et al., 1997; Zhang et al., 2007). In a longitudinal sample of patients aged 70 and above, Hall et al. (1993) tested the causal pathways between satisfaction and health status, and found that self-perceived good health was related to more satisfaction a year later, but not vice versa. Similarly, in a longitudinal study, Ren et al. (2001) found that patients with better health status — particularly better mental health status — were more satisfied with their hospital care. It has also been suggested that poor health in general may directly produce dissatisfaction in patients (Hall et al., 1998). However, a few studies found that health status was not significantly related to satisfaction (Bertakis et al., 1991; Soh, 1991). Finally, research suggests that since healthier patients are inclined to report greater satisfaction with health care, it is health status per se, rather than degree of improvement in health status because of medical care, that affects patients’ satisfaction scores (Rapkin et al., 2008).
With regard to access to care, studies found that self-reported good health (vs. poor health) was associated with better access to healthcare services (Glynn et al., 2004; Jayasinghe et al., 2008; Põlluste et al., 2012; de Boer et al., 2010). Jayasinghe et al. (2008) suggested that patients with better health may need fewer visits for hospital care, and hence have less chance of experiencing difficulty in access to care.
Objectives of the current study
The aforementioned review of literature suggests that although a plethora of research has investigated patients’ perception about a particular indicator of healthcare (e.g., satisfaction), past studies rarely examine the combined impact of multiple indicators of healthcare in a general population. Most of these studies focus on patients in different situations (inpatient facility, outpatient, emergency care, suffering from diverse disease conditions, etc.) and across different socio-demographic characteristics. In addition, only a handful of studies examined the specific expectations of individuals with chronic conditions (Infante et al., 2004), particularly chronic pain. Furthermore, this line of research is lacking in the context of Alberta. In order to address these research gaps, the current study examines two questions: (1) Do people in the older age group score the KPIs of healthcare (i.e., availability, accessibility, quality, and satisfaction) higher on average compared to people in younger age groups in Alberta? and (2) Does the rating of KPIs of healthcare in Alberta vary with different chronic conditions (i.e., no chronic problem, chronic illnesses without pain, and chronic pain)?
Data and sample
The dataset used in this analysis comes from the 2004 Public Survey about Health and the Health System in Alberta. This annual survey was launched in 1996 by the Department of Health and Wellness of the Government of Alberta and continued in similar format until 2004 (Northcott and Northcott, 2004). A cross-sectional, representative sample of 4,000 adults (age 18 and above) from the nine health regions of Alberta participated in the 2004 survey. The survey was conducted by the Population Research Laboratory at the University of Alberta and data were collected by telephone (random digit dialing using computer assisted telephone interviewing) from February 10 to March 31, 2004. The original survey was approved by the Research Ethics Board of the University of Alberta. The sample was stratified based on age, sex, and health region of the participants. The response rate for the 2004 survey was 72%.
The dependent variable for this study is an index of key performance indicators (KPIs) of the healthcare system in Alberta. These indicators reveal a single underlying construct measuring public perceptions of healthcare (see Northcott and Harvey, 2012 for details). The KPIs index consists of five general indicators assessing the availability, accessibility, and perceived quality of healthcare services, overall quality of the healthcare system, and satisfaction with the health system in Alberta. Four of these KPIs were measured on a 4-point scale and one (satisfaction) on a 5-point scale. Availability was measured by asking the respondents, “Overall, how would you rate the availability of health care services in your community?” (coded 1 = poor, 4 = excellent). Accessibility was measured by the question, “How easy or difficult is it for you to get the health care services you need when you need them?” (coded 1 = very difficult, 4 = very easy). Perceived quality of the healthcare services was measured by the question, “Overall, how would you rate the quality of health care services that are available in your community?” (coded 1 = poor, 4 = excellent). Quality of the healthcare system was measured by the question, “Thinking now about the health care system in Alberta, overall, how would you rate it?” (coded 1 = poor, 4 = excellent). Satisfaction with the health system was measured by the question, “Overall, how satisfied are you with the health system in Alberta?” (coded 1 = very dissatisfied, 5 = very satisfied). Northcott and Harvey (2012) utilized the same sample used in this study and reported a Cronbach’s alpha value of .84 for the KPIs index, indicating good internal consistency for this measure.
Age and chronic conditions are examined in this study as possible predictors of the KPIs, that is, of assessments of the healthcare system in Alberta. In the original survey, age was divided into five categories: 18–24, 25–44, 45–64, 65–74, and 75+ years. For this analysis, age is coded as ‘non-seniors’ (18 to 64) = 0 and ‘seniors’ (65+) = 1. Chronic condition was classified into three categories: no chronic problem, at least one chronic condition (e.g., neurological diseases, heart and circulatory diseases, asthma and other chronic respiratory diseases, diabetes and other endocrine diseases, cancer, genito-urinary, reproductive, allergies, muscular or skeletal, sensory system) excluding chronic pain, and chronic pain with or without other chronic conditions.
Self-reported general health status, self-reported physical and mental health status in past 30 days, knowledge of the available health services, utilization of healthcare services, and socio-demographic characteristics were controlled in this study. Self-reported general health status was measured by the question, “In general, compared with other people your age, would you say your health is…” (coded 1 = poor, 5 = excellent). The physical and mental health status in past 30 days were continuous measures (number of days) comprising two questions: “Thinking of your physical health, which includes physical illness and injury, for how many days during the past 30 days was your physical health not good?” and “Thinking of your mental health, which includes stress, depression, and problems with emotions, for how many days during the past 30 days was your mental health not good?” Knowledge of the available health services was measured by the question, “In general, how would you rate your knowledge of the health services that are available to you?” (coded 1 = poor, 4 = excellent). Utilization of healthcare services was measured by the question, “Have you personally received any health care services in Alberta in the past 12 months?” (coded 0 = no, 1 = yes).
Demographic and socioeconomic characteristics
Demographic and socioeconomic indicators included sex, education, household income, and living arrangement. Sex was coded as male = 0, female = 1. Education was classified into four categories: less than high-school, completed high-school, some post-secondary, and completed post-secondary. Annual household income before taxes and deductions was classified into four categories: less than $30,000, $30,000 to $59,999, $60,000 to 99,999, and $100,000+. Living arrangement was coded as 0 = living alone, 1 = living with someone.
The analysis was carried out using IBM SPSS version 20 (PASW) and included univariate, bivariate, and multivariate analysis of data involving computation of percentages, ANOVA, and hierarchical multiple regression. Association among age, chronic conditions, and the KPIs was tested using ANOVA. In order to identify the significant predictors of the KPIs, multivariate ordinary least squared (OLS) regression analyses were performed. Initial analyses were performed on each separate KPIs, which showed that the findings were significant (results not shown and are available upon request). This was followed by analyses of combined KPIs index in three models. Data were checked to ensure no violation of the assumption of normal distributions (Tabachnick and Fidell, 2007). There were no problems of multicollinearity as the highest VIF (variance inflation factor) score was 3.05 (Cohen et al., 2003: 423). Sampling weights were applied for all analyses in this study (based on the population distribution across the health regions) so as to provide a representative sample of adult Albertans (see Northcott and Northcott, 2004, pp. 53–54). Because household income is missing for approximately 22% of the cases, a separate regression analysis was conducted excluding income from the models (not shown here). However, it did not produce a significant difference in outcome. Therefore, the final analysis includes income.
Table 1 presents descriptive findings for the sample, dependent variable, independent variables and control variables. Females represented 50.4% and males represented 49.6% of the sample. A majority of the sample (86.2%) were non-seniors while 13.8% were seniors (n = 552). About one half of the respondents had completed post-secondary education (49.9%), and had an annual household income of $60,000 and above (51.2%) before taxes and deductions. In terms of household arrangement, 15.2% of the respondents were living alone while 84.8% were living with other members of the household.
A large number of respondents (71.1%) had no chronic health problem that would require regular health services, 26.5% had one or more chronic conditions without chronic pain, and 2.4% (n = 97) had chronic pain with or without other chronic conditions. The majority of the respondents (86.7%) reported that their general health was good, very good or excellent. During the past 30 days, 39.3% and 37.9% of the respondents reported that their physical and mental health, respectively, were not good. When asked about their knowledge of the health services that were available to them, 63.5% rated their knowledge as either good or excellent. A substantial proportion of respondents (77.6%) reported personally receiving healthcare service(s) in the province during the past year.
In terms of the availability of healthcare services in their community, 59.4% rated availability as either good or excellent. A little less than two-thirds of the respondents (61.2%) reported that it was either easy or very easy for them to access healthcare services when they needed them. Approximately two-thirds of the respondents rated the quality of available healthcare services and the overall healthcare system in Alberta as either good or excellent (68.4% and 64.6%, respectively). A majority of the respondents (73.7%) reported that they were either somewhat or very satisfied with the healthcare system in the province.
Because seniors are more likely to rate the KPIs more favorably (Bleich et al., 2009; Campbell et al., 2001; Field and Briggs, 2001; Hall and Dornan, 1990; Kontopantelis et al., 2010; Pappa and Niakas, 2006; Quintana et al., 2006; Rahmqvist and Bara, 2010; Sofaer and Firminger, 2005; Wilson and Rosenberg, 2004; Young et al., 2000) and because the respondents’ chronic conditions are negatively related to their perceptions on the healthcare system (Jayasinghe et al., 2008; Ramage-Morin and Gilmour, 2010; Schoenfelder et al., 2011; Sofaer and Firminger, 2005; Tripp et al., 2006), it was necessary to assess the possible interaction effect of age and chronic conditions on the KPIs using a two-way ANOVA test. Figure 1 illustrates that the interaction was not statistically significant, F (2, 3813) = 2.102, p = .122.
Multivariate ordinary least squared (OLS) regression models were used to estimate the predictors of the KPIs of the healthcare system in Alberta. Age and chronic conditions were entered at step 1, other socio-demographic indicators were entered at step 2, self-reported health statuses and knowledge about and utilization of healthcare services were entered at step 3, resulting in 3 predictive models (see Additional file 1 for coding of the variables). As illustrated in Model 1 of Table 2, age (β = 0.114, p < .001) and chronic conditions [chronic without pain, β = -0.114, p < .001, and chronic pain, β = -0.104, p < .001] significantly predicted the KPIs assessing the healthcare system, F (3, 2865) = 29.04, p < .001. Moreover, the inclusion of socio-demographic variables in Model 2 did not significantly alter the coefficient values of age and chronic conditions.
As illustrated in Model 3, having any chronic health problem excluding chronic pain (β = -0.044, p = .033) and having chronic pain negatively predicted the KPIs (β = -0.054, p = .004) assessing healthcare in Alberta. In addition, being in the senior age group positively (β = 0.063, p = .001) predicted the KPIs. In other words, relative to those with no chronic condition, those with one or more chronic problems excluding chronic pain more negatively assessed the KPIs and those with chronic pain assessed the KPIs even more negatively. On the other hand, senior participants more positively evaluated the KPIs compared to those who were non-seniors. Sex predicted the KPIs such that compared to males, the coefficient for females was negatively associated with the KPIs (β = -0.072, p < .001). Participants’ higher education (β = -0.066, p = .032) and higher annual household income (β = -0.060, p = .025) were negatively associated with the KPIs. However, the living arrangement of the participants was not a significant predictor of the KPIs (β = 0.030, p = .114). Participants’ self-reported health status (β = 0.074, p = .001), and knowledge (β = 0.213, p < .001) and utilization of healthcare services (β = 0.039, p = .036) positively predicted the KPIs. Participants’ poor physical health status during the past 30 days (8+ days) negatively predicted the KPIs (β = -0.065, p = .002). Finally, participants’ mental health status during the past 30 days (1 to 7 days and 8+ days, respectively) negatively predicted the KPIs (β = -0.060, p = .001, and β = 0.145, p < .001, respectively). Overall, knowledge of healthcare services and mental health status during the past 30 days were the strongest predictors of the KPIs (based on their respective standardized regression coefficients). The adjusted R2 value for model 3 was 0.119, indicating that 12% of the variance in the KPIs of healthcare was explained by the model.
Discussion and conclusions
This research examined the effects of age and chronic illness on Albertan’s perceptions of their health system, as measured by the KPIs of healthcare. Regarding the first objective of the study, the results indicated that people in the older age group rated the KPIs of healthcare (i.e., availability, accessibility, quality, and satisfaction) more positively compared to the younger age group in Alberta, after taking into account socio-demographic factors, self-reported health status, and knowledge and utilization of health services. This is consistent with previous studies conducted in Canada and elsewhere that showed older people were more likely to be satisfied with their received healthcare services and reported better access to care compared to those who were young (Bleich et al., 2009; Campbell et al., 2001; Cohen, 1996; Hall and Dornan, 1990; Jayasinghe et al., 2008; Kasman and Badley, 2004; Lyratzopoulos et al., 2012; Rahmqvist and Bara, 2010; Rahmqvist, 2001; Sofaer and Firminger, 2005; Tucker and Kelley, 2000; Wilson and Rosenberg, 2004; Young et al., 2000). This association seems to persist irrespective of healthcare delivery settings (i.e., inpatient care, emergency care, ambulatory, and private clinic visits) (Scotti, 2005).
Existing literature suggested several factors that may influence older people to positively assess the KPIs of healthcare. It could be that older people have more exposure to the health system and therefore have more pragmatic expectations of their care compared to younger ones (Hordacre et al., 2005). Another potential reason is that older individuals may be more unwilling to criticize the service they receive compared to younger ones (Agoritsas et al., 2009; Hall and Dornan, 1990). In addition, it has been suggested that some older patients may not accurately recall their difficulty in accessing the healthcare services in the past 12 months due to cognitive impairment (Kasman and Badley, 2004; Raina et al., 2002). However, it was not possible with the cross-sectional data used in this study to determine the reason for older people’s more favorable rating of the KPIs of healthcare. As such, future research should explore this issue using longitudinal design that allows establishing cause and effect.
For the socio-demographic controls, the findings indicated that females rated the KPIs of healthcare more negatively compared to males, after controlling for possible covariates. This is in agreement with previous studies suggesting that women are more likely than men to report experiencing negative encounters with healthcare (Cohen, 1996; Quintana et al., 2006; Upmark et al., 2007), or difficulty in accessing healthcare (Kasman and Badley, 2004). It could also be that women suffer more from chronic health problems (including back pain and neck pain), depression, and related illnesses compared to men (Boulanger et al., 2007; Malmusi et al., 2011; Moulin et al., 2002; Reitsma et al., 2011; Schopflocher et al., 2011; Tsang et al., 2008), and as a result women may tend to rate the KPIs more negatively. Furthermore, this study found that respondents’ higher education and higher income were marginally and negatively associated with their assessment of the KPIs of healthcare in Alberta, which is consistent with the findings of previous studies (Hekkert et al., 2009; Jayasinghe et al., 2008; Quintana et al., 2006; Rahmqvist and Bara, 2010; Sahin et al., 2006; Sofaer and Firminger, 2005).
With reference to the second objective of this study, the findings revealed that people experiencing chronic pain and other chronic illnesses rated the KPIs of healthcare more negatively compared with people who had no chronic health problem in Alberta. This is in line with previous studies reporting that patients experiencing severe pain and/or chronic illness are more likely to be dissatisfied with the care they receive (Cohen, 1996; Crow et al., 2002), less likely to receive healthcare when needed (Kasman and Badley, 2004), and that people with one or more chronic conditions report less access to healthcare (Kontopantelis et al., 2010; Parchman et al., 2005; Wilson and Rosenberg, 2004). They also report poor self-perceived health (Ramage-Morin and Gilmour, 2010; Tripp et al., 2006) and various other physical and psychological problems (Millar, 1996; Ohayon and Schatzberg, 2010; Ramage-Morin, 2008; Smith et al., 1999; Toblin et al., 2011; Tsang et al., 2008). Furthermore, patients with different chronic illnesses have higher expectations, needs, and priorities of care, which may result in lower satisfaction when they do not receive the expected service (Jayasinghe et al., 2008).
The findings of this study also revealed that respondents’ self-reported overall health status was positively related to their assessment of the KPIs of healthcare in Alberta. This is consistent with existing studies showing that better self-reported overall health is associated with reports of higher satisfaction scores as well as better access to healthcare services (Cohen, 1996; Crow et al., 2002; de Boer et al., 2010; Hall et al., 1990, 1993; Jaipaul and Rosenthal, 2003; Jayasinghe et al., 2008; Põlluste et al., 2012; Rahmqvist and Bara, 2010; Ren et al., 2001; Sofaer and Firminger, 2005; Wendt et al., 2009; Xiao and Barber, 2008). Furthermore, results of this study indicated that respondents’ specific reports of poor physical and mental health status (during the past 30 days prior to the survey) were negatively related to their assessment of the KPIs of healthcare. This finding is also in agreement with previous studies reporting that patients who are in poor physical and mental health are less satisfied with the care that they receive (Al-Mandhari et al., 2004; Bleich et al., 2009; Glynn et al., 2004; Hall et al., 1999; Lyratzopoulos et al., 2012; Schoenfelder et al., 2011; Tucker, 2002; Wensing et al., 1997; Zhang et al., 2007).
One of the interesting findings of this study was that respondents’ knowledge of available health services strongly and positively predicted their assessment of the KPIs of healthcare in Alberta. However, it remains unclear as to why knowledge of health services emerged as one of the strongest predictors of the KPIs because no such indication can be found in existing literature. We could speculate that if people have good knowledge of the healthcare services at their disposal, they can make informed decisions about their health and become familiar with the availability of and accessibility to appropriate healthcare services in their community, which in turn would enable them to feel that they receive better care when they need it.
Overall, this study indicated that old age and chronic health problems (particularly chronic pain) predicted people’s assessment of the KPIs of healthcare in Alberta, net of socio-demographic factors, self-reported health statuses, and knowledge and utilization of health services. The findings suggested that people’s personal health and demographic characteristics are important factors associated with their perception of the healthcare system in the province. One of the key strengths of this study is that the KPIs of healthcare have been assessed in a representative sample of Albertans rather than only among patients enrolled in a medical care facility; the latter is the case in most of the studies conducted in this line of research. Another strength of this study is the use of multiple indicators (i.e., availability, accessibility, quality, and satisfaction) to measure the performance of healthcare in Alberta. Finally, the results implied that people experiencing chronic health problems may need healthcare services that are more responsive to their needs.
The findings of this study should be interpreted with caution due to several limitations. First, the findings are based on a self-report survey which may be subjected to over-reporting or underreporting by the respondents. For instance, Voaklander et al. (2006) suggested that discrepancies may exist between self-reported health survey responses and patients’ medical chart based information, such that some types of disease are more likely than others to be over-reported or underreported. However, given that the findings of this study are mostly consistent with existing literature, ‘courtesy bias’a (Glick, 2009) is unlikely to be the case. Furthermore, most self-report surveys used in healthcare settings have been shown to be reliable. For instance, Raina et al. (1999) analyzed the reliability of several scales used frequently in population-based health surveys in Canada (in a group of seniors), and found that most of the multiple-item scales had acceptable internal consistency (Cronbach’s alpha ≥ 0.70), and most of the single-item measures also had acceptable test-retest reliability (kappa > 0.80).
Second, measures of the KPIs are based on several single-item questions capturing aspects of five indicators of healthcare, and as such, they may be subjected to over-simplifying complex issues and not addressing the full range of participants’ concerns about the performance of the health system in Alberta. However, Zhang et al. (2007) showed that a survey instrument based on single-item questions may be useful for examining patient satisfaction, self-rated health, and health confidence in primary care settings.
Third, the data did not allow for measuring the specific problems or experiences of dissatisfaction with healthcare services among the respondents. It has been noted that global surveys of patient experience generally present an overly optimistic view of the quality of care provided and do not identify areas of poor care (Staniszewska and Henderson, 2005). Therefore, future research, employing in-depth interviews or focus groups, should look into patients’ experiences of problems encountered while dealing with the healthcare system in order to identify areas for improvement.
Fourth, this study is cross-sectional in nature, and as such, does not permit inferring causal relationships among the variables, and the results have limited generalizability. To that end, more research is needed modeling longitudinal aspects of people’s assessment of their healthcare system. Fifth, it was not possible to control other socio-economic characteristics such as marital status, employment status, and racial and ethnic composition for present analysis because data were not available. Hence, future studies should control these factors in relation to people’s assessment of healthcare in Alberta. Finally, this study did not measure the time lag between respondents’ encounter with the healthcare system and answering the survey questions, a factor that may lead to differing assessment (Jackson et al., 2001).
This study has several policy implications. A specific implication of this study is that the healthcare system in Alberta should provide services that are better tailored to the needs of people who experience chronic health problems. The facilitation of such support would most likely lead to increased patient satisfaction and better evaluation of the KPIs of healthcare in the province. As public assessment of performance indicators of healthcare is gaining momentum (Zhang et al., 2007), there is a need for taking into account people’s experiences in identifying potential areas of improvement in order to increase the effectiveness of healthcare systems (Hekkert et al., 2009). This can help physicians and healthcare providers to identify problems related to access, availability, quality, and outcome of care, and satisfaction with the care received from public’s point of view. Studies found that healthcare employees considered patients’ evaluations of their care useful for quality improvement (Heje et al., 2011; Iversen et al., 2010). In addition, a majority of healthcare professionals reported that they had implemented improvement measures by attending to problems identified by patients (Heje et al., 2011; Iversen et al., 2010).
aA situation whereby respondents are reluctant to express negative opinions to an interviewer, leading to overestimation of satisfaction with healthcare services (Glick, 2009).
Key performance indicators.
Agoritsas T, Lubbeke A, Schiesari L, Perneger TV: Assessment of patients’ tendency to give a positive or negative rating to healthcare. Qual Saf Health Care 2009, 18(5):374-379. doi:10.1136/qshc.2008.028175 10.1136/qshc.2008.028175
Al-Mandhari AS, Hassan AA, Haran D: Association between perceived health status and satisfaction with quality of care: evidence from users of primary health care in Oman. Fam Pract 2004, 21(5):519-527. doi:10.1093/fampra/cmh508 10.1093/fampra/cmh508
Bentur N, Gross R, Brammli-Greenberg S: Satisfaction with and access to community care of the chronically ill in Israel’s health system. Health Pol 2004, 67(2):129-136. doi:10.1016/S0168-8510(03)00086-1 10.1016/S0168-8510(03)00086-1
Bertakis KD, Roter DL, Putnam SM: The relationship of physician medical interview style to patient satisfaction. J Fam Pract 1991, 32(2):175-181.
Bleich SN, Özaltin E, Murray CJ: How does satisfaction with the health-care system relate to patient experience? Bull World Health Organ 2009, 87(4):271-278. doi:10.2471/BLT.07.050401 10.2471/BLT.07.050401
Boudreaux ED, Ary RD, Mandry CV, McCabe B: Determinants of patient satisfaction in a large, municipal ED: the role of demographic variables, visit characteristics, and patient perceptions. Am J Emerg Med 2000, 18(4):394-400. doi:10.1053/ajem.2000.7316 10.1053/ajem.2000.7316
Boulanger A, Clark AJ, Squire P, Cui E, Horbay GLA: Chronic pain in Canada: have we improved our management of chronic noncancer pain? Pain Res Manag 2007, 12(1):39-47.
Campbell JL, Ramsay J, Green J: Age, gender, socioeconomic, and ethnic differences in patients’ assessments of primary health care. Qual Health Care 2001, 10(2):90-95. doi:10.1136/qhc.10.2.90 10.1136/qhc.10.2.90
Cohen G: Age and health status in a patient satisfaction survey. Soc Sci Med 1996, 42(7):1085-1093. doi:10.1016/0277-9536(95)00315-0 10.1016/0277-9536(95)00315-0
Cohen J, Cohen P, West SG, Aiken LS: Applied multiple regression/correlation analysis for the behavioral sciences. 3rd edition. Mahwah, NJ: Lawrence Erlbaum Associates; 2003.
Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess 2002, 6(32):1-244.
de Boer D, Delnoij D, Rademakers J: Do patient experiences on priority aspects of health care predict their global rating of quality of care? A study in five patient groups. Health Expect 2010, 13(3):285-297. doi:10.1111/j.1369-7625.2010.00591.x
Draper M, Cohen P, Buchan H: Seeking consumer views: what use are results of hospital patient satisfaction surveys? Int J Qual Health Care 2001, 13(6):463-468. doi:10.1093/intqhc/13.6.463 10.1093/intqhc/13.6.463
Field KS, Briggs DJ: Socio-economic and locational determinants of accessibility and utilization of primary health-care. Health Soc Care Community 2001, 9(5):294-308. doi:10.1046/j.0966-0410.2001.00303.x 10.1046/j.0966-0410.2001.00303.x
Glick P: How reliable are surveys of client satisfaction with healthcare services? Evidence from matched facility and household data in Madagascar. Soc Sci Med 2009, 68(2):368-379. doi:10.1016/j.socscimed.2008.09.053 10.1016/j.socscimed.2008.09.053
Glynn LG, Byrne M, Newell J, Murphy AW: The effect of health status on patients’ satisfaction with out-of-hours care provided by a family doctor co-operative. Fam Pract 2004, 21(6):677-683. doi:10.1093/fampra/cmh616 10.1093/fampra/cmh616
Hall JA, Dornan MC: Patient sociodemographic characteristics as predictors of satisfaction with medical care: a meta-analysis. Soc Sci Med 1990, 30(7):811-818. doi:10.1016/0277-9536(90)90205-7 10.1016/0277-9536(90)90205-7
Hall JA, Feldstein M, Fretwell MD, Rowe JW, Epstein AM: Older patients’ health status and satisfaction with medical care in an HMO population. Med Care 1990, 28(3):261-270. 10.1097/00005650-199003000-00006
Hall JA, Milburn MA, Epstein AM: A causal model of health status and satisfaction with medical care. Med Care 1993, 31(1):84-94. 10.1097/00005650-199301000-00007
Hall JA, Milburn MA, Roter DL, Daltroy LH: Why are sicker patients less satisfied with their medical care? Tests of two explanatory models. Health Psychol 1998, 17(1):70-75. doi:10.1037/0278-6184.108.40.206
Hall JA, Roter DL, Milburn MA: Illness and satisfaction with medical care. Curr Dir Psychol Sci 1999, 8(3):96-99. doi:10.1111/1467-8721.00023 10.1111/1467-8721.00023
Heje HN, Vedsted P, Olesen F: General practitioners’ experience and benefits from patient evaluations. BMC Fam Pract 2011, 12: 116. doi:10.1186/1471-2296-12-116 10.1186/1471-2296-12-116
Hekkert KD, Cihangir S, Kleefstra SM, van den Berg B, Kool RB: Patient satisfaction revisited: a multilevel approach. Soc Sci Med 2009, 69(1):68-75. doi:10.1016/j.socscimed.2009.04.016 10.1016/j.socscimed.2009.04.016
Hordacre A-L, Taylor A, Pirone C, Adams RJ: Assessing patient satisfaction: implications for South Australian public hospitals. Aust Health Rev 2005, 29(4):439-446. 10.1071/AH050439
Infante FA, Proudfoot JG, Powell Davies G, Bubner TK, Holton CH, Beilby JJ, Harris MF: How people with chronic illnesses view their care in general practice: a qualitative study. Med J Aust 2004, 181(2):70-73.
Iversen HH, Bjertnæs ØA, Groven G, Bukholm G: Usefulness of a national parent experience survey in quality improvement: views of paediatric department employees. Qual Saf Health Care 2010, 19(5):e38. doi:10.1136/qshc.2009.034298
Jackson JL, Chamberlin J, Kroenke K: Predictors of patient satisfaction. Soc Sci Med 2001, 52(4):609-620. 10.1016/S0277-9536(00)00164-7
Jaipaul CK, Rosenthal GE: Are older patients more satisfied with hospital care than younger patients? J Gen Intern Med 2003, 18(1):23-30. doi:10.1046/j.1525-1497.2003.20114.x 10.1046/j.1525-1497.2003.20114.x
Jayasinghe UW, Proudfoot J, Holton C, Davies GP, Amoroso C, Bubner T, Harris MF: Chronically ill Australians’ satisfaction with accessibility and patient-centredness. Int J Qual Health Care 2008, 20(2):105-114. doi:10.1093/intqhc/mzm071
Johannes CB, Le TK, Zhou X, Johnston JA, Dworkin RH: The prevalence of chronic pain in United States adults: results of an internet-based survey. J Pain 2010, 11(11):1230-1239. doi:10.1016/j.jpain.2010.07.002 10.1016/j.jpain.2010.07.002
Kane RL, Maciejewski M, Finch M: The relationship of patient satisfaction with care and clinical outcomes. Med Care 1997, 35(7):714-730. 10.1097/00005650-199707000-00005
Kasman NM, Badley EM: Beyond access: who reports that health care is not being received when needed in a publicly-funded health care system? Can J Public Health 2004, 95(4):304-308.
Kontopantelis E, Roland M, Reeves D: Patient experience of access to primary care: identification of predictors in a national patient survey. BMC Fam Pract 2010, 11: 61. doi:10.1186/1471-2296-11-61 10.1186/1471-2296-11-61
Lyratzopoulos G, Elliott M, Barbiere JM, Henderson A, Staetsky L, Paddison C, Roland M: Understanding ethnic and other socio-demographic differences in patient experience of primary care: evidence from the English General Practice Patient Survey. BMJ Qual Saf 2012, 21(1):21-29. doi:10.1136/bmjqs-2011-000088 10.1136/bmjqs-2011-000088
Malmusi D, Artazcoz L, Benach J, Borrell C: Perception or real illness? How chronic conditions contribute to gender inequalities in self-rated health. Eur J Public Health 2011. doi:10.1093/eurpub/ckr184
Millar WJ: Chronic pain. Health Rep 1996, 7(4):47-53.
Moret L, Nguyen J-M, Volteau C, Falissard B, Lombrail P, Gasquet I: Evidence of a non-linear influence of patient age on satisfaction with hospital care. Int J Qual Health Care 2007, 19(6):382-389. doi:10.1093/intqhc/mzm041 10.1093/intqhc/mzm041
Moulin DE, Clark AJ, Speechley M, Morley-Forster PK: Chronic pain in Canada–prevalence, treatment, impact and the role of opioid analgesia. Pain Res Manag 2002, 7(4):179-184.
Mpinga EK, Chastonay P: Satisfaction of patients: a right to health indicator? Health Pol 2011, 100(2–3):144-150. doi:10.1016/j.healthpol.2010.11.001
Northcott HC, Harvey MD: Public perceptions of key performance indicators of healthcare in Alberta, Canada. Int J Qual Health Care 2012, 24(3):214-223. doi:10.1093/intqhc/mzs012 10.1093/intqhc/mzs012
Northcott HC, Northcott JL: The 2004 Public Survey about Health and the Health System in Alberta. Edmonton: Population Research Laboratory, University of Alberta, and Alberta Health and Wellness; 2004.
Ohayon MM, Schatzberg AF: Chronic pain and major depressive disorder in the general population. J Psychiatr Res 2010, 44(7):454-461. doi:10.1016/j.jpsychires.2009.10.013 10.1016/j.jpsychires.2009.10.013
Pappa E, Niakas D: Assessment of health care needs and utilization in a mixed public-private system: the case of the Athens area. BMC Health Serv Res 2006, 6: 146. doi:10.1186/1472-6963-6-146 10.1186/1472-6963-6-146
Parchman ML, Noël PH, Lee S: Primary care attributes, health care system hassles, and chronic illness. Med Care 2005, 43(11):1123-1129. 10.1097/01.mlr.0000182530.52979.29
Pelone F, de Belvis AG, Volpe M, Ricciardi W: Is there a relationship between health care models and their performance assessment? The results of an extensive review. Ital J Public Health 2008, 5(2):102-106. doi:10.2427/5836
Põlluste K, Kallikorm R, Meiesaar K, Lember M: Satisfaction with access to health services: the perspective of Estonian patients with rheumatoid arthritis. Sci World J 2012, 2012: 257569. doi:10.1100/2012/257569
Quintana JM, González N, Bilbao A, Aizpuru F, Escobar A, Esteban C, Thompson A: Predictors of patient satisfaction with hospital health care. BMC Health Serv Res 2006, 6: 102. doi:10.1186/1472-6963-6-102 10.1186/1472-6963-6-102
Rahmqvist M: Patient satisfaction in relation to age, health status and other background factors: a model for comparisons of care units. Int J Qual Health Care 2001, 13(5):385-390. 10.1093/intqhc/13.5.385
Rahmqvist M, Bara AC: Patient characteristics and quality dimensions related to patient satisfaction. Int J Qual Health Care 2010, 22(2):86-92. doi:10.1093/intqhc/mzq009 10.1093/intqhc/mzq009
Raina P, Bonnett B, Waltner-Toews D, Woodward C, Abernathy T: How reliable are selected scales from population-based health surveys? An analysis among seniors. Can J Public Health 1999, 90(1):60-64.
Raina P, Torrance-Rynard V, Wong M, Woodward C: Agreement between self-reported and routinely collected health-care utilization data among seniors. Health Serv Res 2002, 37(3):751-774. 10.1111/1475-6773.00047
Ramage-Morin PL: Chronic pain in Canadian seniors. Health Rep 2008, 19(1):37-52.
Ramage-Morin PL, Gilmour H: Chronic pain at ages 12 to 44. Health Rep 2010, 21(4):53-61.
Rapkin B, Weiss E, Chhabra R, Ryniker L, Patel S, Carness J, Tanner E: Beyond satisfaction: using the Dynamics of Care assessment to better understand patients’ experiences in care. Health Qual Life Outcomes 2008, 6: 20. doi:10.1186/1477-7525-6-20 10.1186/1477-7525-6-20
Reitsma ML, Tranmer JE, Buchanan DM, Van den Kerkhof EG: The prevalence of chronic pain and pain-related interference in the Canadian population from 1994 to 2008. Chronic Dis Inj Can 2011, 31(4):157-164.
Ren XS, Kazis L, Lee A, Rogers W, Pendergrass S: Health status and satisfaction with health care: a longitudinal study among patients served by the Veterans Health Administration. Am J Med Qual 2001, 16(5):166-173. doi:10.1177/106286060101600504 10.1177/106286060101600504
Sahin B, Yilmaz F, Lee KH: Factors affecting inpatient satisfaction: structural equation modeling. J Med Syst 2006, 31(1):9-16. doi:10.1007/s10916-006-9038-8 10.1007/s10916-006-9038-8
Schoenfelder T, Klewer J, Kugler J: Determinants of patient satisfaction: a study among 39 hospitals in an in-patient setting in Germany. Int J Qual Health Care 2011, 23(5):503-509. doi:10.1093/intqhc/mzr038 10.1093/intqhc/mzr038
Schopflocher D, Taenzer P, Jovey R: The prevalence of chronic pain in Canada. Pain Res Manag 2011, 16(6):445-450.
Scotti DJ: Satisfaction with medical care among elderly patients: a review of research findings with implications for management practice and future inquiry. J Hosp Mark Public Relations 2005, 15(2):3-32. doi:10.1300/J375v15n02_02 10.1300/J375v15n02_02
Sixma HJ, Spreeuwenberg PM, van der Pasch MA: Patient satisfaction with the general practitioner: a two-level analysis. Med Care 1998, 36(2):212-229. 10.1097/00005650-199802000-00010
Smith BH, Hopton JL, Chambers WA: Chronic pain in primary care. Fam Pract 1999, 16(5):475-482. doi:10.1093/fampra/16.5.475 10.1093/fampra/16.5.475
Sofaer S, Firminger K: Patient perceptions of the quality of health services. Annu Rev Public Health 2005, 26: 513-559. doi:10.1146/annurev.publhealth.25.050503.153958 10.1146/annurev.publhealth.25.050503.153958
Soh G: Patient satisfaction with physician care. Hawaii Med J 1991, 50(4):149-152.
Staniszewska SH, Henderson L: Patients’ evaluations of the quality of care: influencing factors and the importance of engagement. J Adv Nurs 2005, 49(5):530-537. doi:10.1111/j.1365-2648.2004.03326.x 10.1111/j.1365-2648.2004.03326.x
Tabachnick BG, Fidell LS: Using multivariate statistics. 5th edition. Boston, MA: Allyn & Bacon/Pearson Education; 2007.
Toblin RL, Mack KA, Perveen G, Paulozzi LJ: A population-based survey of chronic pain and its treatment with prescription drugs. Pain 2011, 152(6):1249-1255. doi:10.1016/j.pain.2010.12.036 10.1016/j.pain.2010.12.036
Tripp DA, Van den Kerkhof EG, McAlister M: Prevalence and determinants of pain and pain-related disability in urban and rural settings in southeastern Ontario. Pain Res Manag 2006, 11(4):225-233.
Tsang A, Von Korff M, Lee S, Alonso J, Karam E, Angermeyer MC, Watanabe M: Common chronic pain conditions in developed and developing countries: gender and age differences and comorbidity with depression-anxiety disorders. J Pain 2008, 9(10):883-891. doi:10.1016/j.jpain.2008.05.005 10.1016/j.jpain.2008.05.005
Tucker JL: The moderators of patient satisfaction. J Manag Med 2002, 16(1):48-66. 10.1108/02689230210428625
Tucker JL, Kelley VA: The influence of patient sociodemographic characteristics on patient satisfaction. Mil Med 2000, 165(1):72-76.
Upmark M, Borg K, Alexanderson K: Gender differences in experiencing negative encounters with healthcare: a study of long-term sickness absentees. Scand J Public Health 2007, 35(6):577-584. doi:10.1080/14034940701362194 10.1080/14034940701362194
Voaklander DC, Thommasen HV, Michalos AC: The relationship between health survey and medical chart review results in a rural population. Soc Indic Res 2006, 77(2):287-305. doi:10.1007/s11205-005-2551-1 10.1007/s11205-005-2551-1
Wendt C, Kohl J, Mischke M, Pfeifer M: How do Europeans perceive their healthcare system? Patterns of satisfaction and preference for state involvement in the field of healthcare. Eur Sociol Rev 2009, 26(2):177-192. doi:10.1093/esr/jcp014
Wensing M, Grol R, Asberg J, van Montfort P, van Weel C, Felling A: Does the health status of chronically ill patients predict their judgements of the quality of general practice care? Qual Life Res 1997, 6(4):293-299. 10.1023/A:1018405207552
Wilson K, Rosenberg MW: Accessibility and the Canadian health care system: Squaring perceptions and realities. Health Pol 2004, 67(2):137-148. doi:10.1016/S0168-8510(03)00101-5 10.1016/S0168-8510(03)00101-5
Xiao H, Barber JP: The effect of perceived health status on patient satisfaction. Value Health 2008, 11(4):719-725. doi:10.1111/j.1524-4733.2007.00294.x 10.1111/j.1524-4733.2007.00294.x
Young GJ, Meterko M, Desai KR: Patient satisfaction with hospital care: effects of demographic and institutional characteristics. Med Care 2000, 38(3):325-334. 10.1097/00005650-200003000-00009
Zhang Y, Rohrer J, Borders T, Farrell T: Patient satisfaction, self-rated health status, and health confidence: an assessment of the utility of single-item questions. Am J Med Qual 2007, 22(1):42-49. doi:10.1177/1062860606296329 10.1177/1062860606296329
Permission to use the public survey data examined in this paper was obtained from Alberta Health and Wellness. The Population Research Laboratory at the University of Alberta conducted the 2004 survey for Alberta Health and Wellness. We thank Frank Trovato and Laurel Strain for their helpful suggestions on an earlier version of this article.
The authors declare that they have no competing interests. The analysis and interpretation of data presented in this article do not necessarily reflect the official views or policies of the Province of Alberta’s Department of Health and Wellness.
ASN and HN conceptualized and designed the study, including acquisition of data, setting the analytic strategy and materials and methods. ASN analyzed and interpreted the data, and drafted the article. ASN, HN, and MH have been involved in revising the manuscript critically for important intellectual content. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Nurullah, A.S., Northcott, H.C. & Harvey, M.D. Public assessment of key performance indicators of healthcare in a Canadian province: the effect of age and chronic health problems. SpringerPlus 3, 28 (2014). https://doi.org/10.1186/2193-1801-3-28
- Key performance indicators
- Healthcare system
- Age group
- Chronic illness
- Chronic pain