Breast cancer patients’ recall of receiving patient assistance services
© Lin et al.; licensee Springer. 2012
Received: 19 July 2012
Accepted: 6 September 2012
Published: 3 October 2012
The objective of this study was to assess factors that affect breast cancer patients’ recall of patient assistance services.
We surveyed newly-diagnosed breast cancer patients and compared recall of receiving patient assistance services at 2 weeks and 6 months in a patient-assistance randomized controlled trial aimed to connect women to such programs. The intervention group received information about assistance programs targeted to their practical, psychosocial, and/or informational needs; the control group received a Department of Health pamphlet about breast cancer and its treatment, including a list of patient assistance services.
Of 333 women, 210 (63%) reported informational, 183 (55%) psychosocial and 177 (53%) practical needs. At 2 weeks, 96% (202/210) of women with informational needs reported receiving informational material but at 6 months, recall dropped to 69% (140/210). All women whose informational needs were met recalled receiving information, compared to 31% whose needs were unmet (p < 0.0001). Of 109 intervention patients with psychosocial or practical needs, 77% (79) contacted a program specified in their action plan at 2 weeks. However, at 6 months, only 39% (31/79) recalled contacting a program. Women without recall were less likely to report having their needs met (6% vs. 58%; p < 0.001).
Recall of patient assistance services is strongly related to having needs met. Use of patient surveys to evaluate utilization or impact of such programs should be used with caution due to poor patient recall.
Clinical Trials # NCT00233077
KeywordsRecall Survey research Breast cancer Patient assistance
Since medical chart review is time-consuming, costly and logistically challenging in a decentralized health system, patient self-report via questionnaire surveys are often used to assess utilization of services or treatments (Gordon et al. ; Paskett et al. ). Some studies show patient self-report to be relatively accurate for cancer screening procedures such as pap smears, mammograms and fecal occult blood testing (Gordon et al. ; Zapka et al. ; Mandelson et al. ), cancer treatment (Maunsell et al. ; Clegg et al. ; Oberst et al. ; Liu et al. ; Phillips et al. ; Schootman et al. ), and medication therapy (Boudreau et al. ; Paganini-Hill & [Clark 2007]; Caskie & [Willis 2004]). However, potential problems with patient self-report include inaccurate recall of timing or frequency of screening tests (Bancej et al. ; Caplan et al. [2003a]; Caplan et al. [2003b]; Ferrante et al. ; Howard et al. ) or of details of treatment duration or type (Clegg et al. ; Paganini-Hill & [Clark 2007]). Furthermore, some studies show that cancer survivors may not accurately recall details about their stage of disease, type of tumor, chemotherapy regimens or even having had the disease (Nissen & [Tsai 2011]; Desai et al. ). Accuracy of self-report also appears to decrease with the passage of time (Boudreau et al. ; Craig et al. ).
Efficacy of patient assistance programs, educational or psychosocial interventions is often evaluated, at least in part, by questionnaires (Fiscella et al. ; Freund et al. ; David et al. ; Allicock et al. ). These surveys often ask participants to rate satisfaction with, utilization of or effectiveness of program services. As participants may have inaccurate recollections of their use of such programs and interventions, it is important to assess factors that affect patient recall. Accurate recall becomes particularly important if future funding decisions are based in part on patients’ recall of service utilization. Moreover, as many studies evaluating health care utilization are based on survey data, it is important to assess the reliability of self-reported data collected by survey questionnaire. This study was part of a randomized controlled trial to evaluate whether connecting women with newly-diagnosed breast cancer with patient-assistance services could improve use of adjuvant therapies. In this paper, we evaluate newly-diagnosed breast cancer patients’ recall of informational materials received and patient assistance programs contacted.
Setting and participants
Women with early-stage breast cancer who were eligible for post-surgical adjuvant therapy were recruited from 8 New York City hospitals (4 municipal, 4 tertiary referral centers). Women were recruited within 2–4 weeks after definitive surgical treatment and were block-randomized to intervention or usual care. Women who did not speak English or Spanish or could not provide informed consent were excluded. The study was approved by the IRBs of all 8 participating hospitals.
Study design & intervention
We surveyed participants at baseline and 6 months about their experiences with care, health status, social support, self-efficacy, knowledge, attitudes and beliefs about breast cancer and its treatment, patient assistance programs contacted and help received from programs. Scales for health status (SF-12), social support (Strogatz et al. ), and medical mistrust (LaVeist et al. ) were scored to 100 with higher values indicating higher health status, social support, and physician trust, respectively. For all patients, we conducted a baseline survey measuring breast cancer experiences, knowledge, attitudes and beliefs, and a needs assessment. For intervention patients, we identified 3 high-quality patient assistance programs that could address each patient’s identified need and created an individualized action plan with each patient to enable contact with the patient assistance programs. A hard copy of the action plan and related print materials were mailed. Patients in the control group were sent a pamphlet about breast cancer and its treatment created by the New York State Department of Health that also included resources’ contact information. Two weeks later, we called all patients to confirm receipt of mailed materials; intervention patients were also asked whether they had connected with the programs specified in their action plan. If they did not connect with a patient assistance program and still had psychosocial or practical needs, we assigned an outreach worker to help them connect with a program. At 6 months, we surveyed patients to determine the type of help they had received from the patient assistance program and how helpful it was. A patient was classified as having gotten her needs met if she reported receiving information, counseling or practical help for her identified need.
Summary statistics were used to describe baseline demographics, and chi-square tests for categorical variables, T-tests or ANOVA for continuous variables to assess group differences. Logistic regression models were fit to assess risk factors of the primary outcome, 6-month recall of patient assistance services. All analyses were performed using SAS version 9.2, with the type 1 error rate fixed at 0.05 (2 tailed).
Factors associated with recall among women with informational needs & women with practical or psychosocial needs
Recalled Informational help (N = 140)
Did not recall Informational Help (N = 62)
Recalled Practical or Psychosocial Help (N = 31)
Did not recall Practical or Psychosocial help (N = 48)
Age (yrs) mean ± SD
57 ± 11.9
58 ± 10.0
56 ± 10.6
56 ± 12.1
High school graduate
Income < $15,000/year
Radiation treatment received
Hormonal therapy received
Trust MD, mean ± SD+
94 ± 8.4
92 ± 8.2
93 ± 9.1
92 ± 9.7
Instrumental Social Support, mean ± SD+
67 ± 27.3
70 ± 24.4
71 ± 29.5
67 ± 25.2
Emotional Social Support, mean ± SD+
79 ± 19.3
79 ± 18.8
77 ± 21.2
78 ± 19.6
SF-12, Physical Health, mean ± SD+
44 ± 11.7
46 ± 10.3
45 ± 9.0
SF-12, Mental Health, mean ± SD+
49 ± 11.4
46 ± 10.1
48 ± 13.4
48 ± 12.4
Multivariable model predicting recall of practical and psychosocial help
RR (95% Confidence Interval)
1.00 (0.98 - 1.03)
High school education
0.88 (0.56 - 1.38)
1.23 (0.75 - 2.02)
Practical/psychosocial needs met
3.93 (2.36 - 6.55)
Surveys are widely used to assess patients’ experiences, beliefs and knowledge about medical care and treatment. While surveys are an efficient method to collect data, they may not always be accurate or reliable. We found that breast cancer patients’ recall of information about patient assistance programs was not associated with an individual patient’s psychological or physical state but rather on the direct relevance and impact of the data and programs on their lives. Nearly all of the women who received informational materials about breast cancer and treatment recalled getting this information at 2 weeks, but this proportion dropped substantially by 6 months. Strikingly, their recall of having received informational material was significantly associated with whether they reported that their informational needs had been met.
Even more striking was the poor recall of practical and psychosocial services in our study. Of the women with underlying psychosocial or practical needs, more than three-quarters report contacting patient assistance programs initially, but by 6 months, only a third of the women who had contacted a program recalled doing so. Similar to recall of informational material, recall of contacting a program was also strongly related to whether women felt their needs had been met.
Patients who have better recall report more satisfaction with physician communication (Gabrijel et al. ) and greater trust of their providers (Posma et al. ). Additionally, patients’ accurate recall of medical information can directly affect adherence with prescribed treatment regimens ([Kessels 2003]; Watson & Mc[Kinstry 2009]; Pickney & [Arnason 2005]) and can indirectly provide signals about patients’ experiences and the quality of those experiences. Moreover, recall of services utilized may impact patients’ reported satisfaction and thus affect quality improvement efforts and possibly reimbursements tied to quality ratings (van Campen et al. ; [Kravitz 1998]; Turnbull & [Luther 1996]; Epstein et al. ; [Takach 2011]; [Bickell 2999]) From a research perspective, asking patients about services utilized offers a less expensive assessment approach than conducting chart reviews, particularly for care that may be fragmented and not accessible electronically. Studies find patient report to be reliable for cancer treatments received (Oberst et al. ; Phillips et al. ; Schootman et al. ; Penfold et al. ), yet the reliability of patient report to assess utilization is variable (Lubeck & [Hubert 2005]) with greater concerns among vulnerable patients (Sohler et al. ). Our study calls into question the accuracy of self-reported utilization of patient assistance services among breast cancer patients. Any inferences made about underutilization of services reported in survey data using patient self-report should be treated with caution.
Numerous conditions can affect the accuracy of patient recall. Individuals who are older, sicker, less educated and have more negative emotional or psychological states have worse recall of information presented (Jansen et al. ; Ong et al. ; Liang et al. ; Butow et al. ). In addition to the many personal attributes that can challenge an individual’s recollection, recall also depends on the effective communication of accurate information so it can be conveyed and subsequently recalled. These challenges are great in everyday circumstances but can be even more acute for patients with cancer, a diagnosis fraught with physical and psychological threats. Unlike prior studies, however, we found that recall of information was not affected by individual factors such as age, educational level, emotional status, or type of adjuvant therapy received. In our study, only whether patients felt their needs had been met by the services provided affected recall accuracy.
There are a number of limitations to this study. Because this was a study of women receiving breast cancer care in an urban setting, our findings may not generalize to women receiving care in other settings. We did not assess the quality of the contact that women had with patient assistance programs, although the patient assistance programs were high-quality programs specifically chosen based on previous work evaluating quality of patient assistance programs in New York City (Cohen et al. ). Moreover, we did not assess contact with patient assistance programs among the usual care group at the 2 week phone call and are unable to assess their true level of utilization. Thus, it is quite possible that our measure of recall is an underestimate. Still it is striking that of the 79 women who did contact a patient assistance program, only a third of them recalled doing so at 6 months, even after adjusting for age, education and receipt of chemotherapy, which might affect memory (Koppelmans et al. ).
Accuracy of breast cancer patients’ survey responses about patient assistance program utilization is strongly related to their perception of the usefulness of the services received. Our findings should make researchers and others take pause regarding use of patient report as a reliable source to assess program utilization since it appears that recall was closely related to patients’ perceptions of whether the program helped them.
Funding: This work was funded by the National Cancer Institute (5R01CA107051). Dr. Lin is also funded by the American Cancer Society Cancer Control Career Development Grant (CCCDA-10-084-01).
- Allicock M, Campbell MK, Valle CG, Barlow JN, Carr C, Meier A, Gizlice Z: Evaluating the implementation of peer counseling in a church-based dietary intervention for African Americans. Patient education and counseling 2010,81(1):37-42. 10.1016/j.pec.2009.11.018View Article
- Bancej CM, Maxwell CJ, Snider J: Inconsistent self-reported mammography history: findings from the National Population Health Survey longitudinal cohort. BMC Health Serv Res 2004,4(1):32. 10.1186/1472-6963-4-32View Article
- Bickell NA: Quality of breast cancer Care: perception vs practice. J Clin Oncol in press
- Boudreau DM, Daling JR, Malone KE, Gardner JS, Blough DK, Heckbert SR: A validation study of patient interview data and pharmacy records for antihypertensive, statin, and antidepressant medication use among older women. Am J Epidemiol 2004,159(3):308-317. 10.1093/aje/kwh038View Article
- Butow P, Brindle E, McConnell D, Boakes R, Tattersall M: Information booklets about cancer: factors influencing patient satisfaction and utilization. Patient education and counseling 1998,33(2):129-141. 10.1016/S0738-3991(97)00071-2View Article
- Caplan LS, McQueen DV, Qualters JR, Leff M, Garrett C, Calonge N: Validity of women's self-reports of cancer screening test utilization in a managed care population. Cancer Epidemiol Biomarkers Prev 2003,12(11 Pt 1):1182-1187.
- Caplan LS, Mandelson MT, Anderson LA: Validity of self-reported mammography: examining recall and covariates among older women in a Health Maintenance Organization. Am J Epidemiol 2003,157(3):267-272. 10.1093/aje/kwf202View Article
- Caskie GI, Willis SL: Congruence of self-reported medications with pharmacy prescription records in low-income older adults. Gerontologist 2004,44(2):176-185. 10.1093/geront/44.2.176View Article
- Clegg LX, Potosky AL, Harlan LC, Hankey BF, Hoffman RM, Stanford JL, Hamilton AS: Comparison of self-reported initial treatment with medical records: results from the prostate cancer outcomes study. Am J Epidemiol 2001,154(6):582-587. 10.1093/aje/154.6.582View Article
- Cohen A, Mohan KN, Fei K, Geduld AN, Bickell NA: Are patient assistance programmes able to meet the needs of New York City women with breast cancer? Women's perspectives. European journal of cancer care 2009,18(1):50-56. 10.1111/j.1365-2354.2008.00928.xView Article
- Craig BM, Quinn GP, Vadaparampil ST: Sensitivity of self-report mammography use in older women. Am J Prev Med 2009,37(5):441-444. 10.1016/j.amepre.2009.07.007View Article
- David N, Schlenker P, Prudlo U, Larbig W: Online counseling via e-mail for breast cancer patients on the German internet: preliminary results of a psychoeducational intervention. Psychosoc Med 2011, 8: Doc05.
- Desai MM, Bruce ML, Desai RA, Druss BG: Validity of self-reported cancer history: a comparison of health interview data and cancer registry records. Am J Epidemiol 2001,153(3):299-306. 10.1093/aje/153.3.299View Article
- Epstein AM, Lee TH, Hamel MB: Paying physicians for high-quality care. N Engl J Med 2004,350(4):406-410. 10.1056/NEJMsb035374View Article
- Ferrante JM, Ohman-Strickland P, Hahn KA, Hudson SV, Shaw EK, Crosson JC, Crabtree BF: Self-report versus medical records for assessing cancer-preventive services delivery. Cancer Epidemiol Biomarkers Prev 2008,17(11):2987-2994. 10.1158/1055-9965.EPI-08-0177View Article
- Fiscella K, Ransom S, Jean-Pierre P, Cella D, Stein K, Bauer JE, Crane-Okada R, Gentry S, Canosa R, Smith T, et al.: Patient-reported outcome measures suitable to assessment of patient navigation. Cancer 2011,117(15 Suppl):3603-3617.
- Freund KM, Battaglia TA, Calhoun E, Dudley DJ, Fiscella K, Paskett E, Raich PC, Roetzheim RG: National Cancer Institute Patient Navigation Research Program: methods, protocol, and measures. Cancer 2008,113(12):3391-3399. 10.1002/cncr.23960View Article
- Gabrijel S, Grize L, Helfenstein E, Brutsche M, Grossman P, Tamm M, Kiss A: Receiving the diagnosis of lung cancer: patient recall of information and satisfaction with physician communication. J Clin Oncol 2008,26(2):297-302. 10.1200/JCO.2007.13.0609View Article
- Gordon NP, Hiatt RA, Lampert DI: Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst 1993,85(7):566-570. 10.1093/jnci/85.7.566View Article
- Howard M, Agarwal G, Lytwyn A: Accuracy of self-reports of Pap and mammography screening compared to medical record: a meta-analysis. Cancer Causes Control 2009,20(1):1-13. 10.1007/s10552-008-9228-4View Article
- Jansen J, Butow PN, van Weert JC, van Dulmen S, Devine RJ, Heeren TJ, Bensing JM, Tattersall MH: Does age really matter? Recall of information presented to newly referred patients with cancer. J Clin Oncol 2008,26(33):5450-5457. 10.1200/JCO.2007.15.2322View Article
- Kessels RP: Patients' memory for medical information. J R Soc Med 2003,96(5):219-222. 10.1258/jrsm.96.5.219View Article
- Koppelmans V, Breteler MM, Boogerd W, Seynaeve C, Gundy C, Schagen SB: Neuropsychological performance in survivors of breast cancer more than 20 years after adjuvant chemotherapy. J Clin Oncol: official journal of the American Society of Clinical Oncology 2012,30(10):1080-1086. 10.1200/JCO.2011.37.0189View Article
- Kravitz R: Patient satisfaction with health care: critical outcome or trivial pursuit? Journal of general internal medicine 1998,13(4):280-282. 10.1046/j.1525-1497.1998.00084.xView Article
- LaVeist TA, Nickerson KJ, Bowie JV: Attitudes about racism, medical mistrust, and satisfaction with care among African American and white cardiac patients. Med Care Res Rev 2000,57(Suppl 1):146-161.View Article
- Liang W, Burnett CB, Rowland JH, Meropol NJ, Eggert L, Hwang YT, Silliman RA, Weeks JC, Mandelblatt JS: Communication between physicians and older women with localized breast cancer: implications for treatment and patient satisfaction. J Clin Oncol 2002,20(4):1008-1016. 10.1200/JCO.20.4.1008View Article
- Liu Y, Diamant AL, Thind A, Maly RC: Validity of self-reports of breast cancer treatment in low-income, medically underserved women with breast cancer. Breast cancer research and treatment 2010,119(3):745-751. 10.1007/s10549-009-0447-5View Article
- Lubeck DP, Hubert HB: Self-report was a viable method for obtaining health care utilization data in community-dwelling seniors. J Clin Epidemiol 2005,58(3):286-290. 10.1016/j.jclinepi.2004.06.011View Article
- Mandelson MT, LaCroix AZ, Anderson LA, Nadel MR, Lee NC: Comparison of self-reported fecal occult blood testing with automated laboratory records among older women in a health maintenance organization. Am J Epidemiol 1999,150(6):617-621. 10.1093/oxfordjournals.aje.a010060View Article
- Maunsell E, Drolet M, Ouhoummane N, Robert J: Breast cancer survivors accurately reported key treatment and prognostic characteristics. J Clin Epidemiol 2005,58(4):364-369. 10.1016/j.jclinepi.2004.09.005View Article
- Nissen MJ, Tsai ML: Blaes AH. Breast and colorectal cancer survivors' knowledge about their diagnosis and treatment. J Cancer Surviv, Swenson KK; 2011.
- Oberst K, Bradley CJ, Schenk M: Breast and prostate cancer patient's reliability of treatment reporting. J Registry Manag 2009,36(1):12-15.
- Ong LM, Visser MR, Lammes FB, van Der Velden J, Kuenen BC, de Haes JC: Effect of providing cancer patients with the audiotaped initial consultation on satisfaction, recall, and quality of life: a randomized, double-blind study. J Clin Oncol 2000,18(16):3052-3060.
- Paganini-Hill A, Clark LJ: Comparison of patient recall of hormone therapy with physician records. Menopause 2007,14(2):230-234. 10.1097/01.gme.0000235364.50028.b5View Article
- Paskett ED, Tatum CM, Mack DW, Hoen H, Case LD, Velez R: Validation of self-reported breast and cervical cancer screening tests among low-income minority women. Cancer Epidemiol Biomarkers Prev 1996,5(9):721-726.
- Penfold RB, Kullgren JT, Miroshnik I, Galbraith AA, Hinrichsen VL, Lieu TA: Reliability of a patient survey assessing cost-related changes in health care use among high deductible health plan enrollees. BMC Health Serv Res 2011, 11: 133. 10.1186/1472-6963-11-133View Article
- Phillips KA, Milne RL, Buys S, Friedlander ML, Ward JH, McCredie MR, Giles GG, Hopper JL: Agreement between self-reported breast cancer treatment and medical records in a population-based Breast Cancer Family Registry. J Clin Oncol 2005,23(21):4679-4686. 10.1200/JCO.2005.03.002View Article
- Pickney CS, Arnason JA: Correlation between patient recall of bone densitometry results and subsequent treatment adherence. Osteoporos Int 2005,16(9):1156-1160. 10.1007/s00198-004-1818-8View Article
- Posma ER, van Weert JC, Jansen J, Bensing JM: Older cancer patients' information and support needs surrounding treatment: An evaluation through the eyes of patients, relatives and professionals. BMC Nurs 2009, 8: 1. 10.1186/1472-6955-8-1View Article
- Schootman M, Jeffe DB, West MM, Aft R: Self-report by elderly breast cancer patients was an acceptable alternative to surveillance, epidemiology, and end results (SEER) abstract data. J Clin Epidemiol 2005,58(12):1316-1319. 10.1016/j.jclinepi.2005.04.002View Article
- Sohler NL, Coleman SM, Cabral H, Naar-King S, Tobias C, Cunningham CO: Does self-report data on HIV primary care utilization agree with medical record data for socially marginalized populations in the United States? AIDS Patient Care STDS 2009,23(10):837-843. 10.1089/apc.2009.0056View Article
- Strogatz DS, Croft JB, James SA, Keenan NL, Browning SR, Garrett JM, Curtis AB: Social support, stress, and blood pressure in black adults. Epidemiology Cambridge, Mass 1997,8(5)):482-487.View Article
- Takach M: Reinventing Medicaid: state innovations to qualify and pay for patient-centered medical homes show promising results. Health affairs (Project Hope) 2011,30(7):1325-1334. 10.1377/hlthaff.2011.0170View Article
- Turnbull JE, Luther KM: Patient satisfaction report paves way to improved care. QRC Advis 1996,13(1):1-7.
- van Campen C, Sixma H, Friele RD, Kerssens JJ, Peters L: Quality of care and patient satisfaction: a review of measuring instruments. Med Care Res Rev 1995,52(1):109-133. 10.1177/107755879505200107View Article
- Watson PW, McKinstry B: A systematic review of interventions to improve recall of medical advice in healthcare consultations. J R Soc Med 2009,102(6):235-243. 10.1258/jrsm.2009.090013View Article
- Zapka JG, Bigelow C, Hurley T, Ford LD, Egelhofer J, Cloud WM, Sachsse E: Mammography use among sociodemographically diverse women: the accuracy of self-report. Am J Public Health 1996,86(7):1016-1021. 10.2105/AJPH.86.7.1016View Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.