Validation of the Supportive and Palliative Care Indicators Tool in a Geriatric Population
Publication: Journal of Palliative Medicine
Volume 21, Issue Number 2
Abstract
Background: Timely identification of patients in need of palliative care is especially challenging in a geriatric population because of prognostic uncertainty. The Supportive and Palliative Care Indicators Tool (SPICT™) aims at facilitating this identification, yet has not been validated in a geriatric population.
Objective: This study validates the SPICT in a geriatric patient population admitted to the hospital.
Design: This is a retrospective cohort study.
Setting: Subject were patients admitted to the acute geriatric ward of a Belgian university hospital between January 1 and June 30, 2014.
Measurements: Data including demographics, functional status, comorbidities, treatment limitation decision (TLD), and one-year mortality were collected. SPICT was measured retrospectively by an independent assessor.
Results: Out of 435 included patients, 54.7% had a positive SPICT, using a cut-off value of 2 for the general indicators and a cut-off value of 1 for the clinical questions. SPICT-positive patients were older (p = 0.033), more frequently male (p = 0.028), and had more comorbidities (p = 0.015) than SPICT-negative patients. The overall one-year mortality was 32.2%, 48.7% in SPICT-positive patients, and 11.5% in SPICT-negative patients (p < 0.001). SPICT predicted one-year mortality with a sensitivity of 0.841 and a specificity of 0.579. The area under the curve of the general indicators (0.758) and the clinical indicators of SPICT (0.748) did not differ (p = 0.638). In 71.4% of SPICT-positive cases, a TLD was present versus 26.9% in SPICT-negative cases (p < 0.001).
Conclusion: SPICT seems to be valuable for identifying geriatric patients in need of palliative care as it demonstrates significant association with one-year mortality and with clinical survival predictions of experienced geriatricians, as reflected by TLDs given.
Introduction
Offering timely palliative care to patients facing life-threatening illness has proven to be beneficial. It increases satisfaction and quality of life and diminishes depressive feelings, anxiety, and stress in both patients and families.1–3 Unfortunately, this timely identification appears to be a challenge, especially for geriatric patients.4–10 An important reason is that for the latter patients, the trajectory of disability in the last year of life is very heterogeneous, resulting in a nonpredictable course and prognostic uncertainty.10
To identify patients with unmet palliative care needs, several tools were developed over the years.11–15 The Supportive and Palliative Care Indicators Tool (SPICT™) is one of those tools, combining 6 general and 21 clinical questions regarding deteriorating health.11,13 Different versions of SPICT have been published and the April 2015 version is used in this study.16 In contrast to some other tools, such as the multidimensional prognostic index (MPI) or the study of osteoporotic fractures (SOF),14,15 the prognostic value of SPICT in a geriatric population has never been validated before.
SPICT was revised in April 2016 with a decrease in cut-off values and thus a changing focus from prognostication to identifying care needs in a broad patient population.17 Nevertheless the authors believe that prognostication is an indispensable issue when assessing palliative care needs. Offering palliative care to patients who are not yet confronted with impending end of life may result in deprivation from curative care and healing opportunities, as well as the expression of desires that do not reflect true end-of-life wishes. The latter phenomenon is called pseudoparticipation.9 Only when the patient's prognosis is estimated can appropriate and timely medical decisions be delivered.8,18 Although several studies state that the clinical survival predictions of physicians are superior to prognostic tools in the short term,19,20 such prognostic tools may bring an added value for long-term predictions, wherein physicians often tend to be overoptimistic.8
This retrospective cohort study aims at validating the SPICT in a geriatric patient population admitted to the acute geriatric ward, by measuring the ability to predict one-year mortality. The association between the retrospectively calculated SPICT and the presence of a treatment limitation decision (TLD), as a measure for the clinical survival predictions of the geriatrician, is investigated and adds a second validation of SPICT.21–23
Methods
All patients admitted to the acute geriatric ward of a Belgian university hospital for more than one day, between January 1 and June 30, 2014, were included. In an acute geriatric hospital ward, specialized acute care for geriatric patients is offered within a multidisciplinary approach.23 Throughout the hospital, a standardized TLD coding system is used on which fixed categories of nontreatment decisions can be registered. A TLD code 0 means full therapy and a TLD code 1 stands for no cardiopulmonary resuscitation only. A TLD code 2 implies withholding of therapy (e.g., referral to the intensive care unit, upgrading of antibiotics, and dialysis), whereas a TLD code 3 stands for comfort care only with no life-sustaining therapies. As for all other medical interventions or decisions, the Belgian Law on Patients' Rights requires informed consent from the patient or his/her surrogate decision maker in case of incapacity.22
Data regarding demographics, functional status, comorbidities, TLD on admission and discharge, as well as one-year mortality were collected from the electronic patient record. SPICT was measured retrospectively by an independent assessor, who holds medical skills and could rely on the supervision of two geriatricians throughout the entire process of data collection. The general and clinical indicators were mainly found in the comprehensive geriatric assessment (CGA), nursing records and report of multidisciplinary team meetings. Information concerning the one-year mortality was not recorded in the patient file for 158 patients. After telephone contact with patients' general practitioners, the number of cases with unknown one-year mortality was reduced to 25.
Statistical calculations were carried out using SPSS version 23. For continuous data, median and interquartile range were computed. The relationship between continuous data and the dichotomous outcome of SPICT was assessed using Mann–Whitney U tests. Categorical data were assessed using chi-square tests. The exact p values are reported, with statistical significance defined as p ≤ 0.05. To validate the SPICT, a receiver operating characteristic curve was built using SPSS, while the comparison of the areas under the curve (AUCs) was performed using MedCalc.
For this retrospective cohort study, acquisition of informed consent from studied patients was not obliged. The protocol of this study was approved by the ethics committee of the Ghent University Hospital.
Results
Prognostic value of SPICT regarding one-year mortality
Out of the 435 included patients, 238 patients (54.7%) obtained a positive result on SPICT. The distribution of the SPICT-positive indicators is displayed in Table 1. SPICT-positive patients were significantly older (p = 0.033), were more frequently male (p = 0.028), and had more comorbidities (p = 0.015) than patients who had a negative score on SPICT (Table 1). No significant association between SPICT and the reason for admission could be found (p = 0.726). After one year, 48.7% (111/228) of SPICT-positive patients had died, compared with 11.5% (21/182) of SPICT-negative patients (p < 0.001). The overall one-year mortality was 32.2% (132/410).
Total group, n = 435 | SPICT-positive group, n = 238 | SPICT-negative group, n = 197 | p | |
---|---|---|---|---|
Age (median, IQR) | 84, 80–88 | 85, 81–89 | 84, 80–87 | 0.033 |
Gender—female | 267 (61.4%) | 135 (56.7%) | 132 (67.0%) | 0.028 |
Length of stay—days (median, IQR) | 10, 6–15 | 10, 6–16 | 11, 6–14 | 0.127 |
Number of comorbidities (median, IQR) | 4, 3–6 | 5, 3–6 | 4, 3–6 | 0.015 |
One-year mortality | 132 (32.2%) | 111 (48.7%) | 21 (11.5%) | <0.001 |
General indicators of SPICT (first part) | ||||
Poor performance status (>50% of daytime in bed or chair) | 151 (34.7%) | 150 (63.0%) | 1 (0.5%) | <0.001 |
Dependent on others for most care needs because of health problems | 365 (83.9%) | 232 (97.5%) | 133 (67.5%) | <0.001 |
≥2 unplanned hospital admissions in the past six months | 33 (7.6%) | 32 (13.4%) | 1 (0.5%) | <0.001 |
5%–10% weight loss for the past three to six months and/or low BMI | 144 (33.1%) | 125 (52.5%) | 19 (9.6%) | <0.001 |
Persistent troublesome symptoms despite optimal treatment of underlying condition | 76 (17.5%) | 76 (31.9%) | 0 (0.0%) | <0.001 |
Patient asks for supportive and palliative care or treatment withdrawal | 26 (6.0%) | 22 (9.2%) | 4 (2.0%) | 0.002 |
Clinical indicators of SPICT (second part) | ||||
Heart/vascular disease: NYHA III/IV or severe peripheral vascular disease | 70 (16.1%) | 50 (21.0%) | 20 (10.2%) | 0.002 |
Respiratory disease: severe chronic lung disease, long-term oxygen therapy or ventilation for respiratory failure | 29 (6.7%) | 20 (8.4%) | 9 (4.6%) | 0.110 |
Kidney disease: eGFR <30 mL/min, complications of CKD, stopping dialysis | 16 (3.7%) | 8 (3.4%) | 8 (4.1%) | 0.700 |
Liver disease: advanced cirrhosis with complication(s), liver transplant contraindicated | 2 (0.5%) | 2 (0.8%) | 0 (0.0%) | 0.197 |
Neurological disease: speech and/or swallowing problems, recurrent aspiration pneumonia | 218 (50.1%) | 144 (60.5%) | 74 (37.6%) | <0.001 |
Dementia/frailty: incontinence, little social interaction, multiple falls, recurrent infections, help for walking/eating/dressing | 321 (73.8%) | 219 (92.0%) | 102 (51.8%) | <0.001 |
Cancer: progressive metastatic cancer, treatment for symptom control | 25 (5.7%) | 22 (9.2%) | 3 (1.5%) | 0.001 |
SPICT-positive group: ≥2 positive general indicators and ≥1 positive clinical indicator. SPICT-negative group: <2 positive general indicators and/or <1 positive clinical indicator. All percentages display the portion of patients with a specific characteristic compared with the total number of patients in the (sub)population, as shown in the upper row of each column.
BMI, body mass index; CKD, chronic kidney disease; eGFR, estimated glomerular filtration rate; IQR, interquartile range; NYHA, New York Heart Association; SPICT, Supportive and Palliative Care Indicators Tool.
The AUC of the general indicators of SPICT (0.758 with 95% confidence interval [CI]: 0.714–0.799) and the clinical indicators of SPICT (0.748 with 95% CI: 0.703–0.789) did not differ significantly (p = 0.6379) (Table 2). Using a cut-off value of 2 for the general indicators and a cut-off value of 1 for the clinical questions, as performed in the version of April 2015, SPICT can predict the one-year mortality for geriatric patients with a sensitivity of 0.841 and a specificity of 0.579.
Variables of SPICT | No. of indicators present | No. of patients with this no. of indicators presenta | Sensitivity | Specificity | AUC |
---|---|---|---|---|---|
General indicators | 0 | 47 (10.8%) | 1.000 | 0.0 | Total AUC = 0.758 |
1 | 143 (32.9%) | 0.955 | 0.129 | 95% CI: 0.714–0.799 | |
2 | 135 (31.0%) | 0.841 | 0.554 | p = 0.638 | |
3 | 67 (15.4%) | 0.508 | 0.853 | ||
4 | 34 (7.8%) | 0.258 | 0.971 | ||
5 | 9 (2.1%) | 0.061 | 0.996 | ||
6 | 0 (0.0%) | 0.000 | 1.000 | ||
Clinical indicators | 0 | 60 (13.8%) | 1.000 | 0.0 | Total AUC = 0.748 |
1 | 91 (20.9%) | 0.955 | 0.187 | 95% CI: 0.703–0.789 | |
2 | 91 (20.9%) | 0.856 | 0.439 | p = 0.638 | |
3 | 72 (16.6%) | 0.689 | 0.655 | ||
4 | 59 (13.6%) | 0.561 | 0.835 | ||
5 | 31 (7.1%) | 0.333 | 0.935 | ||
6 | 19 (4.4%) | 0.182 | 0.975 | ||
7 | 7 (1.6%) | 0.083 | 0.996 | ||
8 | 5 (1.1%) | 0.030 | 0.996 | ||
9 | 0 (0.0%) | 0.000 | 1.000 | ||
Combination of two general and one clinical indicator(s) (version of April 2015) | 2 + 1 | 238 (54.7%) | 0.841 | 0.579 | |
Combination of one general and one clinical indicator(s) (version of April 2016) | 1 + 1 | 353 (81.1%) | 0.932 | 0.245 |
a
The numbers displayed in this column are absolute and not cumulative.
AUC, area under the curve; CI, confidence interval.
TLDs and the association with SPICT
At discharge, 225 patients (58.6%) disposed of a TLD. Patients with no TLD or a TLD of 0 had a significantly lower one-year mortality (28/194, 14.4%) than patients with a TLD of 1 (11/41, 26.8%) and patients with a TLD of 2 (21/36, 58.3%). All patients with a TLD of 3 had died within one year (16/16, 100%) (p < 0.001). In 71.4% (170/238) of SPICT-positive patients, a TLD was present compared with 26.9% (53/197) in SPICT-negative patients (p < 0.001). We also noticed a significant association between the type of TLD assigned and a SPICT-positive score (p < 0.001) (Fig. 1).
Discussion
To the best of the authors' knowledge, this study is the first to validate SPICT in predicting the one-year mortality and the association with TLDs in a geriatric population. The main finding of this study is that SPICT can predict one-year mortality in a geriatric population with a sensitivity of 0.841 and a specificity of 0.579.
Other prognostic tools, such as the MPI and SOF, show similar sensitivity and specificity when predicting, respectively, the one- and three-year mortalities (sensitivity: ±0.80 and specificity: ±0.40–0.50).14,15 However, the use of SPICT is to be preferred because of several advantages. When there are no opportunities to carry out a CGA, the SPICT shows an equal capacity of prognostication as does the MPI, but using considerably fewer questions. All SPICT questions can be displayed synoptically on one page. In contrast to MPI and SOF, studies have shown that physicians assess the SPICT as convenient and feasible.11,13,24,25
Although both parts of SPICT are equally strong at predicting the one-year mortality, a combination of both parts may bring an added value for physicians who are educated to mainly look for clinical symptoms (second part), rather than functional or general indicators of health (first part). Despite the major complexity of diseases in geriatric patients, 86.2% of patients in the studied acute geriatric unit had at least one positive clinical SPICT indicator. Furthermore, the addition of this second part of SPICT may have increased the specificity of this tool. The combination of cut-off value 2 for the first part and value 1 for the second part is preferred because of the balance between sensitivity and specificity. A rather low specificity, as in the 2015 version, results in identifying some patients who will not die within one year. Offering these patients advance care planning will not cause any harm, therefore, a rather low specificity can be tolerated.1–3 In contrast, the specificity should not be extremely low. In the SPICT version of April 2016, where cut-off values 1 and 1 are used, the specificity is reduced to 0.245 in this patient population. Because of the risk of the so-called phenomenon of pseudoparticipation, the SPICT version of April 2015 is preferred by the authors.9
Given the fact that SPICT was measured retrospectively, it did not function as a guide to assign TLDs, but rather as a measure for the clinical survival predictions of experienced geriatricians. In 71.4% of cases, geriatricians assigned TLDs based on their own clinical knowledge and experience. The added value of SPICT in helping experienced physicians on the acute geriatric ward to identify patients in need of palliative care requires further investigation, as well as the possible added value for physicians less experienced in care of the older person.
A limitation of this study is the retrospective collection of data leading to the possibility of missing information. Future research should be multicentric, prospective, and should also include hospital wards where geriatric patients are not cared for by geriatric experts.
Conclusion
SPICT seems to be a valuable tool for identifying geriatric patients in need of palliative care as it demonstrates significant association with one-year mortality and with clinical survival predictions of experienced geriatricians, as reflected by TLDs given. SPICT predicted the one-year mortality of geriatric patients with a sensitivity of 0.841 and a specificity of 0.579 in this study. These values are comparable with those by prognostic tools commonly used in geriatric medicine, such as MPI and SOF. Because experienced geriatricians were able to identify most patients with limited prognosis based on their clinical survival predictions, the added value of SPICT on an acute geriatric ward can be questioned. The added value of SPICT on other hospital wards and in primary care needs to be further investigated.
Acknowledgments
We express our gratitude to all team members of the geriatric ward of the Ghent University Hospital for their support.
References
1.
Temel JS, Greer JA, Muzikansky A, et al.: Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med 2010;363:733–742.
2.
Wright AA, Zhang B, Ray A, et al.: Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. JAMA 2008;300:1665–1673.
3.
Detering KM, Hancock AD, Reade MC, et al.: The impact of advance care planning on end of life care in elderly patients: Randomised controlled trial. BMJ 2010;340:c1345.
4.
Murray SA, Kendall M, Boyd K, et al.: Illness trajectories and palliative care. BMJ 2005;330:1007–1011.
5.
Boyd K, Murray SA: Recognising and managing key transitions in end of life care. BMJ 2010;341:c4863.
6.
Coventry PA, Grande GE, Richards DA, et al.: Prediction of appropriate timing of palliative care for older adults with non-malignant life-threatening disease: A systematic review. Age Ageing 2005;34:218–227.
7.
Vissers KC, van den Brand MW, Jacobs J, et al.: Palliative medicine update: A multidisciplinary approach. Pain Pract 2013;13:576–588.
8.
Billings JA, Bernacki R: Strategic targeting of advance care planning interventions: The Goldilocks phenomenon. JAMA Intern Med 2014;174:620–624.
9.
Piers RD, van Eechoud IJ, Van Camp S, et al.: Advance care planning in terminally ill and frail older persons. Patient Educ Couns 2013;90:323–329.
10.
Gill TM, Gahbauer EA, Han L, et al.: Trajectories of disability in the last year of life. N Engl J Med 2010;362:1173–1180.
11.
Walsh RI, Mitchell G, Francis L, et al.: What diagnostic tools exist for the early identification of palliative care patients in general practice? A systematic review. J Palliat Care 2015;31:118–123.
12.
Weissman DE, Meier DE: Identifying patients in need of a palliative care assessment in the hospital setting: A consensus report from the Center to Advance Palliative Care. J Palliat Med 2011;14:17–23.
13.
Highet G, Crawford D, Murray SA, et al.: Development and evaluation of the Supportive and Palliative Care Indicators Tool (SPICT): A mixed-methods study. BMJ Support Palliat Care 2014;4:285–290.
14.
Ensrud KE, Ewing SK, Cawthon PM, et al.: A comparison of frailty indexes for the prediction of falls, disability, fractures, and mortality in older men. J Am Geriatr Soc 2009;57:492–498.
15.
De Luca E, Perissinotto E, Fabris L, et al.: Short- and longer-term predictive capacity of the multidimensional prognostic index: The timing of the assessment is of no consequence. Arch Gerontol Geriatr 2015;61:458–463.
16.
<SPICT_APRIL2015.pdf>: www.spict.org.uk/the-spict (last accessed October 26, 2015).
17.
<SPICT_April2016.pdf>: www.spict.org.uk/the-spict (last accessed July 2, 2016).
18.
Pilotto A, Ferrucci L, Franceschi M, et al.: Development and validation of a Multidimensional Prognostic Index for one-year mortality from comprehensive geriatric assessment in hospitalized older patients. Rejuvenation Res 2008;11:151–161.
19.
Sinuff T, Adhikari NK, Cook DJ, et al.: Mortality predictions in the intensive care unit: Comparing physicians with scoring systems. Crit Care Med 2006;34:878–885.
20.
Brabrand M, Hallas J, Knudsen T: Nurses and physicians in a medical admission unit can accurately predict mortality of acutely admitted patients: A prospective cohort study. PLoS One 2014;9:e101739.
21.
Fritz Z, Fuld J: Ethical issues surrounding do not attempt resuscitation orders: Decisions, discussions and deleterious effects. J Med Ethics 2010;36:593–597.
22.
Piers RD, Benoit DD, Schrauwen WJ, et al.: Do-not-resuscitate decisions in a large tertiary hospital: Differences between wards and results of a hospital-wide intervention. Acta Clin Belg 2011;66:116–122.
23.
De Gendt C, Bilsen J, Vander Stichele R, et al.: [Do-not-resuscitate policy on acute geriatric wards in Flanders, Belgium]. Tijdschr Gerontol Geriatr 2007;38:246–254.
24.
<Het gebruik van een nieuw instrument PICT tool.pdf>: www.palliatief.be/pict (last accessed February 5, 2017).
25.
Warnier RM, van Rossum E, van Velthuijsen E, et al.: Validity, reliability and feasibility of tools to identify frail older patients in inpatient hospital care: A systematic review. J Nutr Health Aging 2016;20:218–230.
Information & Authors
Information
Published In
Journal of Palliative Medicine
Volume 21 • Issue Number 2 • February 2018
Pages: 220 - 224
PubMed: 28792787
Copyright
Copyright 2018, Mary Ann Liebert, Inc.
History
Published in print: February 2018
Published online: 1 February 2018
Published ahead of print: 9 August 2017
Accepted: 12 July 2017
Topics
Authors
Author Disclosure Statement
No competing financial interests exist.
Metrics & Citations
Metrics
Citations
Export Citation
Export citation
Select the format you want to export the citations of this publication.
View Options
View options
PDF/EPUB
View PDF/ePubGet Access
Access content
To read the fulltext, please use one of the options below to sign in or purchase access.⚠ Society Access
If you are a member of a society that has access to this content please log in via your society website and then return to this publication.