Advertisement
Original Study| Volume 22, ISSUE 2, e169-e179, March 2021

Download started.

Ok

Patient-Reported Outcome Measures Used in Routine Care Predict for Survival at Disease Progression in Patients With Advanced Lung Cancer

Open AccessPublished:October 15, 2020DOI:https://doi.org/10.1016/j.cllc.2020.09.014

      Abstract

      Background

      Patient-reported outcome (PRO) measures have been increasingly implemented in routine care to aid in clinical decision-making. However, the prognostic value of PRO measures as a tool for decision making is not easily interpreted by clinicians. Our aims were to explore the prognostic value of PRO measures at disease progression and the changes in PRO measures between treatment start (baseline) and disease progression.

      Patients and Methods

      Since 2014, patients with lung cancer have completed an electronic version of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaires C30 and LC-13 before every outpatient visit at the Department of Oncology, Hospital Unit West, Jutland, Denmark. The patients’ responses were used in routine care. Patients receiving palliative antineoplastic treatment were eligible for analysis if the questionnaire had been completed at the initiation of first-line treatment and at disease progression. The prognostic value of the scores was evaluated using a Cox proportional hazard model. A P value < .01 was considered statistically significant.

      Results

      A total of 94 screened patients were included. At disease progression, survival could be predicted from the absolute score of the global health scale, 3 functional scales (physical, role, emotional), and 7 symptom scales (fatigue, pain, dyspnea, hemoptysis, lung cancer dyspnea, chest pain). In addition, changes in hemoptysis, dysphagia, dyspnea, and chest pain predicted for survival at progression.

      Conclusion

      PRO measures used in routine care can provide clinicians with relevant prognostic information about patients with lung cancer at disease progression. These results show the potential value of PRO measures when used in clinical decision-making.

      Keywords

      Introduction

      Lung cancer is the leading cause of cancer-related deaths worldwide.

      Ferlay J, Ervik M, Lam F, et al. Global Cancer Observatory: Cancer Today. Lyon, France: International Agency for Research on Cancer.

      Despite recent progress in treatment, the prognosis has remained poor, and attention to palliative care should still have high priority.
      • Engholm G.
      • Ferlay J.
      • Christensen N.
      • et al.
      NORDCAN: Cancer Incidence, Mortality, Prevalence and Survival in the Nordic Countries, version 7.3 (08.07.2016). Association of the Nordic Cancer Registries. Danish Cancer Society.
      The early initiation of palliative care has previously shown to prolong survival, improve quality of life (QoL), and lead to less aggressive care at the end of life for patients with lung cancer.
      • Temel J.S.
      • Greer J.A.
      • Muzikansky A.
      • et al.
      Early palliative care for patients with metastatic non–small-cell lung cancer.
      In this context, the point of disease progression is a key time in the course of the disease. Disease progression means that the current treatment has stopped being efficient, and important decisions are required concerning whether to start second-line antineoplastic treatment or withdraw active treatment and transition to palliative care. Such essential decisions must involve reflections on the patient’s perceived symptoms and individual preferences.
      In routine care, clinicians rate the patient’s functional level using the performance status score. This clinician-rated score is used to guide decision-making because it has been shown to correlate closely with prognosis and antineoplastic treatment tolerance.
      • Simmons C.P.
      • Koinis F.
      • Fallon M.T.
      • et al.
      Prognosis in advanced lung cancer—a prospective study examining key clinicopathological factors.
      • Buccheri G.
      • Ferrigno D.
      • Tamburini M.
      Karnofsky and ECOG performance status scoring in lung cancer: a prospective, longitudinal study of 536 patients from a single institution.
      • Capewell S.
      • Sudlow M.F.
      Performance and prognosis in patients with lung cancer.
      However, clinicians tend to underestimate or overlook symptoms during routine consultations, which can impair such clinician-rated assessments of patients.
      • Atkinson T.M.
      • Dueck A.C.
      • Satele D.V.
      • et al.
      Clinician vs patient reporting of baseline and postbaseline symptoms for adverse event assessment in cancer clinical trials.
      ,
      • Pakhomov S.V.
      • Jacobsen S.J.
      • Chute C.G.
      • Roger V.L.
      Agreement between patient-reported symptoms and their documentation in the medical record.
      The use of patient-reported outcome (PRO) measures could address some of these issues. When used in routine care, these measures have been shown to improve communication, patient and clinician satisfaction, symptom control, and, even, survival.
      • Kotronoulas G.
      • Papadopoulou C.
      • Simpson M.F.
      • McPhelim J.
      • Mack L.
      • Maguire R.
      Using patient-reported outcome measures to deliver enhanced supportive care to people with lung cancer: feasibility and acceptability of a nurse-led consultation model.
      • Kotronoulas G.
      • Kearney N.
      • Maguire R.
      • et al.
      What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials.
      • Denis F.
      • Basch E.
      • Septans A.-L.
      • et al.
      Two-year survival comparing web-based symptom monitoring vs routine surveillance following treatment for lung cancer.
      • Basch E.
      • Deal A.M.
      • Dueck A.C.
      • et al.
      Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment.
      • Rotenstein L.S.
      • Huckman R.S.
      • Wagle N.W.
      Making patients and doctors happier—the potential of patient-reported outcomes.
      Thus, PRO measures have been increasingly being implemented in many oncology departments throughout the world.
      PRO measures collected from clinical trials have also been shown to have prognostic value for individual patient.
      • Zikos E.
      • Ghislain I.
      • Coens C.
      • et al.
      Health-related quality of life in small-cell lung cancer: a systematic review on reporting of methods and clinical issues in randomised controlled trials.
      • Gotay C.C.
      • Kawamoto C.T.
      • Bottomley A.
      • Efficace F.
      The prognostic significance of patient-reported outcomes in cancer clinical trials.
      • Montazeri A.
      Quality of life data as prognostic indicators of survival in cancer patients: an overview of the literature from 1982 to 2008.
      • Mierzynska J.
      • Piccinin C.
      • Pe M.
      • et al.
      Prognostic value of patient-reported outcomes from international randomised clinical trials on cancer: a systematic review.
      In 1 study, the prognostic value was even better than the clinician-assessed performance status and disease stage for patients with lung cancer.
      • Movsas B.
      • Moughan J.
      • Sarna L.
      • et al.
      Quality of life supersedes the classic prognosticators for long-term survival in locally advanced non-small-cell lung cancer: an analysis of RTOG 9801.
      Although PRO measures collected as endpoints in clinical trials have been widely analyzed, less attention has been given to confirm their prognostic value when used as a decision-making tool to predict the individual patient’s survival during routine care. Such information could help guide clinicians and patients to decide which treatment strategy would be best. Also, to the best of our knowledge, no studies have used disease progression as the key point in time to study the PRO measures used for clinical decision-making.
      The present study explored the prognostic value of PRO measures completed at disease progression and changes in the PRO measures between treatment start (baseline) and disease progression.

      Patients and Methods

      PRO Measures in Routine Care

      Electronic PRO measures have been applied in routine care in the Department of Oncology, Hospital Unit West Jutland, Denmark, since 2014. All patients with lung cancer are encouraged to complete an electronic version of the European Organization for Research and Treatment of Cancer (EORTC) quality of life questionnaires (QLQs) C30 and LC13 before every outpatient visit.
      • Aaronson N.K.
      • Ahmedzai S.
      • Bergman B.
      • et al.
      The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
      ,
      • Bergman B.
      • Aaronson N.K.
      • Ahmedzai S.
      • Kaasa S.
      • Sullivan M.
      The EORTC QLQ-LC13: a modular supplement to the EORTC core quality of life questionnaire (QLQ-C30) for use in lung cancer clinical trials.
      The PRO measures were captured using the AmbuFlex software from home via the homepage or on attendance at the department using a tablet.
      • Schougaard L.M.V.
      • Larsen L.P.
      • Jessen A.
      • et al.
      AmbuFlex: tele-patient-reported outcomes (telePRO) as the basis for follow-up in chronic and malignant diseases.
      ,
      • Hjollund N.H.I.
      Fifteen years’ use of patient-reported outcome measures at the group and patient levels: trend analysis.
      Symptom severity and functional impairment are represented by color bars to the clinicians in the electronic medical records, providing an easy overview of longitudinal symptom development. This information is used by clinicians for decision support and symptom monitoring. All PRO data analyzed in the present study were collected prospectively during routine care.

      Patients

      The patients screened for eligibility included patients with lung cancer who had received first-line palliative antineoplastic treatment in the Department of Oncology, Hospital Unit West Jutland, from 2014 to 2018, with ≥1 completed PRO questionnaire available.
      The inclusion criteria were (1) non–small-cell lung cancer and small-cell lung cancer (SCLC); (2) stage III or IV disease in first-line palliative antineoplastic treatment within the defined study period, and (3) PRO questionnaire completion at the initiation of first-line antineoplastic therapy and at the date of disease progression.
      Patients were excluded from the analyses if (1) the date of disease progression was uncertain, (2) the questionnaire had been completed > 14 days before the date of determined disease progression, or (3) the questionnaire had been completed after the results of the computed tomography scan had been communicated. The latter criterion was used to avoid having the assessments be influenced by the patient’s knowledge of the scan result showing disease progression before completion.
      The electronic medical records of all screened patients were reviewed for clinical information. The baseline data included age, sex, stage, pathologic features, treatment, performance status, and date of treatment initiation. The date of progressive disease was obtained from the electronic medical records, and date of death was obtained from the Danish Central Personal Registry (data extracted July 2, 2019).

      Health-Related QLQs

      The EORTC QLQ-C30, version 3.0, and the lung cancer-specific QLQ-LC13 questionnaires have proven psychometric properties with high validity and reliability for lung cancer patients.
      • Aaronson N.K.
      • Ahmedzai S.
      • Bergman B.
      • et al.
      The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
      ,
      • Bergman B.
      • Aaronson N.K.
      • Ahmedzai S.
      • Kaasa S.
      • Sullivan M.
      The EORTC QLQ-LC13: a modular supplement to the EORTC core quality of life questionnaire (QLQ-C30) for use in lung cancer clinical trials.
      The QLQ-C30 is a multidimensional 30-item questionnaire consisting of a global health score, 5 function domains (physical, role, cognitive, emotional, social), 8 symptom scales (fatigue, pain, nausea and vomiting, dyspnea, insomnia, appetite loss, constipation, diarrhea), and an item about financial difficulties. The QLQ-LC13 has 10 additional lung cancer-specific symptom scales (lung cancer dyspnea, cough, hemoptysis, sore mouth, dysphagia, peripheral neuropathy, alopecia, pain in chest, arm, or shoulder). All items are graded by the severity experienced during the previous week, and most use a 4-point scale (1, not at all; 2, a little; 3, quite a bit; and 4, very much). The scores were converted to a health-related (HR)QoL scale ranging from 0 to 100 points according to the recommendations from the EORTC scoring manual.
      • Fayers P.M.
      • Aaronson N.K.
      • Bjordal K.
      • Groenvold M.
      • Curran D.
      • Bottomley A.
      EQ of Life Group. EORTC QLQ-C30 Scoring Manual, 3rd ed. 2001.
      A higher global health score and function domain scores indicate better function, and lower scores in the symptom scales indicate less severity.
      EORTC Quality of Life Group
      EORTC QLQ-LC13 Scoring Manual. 2001.

      Statistical Analysis

      To describe the cohort, the patient characteristics were registered at baseline, defined as the date of first-line treatment initiation. Survival was measured at 2 points: first, as median survival and the interval to progression measured from baseline; and second, as overall survival measured from disease progression to death.
      The HRQoL measures were analyzed as continuous variables in the longitudinal mean comparison. A paired t test was used to compare the longitudinal group mean HRQoL score changes between treatment start and disease progression.
      • Donneau A.F.
      • Mauer M.
      • Coens C.
      • Bottomley A.
      • Albert A.
      Longitudinal quality of life data: a comparison of continuous and ordinal approaches.
      ,
      • Fradette K.
      • Keselman H.J.
      • Lix L.
      • Algina J.
      • Wilcox R.R.
      Conventional and robust paired and independent-samples t tests: type I error and power rates.
      A score change of > 10 points was considered the minimal important difference and was used to classify symptom development as deteriorating, stable, or improving.
      • Osoba D.
      • Rodrigues G.
      • Myles J.
      • Zee B.
      • Pater J.
      Interpreting the significance of changes in health-related quality-of-life scores.
      The prognostic value of the HRQoL scores was evaluated using the Cox proportional hazard model and presented using Kaplan-Meier plots. For the overall survival analysis, patients were dichotomized into 2 categories: patients with symptom deterioration and patients with symptom improvement or stability, measured from treatment initiation to progression. Univariate analyses of overall survival stratified by the change in HRQoL scores were performed for all scales. A median split was used to dichotomize the patients to assess the prognostic value of the absolute HRQoL scores.
      To reduce the risk of false-positive results through multiple testing, P < .01 was considered statistically significant. All analyses were performed using the STATA software package, version 16 (StataCorp, College Station, TX).

      Study Approval

      The present study was conducted as a quality assurance project and internally approved by the department management. According to Danish law, such projects do not require research approval from the health authorities.
      Danish Patient Safety Authority
      Patient record information for research [in Danish].

      Results

      Patients

      Of the 584 screened patients, 94 met the inclusion criteria and were included in the analyses. The reasons for noneligibility are shown in Figure 1. The most common reason for noneligibility was a missing PRO report at disease progression (n = 263). The date of progressive disease could not be determined for 120 patients, either because disease progression had not yet occurred at the study cutoff or because the exact date could not be extracted from the medical records.
      Figure thumbnail gr1
      Figure 1Flow Chart of Patient Selection. ∗Patients Who Completed the Questionnaire Later Than the Day of First Treatment Were Excluded From the Analyses. ∗∗Patients Who Completed the Questionnaire > 2 Weeks Before the Ambulatory Visit or After the Computed Tomography Results Had Been Communicated Were Excluded From the Analyses
      The baseline patient characteristics are listed in Table 1. The median age was 70 years, and 62.8% of the patients were male. For patients who were not eligible for analysis, the median age was 69 years (interquartile range, 65-75 years), and 55% were male.
      Table 1Patient Baseline Characteristics
      CharacteristicValue
      Age, y
       Median70
       IQR64-74
      Gender, n (%)
       Male59 (62.8)
       Female35 (37.2)
       Total94 (100.0)
      Histologic type, n (%)
       SCLC22 (23.4)
       NSCLC72 (76.6)
      Stage, n (%)
       IIIb3 (3.2)
       IV91 (96.8)
      First-line treatment, n (%)
       Chemotherapy80 (85.1)
       Targeted therapy5 (5.3)
       Immunotherapy7 (7.4)
       Palliative radiotherapy2 (2.1)
      Performance status at baseline, n (%)
       039 (41.5)
       138 (40.4)
       25 (5.3)
       33 (3.2)
       40 (0)
       NA9 (9.6)
      Time to progression, mo
       Median5.9
       IQR3.0-8.4
      Survival from baseline, mo
       Median10.5
       IQR6.6-19.1
      Abbreviations: IQR = interquartile range; NA = not available; NSCLC = non–small-cell lung cancer; SCLC = small cell lung cancer.
      Of the 94 patients included in the present study, all had received palliative antineoplastic treatment, and most patients (96.8%) had had stage IV lung cancer. The vast majority of patients (85.1%) had received chemotherapy. The median time from treatment initiation to disease progression was 5.9 months. The median overall survival from the initiation of first-line treatment was 10.5 months. At the time of data extraction, 88 patients (93.6%) had died.

      Longitudinal Changes in HRQoL Scores

      The longitudinal deteriorations in the group mean scores between baseline and disease progression were observed in several HRQoL scales (Table 2). In contrast, no scale scores had improved significantly in the study period. The functional scales were the most sensitive to the changes between first-line treatment and disease progression. The functional scales showing the largest mean deteriorations were physical (−10.5; 95% confidence interval [CI], −14.8 to −6.1; P < .001), role (−11; 95% CI, −17.2 to −4.8; P < .001), and social functioning (−9.8; 95% CI, −15.5 to −4.0; P = .001). The global health score had deteriorated by 7.3 points (95% CI, −12.8 to −1.9; P = .009). For the symptom scales, fatigue (11.5; 95% CI, 6.0-17.0; P < .001) and pain (12.0; 95% CI, 5.5-18.5; P < .001) had the largest mean deterioration. The group mean worsening for nausea and vomiting (4.3; 95% CI, 1.3-7.3; P = .005), alopecia (12.3; 95% CI, 6.2-18.4; P < .001), peripheral neuropathy (9.1, 95% CI, 4.5-13.7; P < .001), and sore mouth (6.2; 95% CI, 1.6-10.7; P = .009) most likely represented adverse effects from chemotherapy. The symptom baseline scores were comparable across gender and histologic type. However, the deteriorations were larger in the non–small-cell lung cancer group than in the SCLC group. Also, we observed that most patients (data not shown) with SCLC experienced initial chemotherapy-induced symptom improvement that later deteriorated toward the onset of progression. For the SCLC group, this resulted in a smaller mean difference between treatment start and progression.
      Table 2Mean HRQoL Scores and Group Changes in Scores From Baseline to Progression (n = 94)
      ScaleBaselineProgressionChange
      Paired t test used to compare only items without missing data.
      Mean ± SDMissingMean ± SDMissingMean Difference95% CIP Value
      QLQ-C30 version 3.0
       Global health status
      A high score indicates a better outcome.
      59.1 ± 26.0251.7 ± 24.20−7.3−12.8 to −1.9.009
      Statistically significant (P < .01).
       Functional scales
      A high score indicates a better outcome.
      Physical functioning75.2 ± 22.7064.7 ± 26.00−10.5− 14.8 to −6.1<.001
      Statistically significant (P < .01).
      Role functioning67.2 ± 34.9056.2 ± 33.40−11.0−17.2 to −4.8<.001
      Statistically significant (P < .01).
      Emotional functioning74.7 ± 18.8273.0 ± 20.30−2.4−6.1 to 1.4.214
      Cognitive functioning81.7 ± 21.9176.8 ± 24.20−5.2−9.3 to −1.1.014
      Social functioning84.1 ± 24.2274.6 ± 28.40−9.8−15.5 to −4.0.001
      Statistically significant (P < .01).
       Symptom scales
      A high score indicates a worse outcome.
      Fatigue36.9 ± 27.7148.3 ± 27.5011.56.0 to 17.0<.001
      Statistically significant (P < .01).
      Nausea and vomiting4.7 ± 10.818.9 ± 16.904.31.3 to 7.3.005
      Pain24.2 ± 28.4136.2 ± 31.7012.05.5 to 18.5<.001
      Statistically significant (P < .01).
      Dyspnea32.6 ± 33.1039.4 ± 33.506.7−0.6 to 14.1.071
      Insomnia26.5 ± 30.5125.5 ± 29.90−0.7−8.0 to 6.6.846
      Appetite loss22.2 ± 29.2122.7 ± 31.000.7−6.7 to 8.1.847
      Constipation14.0 ± 27.5111.3 ± 19.30−2.5−9.3 to 4.3.466
      Diarrhea7.5 ± 17.1110.3 ± 19.602.9−2.2 to 7.9.260
      Financial difficulties3.3 ± 11.125.0 ± 16.201.8−1.2 to 4.8.227
      QLQ-LC13
       Symptom scales
      A high score indicates a worse outcome.
      Lung cancer dyspnea25.2 ± 23.3231.0 ± 25.705.31.3 to 9.4.011
      Coughing39.1 ± 31.5239.7 ± 28.600.7−6.2 to 7.6.834
      Hemoptysis4.0 ± 12.923.2 ± 11.00−0.7−4.3 to 2.8.685
      Sore mouth3.3 ± 12.229.9 ± 23.406.21.6 to 10.7.009
      Statistically significant (P < .01).
        Dysphagia8.7 ± 21.5213.5 ± 25.505.1−0.2 to 10.4.061
      Peripheral neuropathy3.6 ± 12.6212.4 ± 21.309.14.5 to 13.7<.001
      Statistically significant (P < .01).
      Alopecia0.4 ± 3.5212.4 ± 28.9012.36.2 to 18.4<.001
      Statistically significant (P < .01).
      Pain in chest20.7 ± 29.2223.4 ± 27.602.5−2.9 to 8.0.357
      Pain in arm or shoulder17.8 ± 27.7221.1 ± 31.412.9−4.4 to 10.2.427
      Pain in other parts21.2 ± 29.2325.2 ± 29.604.0−2.3 to 10.4.212
      Abbreviations: CI = confidence interval; HRQoL = health-related quality of life, QLQ = quality of life questionnaire; SD = standard deviation.
      a Paired t test used to compare only items without missing data.
      b A high score indicates a better outcome.
      c Statistically significant (P < .01).
      d A high score indicates a worse outcome.
      How the HRQoL scores for the individual patients changed between treatment start and disease progression are shown in Figure 2, including the development of selected scores of high clinical importance in the palliative treatment of patients with lung cancer. Each line represents an individual patient. The data in Figure 2 show that a large proportion of patients experience symptom deterioration through first line treatment to disease progression, with fewer patients experiencing symptom improvement or stable symptoms. Also, the changes were larger (steeper slopes) for the patients who had experienced deterioration compared with that for patients with improvement. Overall, these observations have confirmed that many patients experience declining health on several scales at disease progression. Of the presented symptoms, the proportion of patients experiencing deterioration was pronounced for global health status, physical functioning, pain, fatigue and dyspnea,. The number of patients with worsening dysphagia was smaller yet highly severe for those experiencing it.
      Figure thumbnail gr2
      Figure 2Individual Changes in Health-related Quality of Life (HRQoL) Scores Between Treatment Start and Disease Progression. The Time of Confirmed Disease Progression Is Shown on the Right. The Lines Symbolize an Individual Patient's Development in HRQoL Scores From Treatment Start to Disease Progression. The Horizontal Length of the Line Represents the Duration From Treatment Start to Disease Progression. The Slope of the Lines Describes the Altitude of Change in Severity From Treatment Start to Disease Progression. The Colors Illustrate the Direction of Change in the Scores Between Treatment Start and Disease Progression: Red Diamonds, Deterioration; Orange Triangles, Stable Disease; Green Squares, Improvement; Dashed Lines, Minimal Important Difference (>10-point Change From Baseline to Progression). ∗One Patient Was Excluded From the Visual Presentation Because of Long Progression-free Survival

      Prognostic Value of Absolute Scores at Disease Progression

      The hazard ratios (HRs) computed from the absolute HRQoL scores are presented in Table 3. Three of the four scales providing statistically significant prognostic information according to the HRQoL score changes were also significant when assessed using the absolute scores: dyspnea, hemoptysis and pain in the chest. The absolute score of dysphagia offered no significant information at progression (P = .025). Additionally, 7 other HRQoL scales predicted for survival using the absolute score. These scales were global health, 3 functional scales (physical, role, emotional), and 3 additional symptom scales (fatigue, pain, lung cancer dyspnea; Table 3). Symptoms that are known side effects of chemotherapy (nausea and vomiting, sore mouth, neuropathy, alopecia) were not prognostic for survival.
      Table 3Univariate Cox Regression Analysis of Overall Survival Stratified by HRQoL Score
      ScaleAbsolute Score at Disease Progression
      Absolute score stratified by the median score.
      Individual Change From Baseline to Progression
      Change of >10 points from baseline to progression recorded as improved/stable for median scores or less and deteriorated for scores greater than the median.
      Patients, nMedian OS,
      OS measured from disease progression.
      mo
      HR95% CIP Value
      Log-rank test.
      ChangePatients, nMedian OS,
      OS measured from disease progression.
      mo
      HR95% CIP value
      Log-rank test.
      Global health status1.831.18-2.84.006
      Statistically significant (P < .01).
      1.120.72-1.73.610
       ≤50543.6Improved/stable535.2
       >50
      Better function or less severity.
      406.2Deterioration394.1
      Physical functioning1.941.25-3.00.002
      Statistically significant (P < .01).
      1.621.05-2.48.026
       ≤73.3523.7Improved/stable476.2
       >73.3
      Better function or less severity.
      427.5Deterioration473.7
      Role functioning2.241.38-3.62.001
      Statistically significant (P < .01).
      1.120.73-1.17.590
       ≤66.7643.7Improved/stable445.2
       >66.7
      Better function or less severity.
      306.6Deterioration504.5
      Emotional functioning1.921.23-3.00.004
      Statistically significant (P < .01).
      1.670.99-2.82.053
       ≤50553.7Improved/stable725.2
       >50
      Better function or less severity.
      397.3Deterioration204.0
      Cognitive functioning1.500.97-2.32.0691.380.88-2.16.160
       ≤83.3574.4Improved/stable615.1
       >83.3
      Better function or less severity.
      376.2Deterioration324.1
      Social functioning1.730.37-0.89.0121.360.88-2.12.166
       ≤83.3543.4Improved/stable575.4
       >83.3
      Better function or less severity.
      406.6Deterioration352.9
      Fatigue2.061.12-2.68.001
      Statistically significant (P < .01).
      1.280.83-1.96.263
       ≤44.4
      Better function or less severity.
      546.6Improved/stable436.0
       >44.4402.9Deterioration504.0
      Nausea and vomiting1.350.86-2.12.191.260.79-2.02.326
       0
      Better function or less severity.
      645.1Improved/stable675.1
       >0303.7Deterioration264.5
      Pain1.941.24-3.02.003
      Statistically significant (P < .01).
      1.490.97-2.29.067
       ≤33.3
      Better function or less severity.
      606.0Improved/stable506.0
       >33.3342.8Deterioration433.7
      Dyspnea2.131.36-3.32.001
      Statistically significant (P < .01).
      1.901.21-2.98.004
      Statistically significant (P < .01).
       ≤33.3
      Better function or less severity.
      616.0Improved/stable636.0
       >33.3332.9Deterioration312.1
      Insomnia1.731.13-2.65.0111.861.13-3.07.013
       ≤16.7
      Better function or less severity.
      476.2Improved/stable726.0
       >16.7473.7Deterioration212.6
      Appetite loss1.40.92-2.15.1171.490.92-2.42.099
       0
      Better function or less severity.
      546.0Improved/stable695.2
       >0404.0Deterioration244.0
      Constipation1.390.87-2.21.1691.430.84-2.44.190
       0
      Better function or less severity.
      675.4Improved/stable745.4
       >0274.0Deterioration192.5
      Diarrhea1.390.86-2.24.1781.300.78-2.16.319
       0
      Better function or less severity.
      705.2Improved/stable735.2
       >0242.6Deterioration202.6
      Financial difficulties1.330.69-2.59.3911.100.48-2.53.822
       0
      Better function or less severity.
      845.0Improved/stable865.0
       >0102.8Deterioration65.2
      Lung cancer dyspnea1.881.22-2.89.004
      Statistically significant (P < .01).
      1.551.00-2.39.046
       ≤22.2556.2Improved/stable536.0
       >22.2393.2Deterioration393.4
      Coughing1.120.69-1.82.6491.210.76-1.92.418
       ≤33.3
      Better function or less severity.
      695.2Improved/stable645.0
       >33.3253.6Deterioration285.0
      Hemoptysis3.641.70-7.81< .001
      Statistically significant (P < .01).
      3.291.47-7.37.002
      Statistically significant (P < .01).
       0
      Better function or less severity.
      865.2Improved/stable855.2
       >081.8Deterioration71.9
      Sore mouth1.160.68-1.97.5920.940.52-1.70.833
       0
      Better function or less severity.
      765.1Improved/stable785.0
       >0183.7Deterioration145.0
      Dysphagia1.71.06-2.69.0252.541.47-4.37.001
      Statistically significant (P < .01).
       0
      Better function or less severity.
      685.3Improved/stable745.4
       >0262.5Deterioration182.0
      Peripheral neuropathy1.20.76-1.90.441.250.76-2.05.377
       0
      Better function or less severity.
      665.0Improved/stable695.2
       >0284.5Deterioration234.0
      Alopecia0.760.45-1.30.310.770.45-1.32.340
       0
      Better function or less severity.
      764.5Improved/stable744.5
       >0186.2Deterioration186.2
      Pain in chest2.181.40-3.38< .001
      Statistically significant (P < .01).
      1.941.17-3.22.008
      Statistically significant (P < .01).
       0
      Better function or less severity.
      486.2Improved/stable715.3
       >0463.2Deterioration211.9
      Pain in arm or shoulder1.220.79-1.90.3741.380.83-2.30.207
       0
      Better function or less severity.
      595.0Improved/stable705.0
       > 0344.5Deterioration215.0
      Pain in other parts1.310.86-2.00.2040.880.53-1.44.597
       ≤16.7
      Better function or less severity.
      476.0Improved/stable675.0
       >16.7473.7Deterioration244.4
      Abbreviations: CI = confidence interval; HR = hazard ratio; HRQoL = health-related quality of life; OS = overall survival.
      a Absolute score stratified by the median score.
      b Change of >10 points from baseline to progression recorded as improved/stable for median scores or less and deteriorated for scores greater than the median.
      c OS measured from disease progression.
      d Log-rank test.
      e Statistically significant (P < .01).
      f Better function or less severity.

      Prognostic Value of Changes in HRQoL Scores From Baseline to Progression

      Changes in 4 HRQoL scales from treatment start to disease progression were associated with survival (Table 3). This was shown for patients with deterioration in hemoptysis (HR, 3.29; 95% CI, 1.47-7.37; P = .002), dysphagia (HR, 2.54; 95% CI, 1.47-4.37; P = .001), dyspnea (HR, 1.90; 95% CI, 1.21-2.98; P = .004), and pain in the chest (HR, 1.94; 95% CI, 1.17-3.22; P = .008). Survival measured from disease progression is presented using Kaplan-Meier curves in Figure 3 for selected scales. The median survival was more than doubled if no deterioration had occurred compared with that for patients who had experienced symptom worsening. At disease progression, ≥ 50% of all patients had experienced deterioration in terms of physical function, role function, and/or fatigue.
      Figure thumbnail gr3
      Figure 3Overall Survival From Disease Progression Stratified by Changes in Health-related Quality of Life Score. Deterioration, Symptom Worsening > 10 Points From Baseline to Progression; No Deterioration, Symptom Worsening < 10 Points From Baseline to Progression
      Abbreviations: CI = confidence interval; HR = hazard ratio.

      Discussion

      In the present explorative study of lung cancer patients completing PRO measures as a part of routine care, we identified specific scales from the QLQ-C30 and LC13 questionnaires that seem to predict a patient’s survival at disease progression. The absolute HRQoL scores predicted survival for several scales, including global health score, physical functioning, fatigue, and pain at disease progression. In addition, previous changes in 4 HRQoL scores (dyspnea, hemoptysis, dysphagia, pain in the chest) predicted for survival at disease progression. Thus, we have demonstrated that PRO measures collected in routine care can provide clinicians with relevant prognostic information, supplementing the standard clinical assessment of patients with lung cancer. Some symptom deterioration had resulted from side effects due to treatment, and other symptoms had less prognostic importance. Such symptoms may still be important to measure; however, clinicians should be informed of the specific properties of the individual scales.
      Overall, the change in the HRQoL scores added little prognostic information to that of the absolute scores. These results indicate that the patient’s current health condition at disease progression is more important than any previous change, presumably because a decline in an HRQoL score will not be equally severe for all patients. In addition, 1 study showed that the absolute scores identified patients' most bothersome QoL issues better than did changes in the scores compared with those at the previous visit.
      • Snyder C.F.
      • Blackford A.L.
      • Aaronson N.K.
      • et al.
      Can patient-reported outcome measures identify cancer patients’ most bothersome issues?.
      Thus, the absolute HRQoL scores might have higher clinical value than the score changes.
      Several studies have reported prognostic significance for HRQoL in patients with advanced or metastatic lung cancer. All the identified studies had used a post hoc analysis of HRQoL data collected to evaluate the effect of an intervention. Most studies had analyzed the baseline HRQoL scores as prognostic factors.
      • Aaronson N.K.
      • Ahmedzai S.
      • Bergman B.
      • et al.
      The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
      ,
      • Bergman B.
      • Aaronson N.K.
      • Ahmedzai S.
      • Kaasa S.
      • Sullivan M.
      The EORTC QLQ-LC13: a modular supplement to the EORTC core quality of life questionnaire (QLQ-C30) for use in lung cancer clinical trials.
      ,
      • Cella D.F.
      • Bonomi A.E.
      • Lloyd S.R.
      • Tulsky D.S.
      • Kaplan E.
      • Bonomi P.
      Reliability and validity of the functional assessment of cancer therapy-lung (FACT-L) quality of life instrument.
      The baseline global health score and pain were most often reported to have prognostic value.
      • Movsas B.
      • Moughan J.
      • Sarna L.
      • et al.
      Quality of life supersedes the classic prognosticators for long-term survival in locally advanced non-small-cell lung cancer: an analysis of RTOG 9801.
      ,
      • Qi Y.
      • Schild S.E.
      • Mandrekar S.J.
      • et al.
      Pretreatment quality of life is an independent prognostic factor for overall survival in patients with advanced stage non-small cell lung cancer.
      ,
      • Spigel D.R.
      • Patel J.D.
      • Reynolds C.H.
      • et al.
      Quality of life analyses from the randomized, open-label, phase III pointbreak study of pemetrexed-carboplatin-bevacizumab followed by maintenance pemetrexed-bevacizumab versus paclitaxel-carboplatin-bevacizumab followed by maintenance bevacizumab in patients.
      Other studies found that baseline dyspnea, dysphagia, and physical functioning had prognostic properties.
      • Movsas B.
      • Moughan J.
      • Sarna L.
      • et al.
      Quality of life supersedes the classic prognosticators for long-term survival in locally advanced non-small-cell lung cancer: an analysis of RTOG 9801.
      ,
      • Efficace F.
      • Bottomley A.
      • Smit E.
      • et al.
      Is a patient’s self-reported health-related quality of life a prognostic factor for survival in non-small-cell lung cancer patients? A multivariate analysis of prognostic factors of EORTC study 08975.
      ,
      • Herndon J.E.
      • Fleishman S.
      • Kornblith A.B.
      • Kosty M.
      • Green M.R.
      • Holland J.
      Is quality of life predictive of the survival of patients with advanced nonsmall cell lung carcinoma?.
      Two studies had used the initial changes in HRQoL scores during chemotherapy to predict for survival.
      • Eton D.T.
      • Fairclough D.L.
      • Cella D.
      • Yount S.E.
      • Bonomi P.
      • Johnson D.H.
      Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from Eastern Cooperative Oncology Group study 5592.
      ,
      • Ediebah D.E.
      • Coens C.
      • Zikos E.
      • et al.
      Does change in health-related quality of life score predict survival? Analysis of EORTC 08975 lung cancer trial.
      Both found early changes in physical functioning to have prognostic value,
      • Eton D.T.
      • Fairclough D.L.
      • Cella D.
      • Yount S.E.
      • Bonomi P.
      • Johnson D.H.
      Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from Eastern Cooperative Oncology Group study 5592.
      ,
      • Ediebah D.E.
      • Coens C.
      • Zikos E.
      • et al.
      Does change in health-related quality of life score predict survival? Analysis of EORTC 08975 lung cancer trial.
      and one had also identified pain and dysphagia as prognostic.
      • Ediebah D.E.
      • Coens C.
      • Zikos E.
      • et al.
      Does change in health-related quality of life score predict survival? Analysis of EORTC 08975 lung cancer trial.
      As described, the prognostic properties of PRO measures collected during lung cancer clinical trials have been widely confirmed by several studies.
      • Mierzynska J.
      • Piccinin C.
      • Pe M.
      • et al.
      Prognostic value of patient-reported outcomes from international randomised clinical trials on cancer: a systematic review.
      However, to the best of our knowledge, the present study is the first to show that such prognostic properties could also apply to the use of PRO measures in daily clinical decision-making.
      An important perspective of our findings was that several functional scales gave significant prognostic information. These scales represent topics that are often highly relevant for patients’ daily living and QoL. Role functioning describes a patient’s ability to work and maintain daily activities during treatment. Such topics might rarely be addressed by clinicians if not directly related to treatment or the disease. Therefore, assessing PRO measures in routine care enables clinicians to increase their awareness on several aspects of a patient’s life, providing a more complete picture of the individual patient. Such highly relevant information should be used and prioritized when evaluating patient preferences in the palliative treatment of metastatic cancer.
      A major strength of the present study was that several specific baseline HRQoL scales identified to predict for survival were consistent with those reported by other studies (global health score, physical functioning, pain, dysphagia, dyspnea). Most of the other studies did not include all scales in their analyses. This could explain why some scales (eg, hemoptysis and fatigue) were not identified as prognostic for survival in any of the previous studies. It has generally been accepted that hemoptysis is a severe symptom and, therefore, consistent with the clinical experience of its prognostic value. Patients experiencing a considerable decline in their health condition would be expected to report increased worries. This might explain why the absolute scores of emotional function and insomnia were also prognostic for survival at disease progression. Another strength was that our patients could complete the questionnaires at home in a safe environment and unaffected by the doctor’s interpretation of their symptoms. A final strength of the present results is that the absolute scores and the change in scores predicted for survival on several of the same scales.
      A potential weakness of the study was the risk of excluding a group of patients known to experience difficulty in completing electronic questionnaires. The baseline HRQoL scores of the included patients were better than the scores from a reference population of patients with stage IV lung cancer and another population of Scandinavian patients.
      • Scott N.W.
      • Fayers P.
      • Aaronson N.K.
      • et al.
      EORTC QLQ-C30 Reference Values Manual.
      ,
      • Silvoniemi M.
      • Vasankari T.
      • Löyttyniemi E.
      • Valtonen M.
      • Salminen E.
      Symptom assessment for patients with non-small cell lung cancer scheduled for chemotherapy.
      This could indicate that patients with worse symptoms completed the questionnaires to a lesser extent than did patients with milder symptoms. However, the baseline scores were highly comparable with the scores from a study describing HRQoL development in patients during maintenance chemotherapy.
      • Sztankay M.
      • Giesinger J.M.
      • Zabernigg A.
      • et al.
      Clinical decision-making and health-related quality of life during first-line and maintenance therapy in patients with advanced non-small cell lung cancer (NSCLC): findings from a real-world setting.
      The age and gender distributions were similar for the study population and the noneligible patients. Also, a substantial proportion of patients had been excluded because of missing questionnaire completion at disease progression. Some explanations for this are possible. First, the collected PRO measures were used for different clinical purposes, which could have led to misunderstandings among both patients and clinicians. During a course of treatment (eg, chemotherapy every 3 weeks), PRO measures are primarily used to monitor adverse effects and to guide treatment dose modifications. However, for some patients, the therapy will end after a prescheduled number of treatment cycles, and the patients continue with follow-up. In the latter phase, the primary purpose of the PRO measures becomes to aid in decision-making and assist in optimizing palliative care. Because the aims were not obvious to all stakeholders, including the clinicians, the patients may not have known that they were supposed to continue completing the questionnaires after treatment cessation. This problem was larger in the beginning of the study period, indicating the presence of an implementation start-up issue during which patients and clinicians were still learning how to use the PRO measures in routine care.
      The time to progression and type of treatment differed among patients, which made the course of symptom development very variable. Some patients responding to treatment experienced symptom improvement, which again worsened in the period leading up to progression, but others experienced a more linear symptom development. We have described the change only from treatment initiation to disease progression and not the development in between. However, although the HRQoL data were collected prospectively during routine care, the data were not collected at fixed intervals or with the aim of performing the present study. Therefore, these retrospective analyses of prospectively collected data can act merely as an indicator of prognostic value.
      Also, the present study was conducted before immunotherapy had been widely implemented as the standard of care for patients with lung cancer. Thus, the prognostic significance for patients treated with immunotherapy could differ from the presented results. However, poor performance status is a known negative predictor of response to both chemotherapy and immunotherapy. Thus, a prognostic evaluation of a patient’s health status using PRO measures will also most likely be well suited to monitor patients during immunotherapy.
      In the survival analyses, the patients were dichotomized by performing a median split of the absolute HRQoL scores and by a 10-point minimal important difference for longitudinal changes. Thus, the results might have been different if other thresholds had been used. Previous studies have also used a median split to construct groups of patients with high or low HRQoL scores. However, such arbitrary cutoffs cannot consider the patient’s needs or the clinical relevance.
      • Movsas B.
      • Moughan J.
      • Sarna L.
      • et al.
      Quality of life supersedes the classic prognosticators for long-term survival in locally advanced non-small-cell lung cancer: an analysis of RTOG 9801.
      ,
      • Eton D.T.
      • Fairclough D.L.
      • Cella D.
      • Yount S.E.
      • Bonomi P.
      • Johnson D.H.
      Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from Eastern Cooperative Oncology Group study 5592.
      Giesinger et al
      • Giesinger J.M.
      • Loth F.L.C.
      • Aaronson N.K.
      • et al.
      Thresholds for clinical importance were established to improve interpretation of the EORTC QLQ-C30 in clinical practice and research.
      suggested thresholds for clinically important symptom/functional impairment for each scale in the EORTC QLQ-C30 questionnaire for patients with different cancer diagnoses. However, because these thresholds were not designed to assess prognosis, we considered their approach unfit for dichotomization in the present survival analyses. Symptoms that are important to patients (eg, symptoms considered side effects of treatment) may not be of prognostic value. Therefore, clinical cutoffs with clinical relevance could have less prognostic significance than cutoffs specifically developed for prognostic evaluation. The present study was not designed to suggest specific cutoff scores but to explore whether symptoms with prognostic significance could be identified.

      Conclusion

      The results from the present study have shown that PRO measures applied in routine care can offer clinically relevant prognostic information at disease progression. Such information could help to initiate end-of-life discussions, improve palliative care, and aid decision making for patients with deteriorating health. However, because of the explorative nature of the study design, the exact risk assessments and specific symptom scores should be interpreted with caution. Future studies should aim to specify the prognostic thresholds for the individual HRQoL scores in larger patient cohorts.

      Clinical Practice Points

      • Electronic PRO measures have been increasingly used in routine care for various purposes.
      • The routine use of such information has been shown to improve clinician awareness of patient-perceived symptoms and patient–caregiver communication, thereby enhancing quality of care.
      • However, the clinical significance of PROs are not easily interpreted.
      • In the present study, we identified specific PRO measures that were predictive of survival at disease progression in patients with lung cancer.
      • In addition, the absolute PRO measures at the disease progression predicted for survival.
      • These results show how PRO measures used in clinical routine care can help to initiate end-of-life discussions, improve palliative care, and aid in decision making for patients with deteriorating health.

      Disclosure

      The authors declare that they have no competing interests.

      CRediT authorship contribution statement

      Rasmus Blechingberg Friis: Writing - original draft, Formal analysis, Conceptualization, Methodology, Project administration. Niels Henrik Hjøllund: Conceptualization, Software, Writing - review & editing. Helle Pappot: Supervision, Conceptualization, Writing - review & editing. Gry Assam Taarnhøj: Conceptualization, Writing - review & editing. Jesper Medom Vestergaard: Data curation, Visualization, Writing - review & editing. Halla Skuladottir: Supervision, Conceptualization, Writing - review & editing, Funding acquisition.

      Acknowledgments

      This work was supported by the Danish Cancer Society (grants R184-A11805, 2017), the Max Wørzner and Wife Inger Wørzner's Memorial Fund and the Department of Oncology, Hospital Unit West Juland. We thank all patients and clinical staff for ongoing support to the clinical use of patient-reported outcome measures during treatment in the Department of Oncology, Regional Hospital West Jutland. Thanks to Morten Pilgaard for language revision of our report. A special thanks to the Head of the Department, Senior Consultant Hanne Linnet, for innovative and proactive thinking concerning the implementation of patient-reported outcomes in clinical practice.

      References

      1. Ferlay J, Ervik M, Lam F, et al. Global Cancer Observatory: Cancer Today. Lyon, France: International Agency for Research on Cancer.

        • Engholm G.
        • Ferlay J.
        • Christensen N.
        • et al.
        NORDCAN: Cancer Incidence, Mortality, Prevalence and Survival in the Nordic Countries, version 7.3 (08.07.2016). Association of the Nordic Cancer Registries. Danish Cancer Society.
        (Available at:) (Accessed October 1, 2019)
        • Temel J.S.
        • Greer J.A.
        • Muzikansky A.
        • et al.
        Early palliative care for patients with metastatic non–small-cell lung cancer.
        N Engl J Med. 2010; 363: 733-742
        • Simmons C.P.
        • Koinis F.
        • Fallon M.T.
        • et al.
        Prognosis in advanced lung cancer—a prospective study examining key clinicopathological factors.
        Lung Cancer. 2015; 88: 304-309
        • Buccheri G.
        • Ferrigno D.
        • Tamburini M.
        Karnofsky and ECOG performance status scoring in lung cancer: a prospective, longitudinal study of 536 patients from a single institution.
        Eur J Cancer Part A. 1996; 32: 1135-1141
        • Capewell S.
        • Sudlow M.F.
        Performance and prognosis in patients with lung cancer.
        Thorax. 1990; 45: 951-956
        • Atkinson T.M.
        • Dueck A.C.
        • Satele D.V.
        • et al.
        Clinician vs patient reporting of baseline and postbaseline symptoms for adverse event assessment in cancer clinical trials.
        JAMA Oncol. 2020; 6: 437-439
        • Pakhomov S.V.
        • Jacobsen S.J.
        • Chute C.G.
        • Roger V.L.
        Agreement between patient-reported symptoms and their documentation in the medical record.
        Am J Manag Care. 2008; 14: 530-539
        • Kotronoulas G.
        • Papadopoulou C.
        • Simpson M.F.
        • McPhelim J.
        • Mack L.
        • Maguire R.
        Using patient-reported outcome measures to deliver enhanced supportive care to people with lung cancer: feasibility and acceptability of a nurse-led consultation model.
        Support Care Cancer. 2018; 26: 3729-3737
        • Kotronoulas G.
        • Kearney N.
        • Maguire R.
        • et al.
        What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials.
        J Clin Oncol. 2014; 32: 1480-1501
        • Denis F.
        • Basch E.
        • Septans A.-L.
        • et al.
        Two-year survival comparing web-based symptom monitoring vs routine surveillance following treatment for lung cancer.
        JAMA. 2019; 321: 306
        • Basch E.
        • Deal A.M.
        • Dueck A.C.
        • et al.
        Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment.
        JAMA. 2017; 318: 197-198
        • Rotenstein L.S.
        • Huckman R.S.
        • Wagle N.W.
        Making patients and doctors happier—the potential of patient-reported outcomes.
        N Engl J Med. 2017; 377: 1309-1312
        • Zikos E.
        • Ghislain I.
        • Coens C.
        • et al.
        Health-related quality of life in small-cell lung cancer: a systematic review on reporting of methods and clinical issues in randomised controlled trials.
        Lancet Oncol. 2014; 15: e78-e89
        • Gotay C.C.
        • Kawamoto C.T.
        • Bottomley A.
        • Efficace F.
        The prognostic significance of patient-reported outcomes in cancer clinical trials.
        J Clin Oncol. 2008; 26: 1355-1363
        • Montazeri A.
        Quality of life data as prognostic indicators of survival in cancer patients: an overview of the literature from 1982 to 2008.
        Health Qual Life Outcomes. 2009; 7: 102
        • Mierzynska J.
        • Piccinin C.
        • Pe M.
        • et al.
        Prognostic value of patient-reported outcomes from international randomised clinical trials on cancer: a systematic review.
        Lancet Oncol. 2019; 20: e685-e698
        • Movsas B.
        • Moughan J.
        • Sarna L.
        • et al.
        Quality of life supersedes the classic prognosticators for long-term survival in locally advanced non-small-cell lung cancer: an analysis of RTOG 9801.
        J Clin Oncol. 2009; 27: 5816-5822
        • Aaronson N.K.
        • Ahmedzai S.
        • Bergman B.
        • et al.
        The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology.
        J Natl Cancer Inst. 1993; 85: 365-376
        • Bergman B.
        • Aaronson N.K.
        • Ahmedzai S.
        • Kaasa S.
        • Sullivan M.
        The EORTC QLQ-LC13: a modular supplement to the EORTC core quality of life questionnaire (QLQ-C30) for use in lung cancer clinical trials.
        Eur J Cancer. 1994; 30: 635-642
        • Schougaard L.M.V.
        • Larsen L.P.
        • Jessen A.
        • et al.
        AmbuFlex: tele-patient-reported outcomes (telePRO) as the basis for follow-up in chronic and malignant diseases.
        Qual Life Res. 2016; 25: 525-534
        • Hjollund N.H.I.
        Fifteen years’ use of patient-reported outcome measures at the group and patient levels: trend analysis.
        J Med Internet Res. 2019; 21: e15856
        • Fayers P.M.
        • Aaronson N.K.
        • Bjordal K.
        • Groenvold M.
        • Curran D.
        • Bottomley A.
        EQ of Life Group. EORTC QLQ-C30 Scoring Manual, 3rd ed. 2001.
        (Available at:) (Accessed October 15, 2019)
        • EORTC Quality of Life Group
        EORTC QLQ-LC13 Scoring Manual. 2001.
        (Available at:) (Accessed October 15, 2019)
        • Donneau A.F.
        • Mauer M.
        • Coens C.
        • Bottomley A.
        • Albert A.
        Longitudinal quality of life data: a comparison of continuous and ordinal approaches.
        Qual Life Res. 2014; 23: 2873-2881
        • Fradette K.
        • Keselman H.J.
        • Lix L.
        • Algina J.
        • Wilcox R.R.
        Conventional and robust paired and independent-samples t tests: type I error and power rates.
        J Mod Appl Stat Methods. 2003; 2: 481-496
        • Osoba D.
        • Rodrigues G.
        • Myles J.
        • Zee B.
        • Pater J.
        Interpreting the significance of changes in health-related quality-of-life scores.
        J Clin Oncol. 1998; 16: 139-144
        • Danish Patient Safety Authority
        Patient record information for research [in Danish].
        (Available at:) (Accessed October 11, 2019)
        • Snyder C.F.
        • Blackford A.L.
        • Aaronson N.K.
        • et al.
        Can patient-reported outcome measures identify cancer patients’ most bothersome issues?.
        J Clin Oncol. 2011; 29: 1216-1220
        • Cella D.F.
        • Bonomi A.E.
        • Lloyd S.R.
        • Tulsky D.S.
        • Kaplan E.
        • Bonomi P.
        Reliability and validity of the functional assessment of cancer therapy-lung (FACT-L) quality of life instrument.
        Lung Cancer. 1995; 12: 199-220
        • Qi Y.
        • Schild S.E.
        • Mandrekar S.J.
        • et al.
        Pretreatment quality of life is an independent prognostic factor for overall survival in patients with advanced stage non-small cell lung cancer.
        J Thorac Oncol. 2009; 4: 1075-1082
        • Spigel D.R.
        • Patel J.D.
        • Reynolds C.H.
        • et al.
        Quality of life analyses from the randomized, open-label, phase III pointbreak study of pemetrexed-carboplatin-bevacizumab followed by maintenance pemetrexed-bevacizumab versus paclitaxel-carboplatin-bevacizumab followed by maintenance bevacizumab in patients.
        J Thorac Oncol. 2015; 10: 353-359
        • Efficace F.
        • Bottomley A.
        • Smit E.
        • et al.
        Is a patient’s self-reported health-related quality of life a prognostic factor for survival in non-small-cell lung cancer patients? A multivariate analysis of prognostic factors of EORTC study 08975.
        Ann Oncol. 2006; 17: 1698-1704
        • Herndon J.E.
        • Fleishman S.
        • Kornblith A.B.
        • Kosty M.
        • Green M.R.
        • Holland J.
        Is quality of life predictive of the survival of patients with advanced nonsmall cell lung carcinoma?.
        Cancer. 1999; 85: 333-340
        • Eton D.T.
        • Fairclough D.L.
        • Cella D.
        • Yount S.E.
        • Bonomi P.
        • Johnson D.H.
        Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from Eastern Cooperative Oncology Group study 5592.
        J Clin Oncol. 2003; 21: 1536-1543
        • Ediebah D.E.
        • Coens C.
        • Zikos E.
        • et al.
        Does change in health-related quality of life score predict survival? Analysis of EORTC 08975 lung cancer trial.
        Br J Cancer. 2014; 110: 2427-2433
        • Scott N.W.
        • Fayers P.
        • Aaronson N.K.
        • et al.
        EORTC QLQ-C30 Reference Values Manual.
        2nd ed. EORTC Quality of Life Group, Brussels, Belgium2008
        • Silvoniemi M.
        • Vasankari T.
        • Löyttyniemi E.
        • Valtonen M.
        • Salminen E.
        Symptom assessment for patients with non-small cell lung cancer scheduled for chemotherapy.
        Anticancer Res. 2016; 36: 4123-4128
        • Sztankay M.
        • Giesinger J.M.
        • Zabernigg A.
        • et al.
        Clinical decision-making and health-related quality of life during first-line and maintenance therapy in patients with advanced non-small cell lung cancer (NSCLC): findings from a real-world setting.
        BMC Cancer. 2017; 17: 565
        • Giesinger J.M.
        • Loth F.L.C.
        • Aaronson N.K.
        • et al.
        Thresholds for clinical importance were established to improve interpretation of the EORTC QLQ-C30 in clinical practice and research.
        J Clin Epidemiol. 2020; 118: 1-8