Original research

Developing a platform to investigate the heterogeneity of outcomes for patients with ovarian cancer

Abstract

Background The geographical variation in treatment patterns for patients with ovarian cancer is profound, long-standing and worrying. Although these variations were highlighted in a recent UK registry audit, granular data to provide explanations for these variations have been lacking.

Methods A consortium of six UK centres was generated to curate and submit data for all patients treated at their centre for a 2-year period. Descriptive statistics were combined with Cox regression and Kaplan-Meier analysis to confirm the findings from the national registry audit and identify possible drivers of the heterogeneity previously described.

Results Records for 1117 patients treated in six centres in 2018 and 2019 were collated. Although there were differences in the clinical characteristics of patients between centres, these were not enough to account for the significant variation in survival outcomes between centres (p<0.001). Treatment rates varied between centres with between 30% and 76% of patients receiving combination therapy but in Cox models ‘treatment centre’ remained a predictor of 1 year survival independent of patient, tumour factors and treatment choice.

Conclusion Variations in outcome seen between UK centres are not related solely to casemix but rather to the approach and ethos of each centre towards advanced ovarian cancer treatment options. Although important, differences in treatment patterns do not completely explain the variations seen and further work is required to understand the drivers of difference seen.

What is already known on this topic

  • Treatment patterns vary between centres in the UK and this is associated with worrying differences in outcomes.

What this study adds

  • This variation in treatment is not explained by casemix and may therefore be related to the ethos of the centre.

How this study might affect research, practice or policy

  • Women with ovarian cancer need better evidence to help them make treatment decisions.

Introduction

Outcomes for patients with ovarian cancer remain poor with 5-year survival rates of 34.6%.1 One of the strongest determinants of outcome is the mode of primary treatment.2 Treatment with a combination of surgery and chemotherapy is associated with best outcomes, although not all patients are suitable for this approach. Guidance is lacking on how to select patients for treatment and consequently practice varies between centres, even within a centralised health service such as the UK. This variation was highlighted in the UK Ovarian Cancer Audit Feasibility Pilot (OCAFP),1 which showed unacceptable levels of variation in treatment patterns, and overall survival, between Cancer Alliances, the geographical units of administration within England.

OCAFP was a registry study and was thus unable to capture potentially important data, including performance status and comorbidity data. As a result, it is difficult to interpret from OCAFP the underlying reasons for the variations in practice seen. To understand these differences, a dataset is required which includes not only all known prognostic factors but also includes all patients diagnosed in a centre, thus ensuring the correct denominator.3 Such datasets are not provided by clinical trial datasets which can often be highly selective.

Here, we therefore wanted to assess the feasibility of generating a granular dataset from a consortium of UK centres before using these data to confirm the findings of the OCAFP and start to provide reasons for the variations that are seen in current treatment patterns.

Methods

Identification of centres

Six UK sites were carefully selected to include large and small centres, and centres from Cancer Alliances with high and low surgical resection rates identified from the OCAFP.1 The participating centres were selected to reflect the full range of UK practice and included one centre which lies above the 99th centile for resection rates, and one centre lying below the 1st centile, with four centres representing mainstream practice.

A data dictionary was generated to define all clinical variables to be collected. Details of the dictionary have been previously described.4 Briefly. the data dictionary comprises (1) patient factor data which include demographic, comorbidity using the validated ACE27 system,5 and germline BRCA status, (2) tumour-related data, including histological type, grade and stage, physiological response data and radiological distribution of disease and (3) treatment-related data including type and outcome of each treatment modality. Deprivation indices were generated from patient postcode using the Indices of Deprivation Score.6 Three-year follow-up data were also recorded.

Each participating centre was funded to collect data, according to the data dictionary, for all patients registered with a diagnosis of ovarian cancer (ICD56), between 1 January 2018 and 31 December 2019.

Data were transferred to the University of Manchester and stored in a data repository in a pseudonymised fashion. Missing data were managed with median replacement. Data were analysed with Kaplan-Meier, Cox proportional hazard and multivariable Cox models using Rstudios (V.4.2.3).

As part of the data collection process, sites were also asked to complete a resource requirements document, to better understand the time taken to obtain the data at each site. This information was not requested from the one centre, as data collection was complete prior to the commencement of this project.

Results

Data completeness

A total of 1117 patient records were submitted, representing all cases registered with each centre for the 2-year period from 1 January 2018 to 31 December 2019. The numbers registered per centre were 94, 115, 123, 173, 304 and 308, respectively. The numbers per centre varied, as expected, dependent on the varying sizes of the local population.

Performance status, CA125, Deprivation Index, Federation Internation Gynaecology & Obstetrics (FIGO) stage and grade were generally well-recorded and available for analysis. In contrast, while ACE27 (Adult co morbidity evaluation) scores and ethnicity were well recorded in some centres, they were very poorly recorded in others (table 1). Although germline BRCA status was also heterogeneously recorded it should be noted that the study period coincided with the national rollout of germline BRCA testing with centres taking this on at various points during the study period (table 1).

Table 1
Percentage missing data by centre

Data collection processes

The resource required to carry out retrospective data collection is rarely calculated. We wanted to generate an estimate of the time and resource required to generate a comprehensive data record, which often requires access to multiple IT systems. Data collectors therefore recorded the time taken to complete each record. Time taken to collect data for each patient varied across centres with a mean score of 27 min per patient, table 2. There was no evidence of time per record decreasing with increasing experience. There was also no correlation between number of patients and time taken to collect data. The number of data systems required to obtain the data (electronic and paper-based) ranged from 2 to 7 in the five centres that submitted resource requirements information (table 2).

Table 2
Effort required to collect data

Explaining heterogeneity

Median follow-up for the whole cohort was 36 months. However, to explore heterogeneity, we focused on patients with FIGO stage 2–4 disease. Median survival for stage 2–4 patients was 27 months. Kaplan-Meier analysis, stratified by treatment centre, showed marked survival differences between patients in each centre (p<0.001, log-rank test) (figure 1).

Survival analysis for all FIGO stage 2–4 ovarian cancers, stratified by centre. Follow-up was shorter for patients at one centre resulting in early censoring. Survival differed between the cohorts (p<0.001, log-rank test).

Demographics and clinical factors varied between centres. There were marked differences in indices of deprivation between the six centres, with two centres having large proportions of patients with low (1–3) deprivation scores (table 3 and figure 2A).

Clinical characteristics of cohort by centre. (A)Index of Multiple Deprivation (IMD) s calculated for each patient using the index of multiple deprivation. Age (b) and BMI (c) also both showed significant differences between centres. BMI, Body Mass Index.

Table 3
Clinical data for patients with FIGO stage 2–4 ovarian cancer, stratified by centre (A–F)

There were also differences between centres in age, WHO performance status, ACE27 Comorbidity Index,5 smoking status, ethnicity, Body Mass Index, FIGO stage and histological diagnosis (table 3).

However, most notable was the heterogeneity seen within treatment patterns between the six centres (figure 3). For stage 2–4 disease, the combination of surgery and chemotherapy, which can be delivered with surgery either prior to or during chemotherapy,7 is considered gold standard treatment for patients with advanced ovarian cancer. Median rates of gold standard treatment in this cohort were 64.2% but ranged from 29.4% in one centre to 75.9% in another. There were similar variations in rates of ‘no treatment’ (median 12.0%, range 2.1%–31.2%).

Stacked bar chart showing treatment patterns for patients with advanced ovarian cancer for each centre. Centres are shown in ascending order of ‘gold standard’ treatment rate, defined as the combination of surgery and chemotherapy (red and orange bars). NACT - Neoadjuvant chemotherapy. PDS - primary debulking surgery

Cox proportional hazard modelling showed that the patient and tumour factors that impacted on survival included age (HR for death 1.04), performance statue (PS) 3 or 4 (HR 2.06 and 16.5, respectively), FIGO stage 3 or 4 (3.13 and 4.30, respectively) and albumin level (HR 0.97).

When treatment was incorporated into the model, there was no effect of receiving neoadjuvant chemotherapy and interval surgery compared with primary cytoreductive surgery. Unsurprisingly, receiving chemotherapy alone without surgery (HR 3.03) was associated with shorter survival times (HR 4.0).

However, when multivariable Cox models were generated, treatment centre remained a predictor of 1 year survival independent of patient, tumour factors and treatment choice.

Discussion

We have carried out a retrospective, observational study to validate the findings first described in the OCAFP. The latter was a registry-level study and detailed interpretation was limited by lack of data regarding patient demographics. Here, we have carried out a ‘bottom-up’ study using clinical record data to confirm, and investigate, the findings from the OCAFP.

We have shown that granular datasets can be generated from routinely collected clinical records with acceptable levels of missing data within a centralised cancer care system. We have confirmed that the variations in treatment patterns seen in Cancer Alliances and reported in OCAFP are replicated in data from individual centres.

The variations in age, performance status and particularly deprivation seen between the cohorts in this study highlight the challenges faced by particular centres. These differences are rarely accounted for in commissioning of services but are likely to impact on resource requirements. More concerning are the variations in survival outcomes seen between the centres. These are not fully accounted for by the population and treatment differences between the centres. Given the comprehensive data collection that underpinned this study, it appears that variations in outcome are not fully driven by differences in casemix. Instead, these variations in outcome may be driven by more subtle differences between the centres; potentially including infrastructure, capacity or even an ethos and philosophy about treatment plans and overall treatment approach for patients with advanced ovarian cancer. Indeed, evidence is emerging that there is heterogeneity in the decision-making process for these patients between centres8 and further work is required to understand these differences.

There has been extensive debate regarding the relative merits of primary versus delayed primary surgery for patients with advanced disease.9 However, the data presented here clearly indicate that key to survival benefit is the incorporation of surgical resection in the treatment algorithm of advanced ovarian cancer, independently of the timing, that is, upfront or delayed, at interval. Hence, the focus for clinicians should move from discussions about the timing of surgery to increasing the proportion of patients receiving this gold standard treatment,9 as reducing the inequity surrounding patient’s access to surgery could go some away to reducing the heterogeneity outcomes demonstrated here. Empowering patients in the decision-making process, using personalised decision aids as appropriate, may be a useful tool to enable this.

In summary, we have confirmed here the findings that were first outlined in the OCAFP. We have demonstrated that significant heterogeneity exists in treatment patterns, and outcomes, between centres in the UK. This heterogeneity cannot be explained by differences in casemix and further work is now required to understand why this is so, including whether this is related to the ethos and philosophy of the treating team. Perhaps more importantly, work needs to be carried out to show how this may be overcome.

  • Contributors: KB, NW, JM, MM, CF and RE conceived the study. All authors collected and collated data. KB and RE did the analysis. KB and RE wrote the first draft. All authors contributed to editing the first draft.

  • Funding: Funding for this project was provided by Ovarian Cancer Action.

  • Competing interests: RE has received honoraria from GSK and AstraZeneca. CF has received honoraria from Roche, GSK, Ethicon, AstraZeneca/MSD and Oncoinvent. No other authors declare any conflicts of interest.

  • Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

  • Provenance and peer review: Not commissioned; externally peer reviewed.

Data availability statement

Data are available upon reasonable request. Data from this study may be shared subject to appropriate ethical approval.

Ethics statements

Patient consent for publication:
Ethics approval:

Ethical approval was granted from the HRA and Health and Care Research Wales for data collection and storage (ref 22/HRA/3264).

  1. close NCRAS. Ovarian cancer audit feasibility pilot. 2020;
  2. close Lheureux S, Gourley C, Vergote I, et al. Epithelial ovarian cancer. Lancet 2019; 393:1240–53.
  3. close Phillips A, Balega J, Nevin J, et al. “Reporting 'denominator' data is essential for Benchmarking and quality standards in ovarian cancer”. Gynecol Oncol 2017; 146:94–100.
  4. close Russell B, Hawarden A, Gee M, et al. Propensity score matching confirms that primary surgery or Neoadjuvant chemotherapy result in equivalent survival within a comprehensive cohort of patients with high-grade Serous ovarian cancer. Gynecol Oncol 2021; 160:24–31.
  5. close Kallogjeri D, Piccirillo JF, Spitznagel EL, et al. Comparison of scoring methods for ACE-27: simpler is better. J Geriatr Oncol 2012; 3:238–45.
  6. close Ministry of Housing. The English Indices of Deprivation 2019 - Statistical Release, C.L.G. 2019;
  7. close Coleridge SL, Bryant A, Kehoe S, et al. Neoadjuvant chemotherapy before surgery versus surgery followed by chemotherapy for initial treatment in advanced ovarian epithelial cancer. Cochrane Database Syst Rev 2021; 7.
  8. close Khassan T, Smitten E, Wood N, et al. MDT practice determines treatment pathway for patients with advanced ovarian cancer: A multi-centre observational study. Eur J Surg Oncol 2023; 49:1504–10.
  9. close Morrison J. “Neoadjuvant chemotherapy for ovarian cancer: avoiding 'needless hurt'? Bjog”. BJOG 2023; 130:1589–90.
    Available: here

  • Received: 2 January 2024
  • Accepted: 20 February 2024
  • First published: 25 February 2025