Article Text

Download PDFPDF

Joint effort: a call for standardization in total joint arthroplasty data reporting
  1. Alexander Y Liebeskind1,
  2. Marc Nieuwenhuijse2,3,
  3. Jensen H Hyde4,
  4. Amanda C Chen1,
  5. Suvekshya Aryal1 and
  6. Per-Henrik Randsborg5,6
  1. 1Department of Health Policy and Research, Weill Cornell Medical College, New York, New York, USA
  2. 2Orthopaedic Surgery, Maastricht University Medical Center+, Maastricht, The Netherlands
  3. 3Orthopaedic Surgery, Leiden University Medical Center, Leiden, The Netherlands
  4. 4Department of Internal Medicine, The University of Tennessee at Chattanooga, Chattanooga, Tennessee, USA
  5. 5Sport Medicine Institute, Hospital for Special Surgery, New York, New York, USA
  6. 6Departement of Orthopedic Surgery, Akershus University Hospital, Lorenskog, Norway
  1. Correspondence to Dr Per-Henrik Randsborg; Per-Henrik.Randsborg{at}ahus.no

Statistics from Altmetric.com

Introduction

The prevalence of osteoarthritis doubled in the USA between 1999 and 2014,1 making the condition the single largest contributor to health-related costs.2 Consequently, over 1 million total joint arthroplasties (TJAs) are performed each year in the USA, and this number is expected to exceed 4 million by 2030.3

Rising healthcare costs related to low value care require quantification of efficacy and safety from the patient’s perspective.4 Patient reported outcome measures (PROMs) are typically used to assess the patient orientated efficacy of joint replacements. PROMs include joint-specific and generic questionnaire-based endpoints. Implant survival is also used as safety and performance metric.

Systematic reviews are at the top of the evidence pyramid. The quality of the aggregated evidence depends on the amount of analyzable data available for meta-analysis. The purpose of this commentary is not to provide a meta-analysis or systematic review of outcome after total hip and knee arthroplasties, but to demonstrate that the lack of harmonized data reporting makes aggregate knowledge synthesis near impossible despite thousands of available publications.

Materials and methods

We reviewed 7979 publications related to total knee arthroplasty (TKA) and total hip arthroplasty (THA). The study pool was drawn from PubMed, MEDLINE, Embase, EMCare, Web of Science and Cochrane Library. To ensure inclusion and exclusion criteria were satisfied, the literature sample was subjected to a multi-round, paired peer-verified screening process (figure 1). Studies were included that met a 90% osteoarthritis population diagnosis rate and with a US study population. Exclusion criteria included irrelevant population, country, or outcome, insufficient follow-up (less than 2-year survival rate, revision rate, or PROM data), insufficient sample size (<100 for randomised controlled trials or <250 for observational studies), or extraneous area of focus (Unicompartmental Knee Arthroplasty (UKA), resurfacing, etc). Editorials and reviews were excluded. Between rounds, studies were reassigned for assessment in order to limit potential bias and optimize data extraction. Data were extracted from the publications which passed the systematic review process. This primary data set was analyzed to assess data reporting related to extractable PROM endpoints and implant survival (figure 1).

Figure 1

Preferred Reporting Items for Systematic Reviews and Meta-Analyses flowchart illustrating the process of evidence review and the number of studies included in the analysis (note: two studies citing both hip and knee patient reported outcome measures met inclusion criteria). EQ5D, EuroQol-5 Dimension; HHS, Harris Hip Score; HOOS, Hip Injury and Osteoarthritis Outcome Score; KOOS, Knee Injury and Osteoarthritis Outcome Score; KSS, Knee Society Score; OKS, Oxford Knee Score; RSA, Resurfacing Arthroplasty; SF, Short Form; UKA, Unicompartmental Knee Arthroplasty; VAS, Visual Analouge Scale.

Results

Following title and abstract screening, 294 papers met initial inclusion criteria for full-text assessment, of which 30 (10.2%) studies (2 including both hip and knee data) met final inclusion criteria. Survival rates were cited by 87.5% and 37.5% of THA studies and 50.0% and 41.7% of TKA studies at 2 and 5 years, respectively, which exceeded average reporting rates for joint-specific or generic PROMs (table 1). Given the potential for 8 THA and 24 TKA aggregated endpoints, total extractable data were markedly low.

Table 1

Percentage of publications presenting compatible and analyzable endpoints extracted from 30 studies included in a systematic review of 7979 publications on total joint arthroplasty

Discussion

We found two primary problems in our evidence assessment: (1) reporting of PROMs differs across publications and (2) endpoints are presented using incomparable parameters. These obstacles critically undermine consolidated analysis by reducing the number of analyzable endpoints per study.

Our results show that there is a dire need for standardization in the quantification and reporting of TJA outcome measures. The inability to compute aggregate data inhibits generation of surgical protocols and hinders device regulation, which is important for public health and policymaking. Publications that cannot be included in aggregate data analysis miss the opportunity to improve practice, the key goal of scientific publications. These findings corroborate past results: one recent review of four orthopedic journals identified over 40 different knee and hip specific PROM types.4 This multitude of outcome measures compromises between-study comparability and evidence synthesis for construction of performance benchmarks and clinical and regulatory guidelines.

Removing unnecessary obstacles to aggregated data analysis in publications related to joint replacement will lead to stronger evidence generation, subsequent improvement of TJA outcomes and reduction in scientific waste. We therefore call for publishers, stakeholders, and professional societies to harmonize data reporting in joint replacement with support from key regulators. It is essential that future PROM studies adopt standard reporting practices, minimum data guidelines, and PROM conversion crosswalks5 to prevent research waste.

Ethics statements

Patient consent for publication

References

Footnotes

  • Twitter @randsborg

  • Contributors AYL, MN, JHH, ACC, SA, and P-HR contributed to inclusion and exclusion criteria, orthopedic study review, data extraction, and provided consultation on methodology. Authors AYL, MN, JHH, and P-HR were additionally responsible for analysis and manuscript writing and editing.

  • Funding This work was supported by the Food and Drug Administration, Center for Devices and Radiological Health, grant number U01FD006292.

  • Disclaimer Marc Nieuwenhuijse is an Editorial Board Member.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.