Statistics from Altmetric.com
The prevalence of osteoarthritis doubled in the USA between 1999 and 2014,1 making the condition the single largest contributor to health-related costs.2 Consequently, over 1 million total joint arthroplasties (TJAs) are performed each year in the USA, and this number is expected to exceed 4 million by 2030.3
Rising healthcare costs related to low value care require quantification of efficacy and safety from the patient’s perspective.4 Patient reported outcome measures (PROMs) are typically used to assess the patient orientated efficacy of joint replacements. PROMs include joint-specific and generic questionnaire-based endpoints. Implant survival is also used as safety and performance metric.
Systematic reviews are at the top of the evidence pyramid. The quality of the aggregated evidence depends on the amount of analyzable data available for meta-analysis. The purpose of this commentary is not to provide a meta-analysis or systematic review of outcome after total hip and knee arthroplasties, but to demonstrate that the lack of harmonized data reporting makes aggregate knowledge synthesis near impossible despite thousands of available publications.
Materials and methods
We reviewed 7979 publications related to total knee arthroplasty (TKA) and total hip arthroplasty (THA). The study pool was drawn from PubMed, MEDLINE, Embase, EMCare, Web of Science and Cochrane Library. To ensure inclusion and exclusion criteria were satisfied, the literature sample was subjected to a multi-round, paired peer-verified screening process (figure 1). Studies were included that met a 90% osteoarthritis population diagnosis rate and with a US study population. Exclusion criteria included irrelevant population, country, or outcome, insufficient follow-up (less than 2-year survival rate, revision rate, or PROM data), insufficient sample size (<100 for randomised controlled trials or <250 for observational studies), or extraneous area of focus (Unicompartmental Knee Arthroplasty (UKA), resurfacing, etc). Editorials and reviews were excluded. Between rounds, studies were reassigned for assessment in order to limit potential bias and optimize data extraction. Data were extracted from the publications which passed the systematic review process. This primary data set was analyzed to assess data reporting related to extractable PROM endpoints and implant survival (figure 1).
Following title and abstract screening, 294 papers met initial inclusion criteria for full-text assessment, of which 30 (10.2%) studies (2 including both hip and knee data) met final inclusion criteria. Survival rates were cited by 87.5% and 37.5% of THA studies and 50.0% and 41.7% of TKA studies at 2 and 5 years, respectively, which exceeded average reporting rates for joint-specific or generic PROMs (table 1). Given the potential for 8 THA and 24 TKA aggregated endpoints, total extractable data were markedly low.
We found two primary problems in our evidence assessment: (1) reporting of PROMs differs across publications and (2) endpoints are presented using incomparable parameters. These obstacles critically undermine consolidated analysis by reducing the number of analyzable endpoints per study.
Our results show that there is a dire need for standardization in the quantification and reporting of TJA outcome measures. The inability to compute aggregate data inhibits generation of surgical protocols and hinders device regulation, which is important for public health and policymaking. Publications that cannot be included in aggregate data analysis miss the opportunity to improve practice, the key goal of scientific publications. These findings corroborate past results: one recent review of four orthopedic journals identified over 40 different knee and hip specific PROM types.4 This multitude of outcome measures compromises between-study comparability and evidence synthesis for construction of performance benchmarks and clinical and regulatory guidelines.
Removing unnecessary obstacles to aggregated data analysis in publications related to joint replacement will lead to stronger evidence generation, subsequent improvement of TJA outcomes and reduction in scientific waste. We therefore call for publishers, stakeholders, and professional societies to harmonize data reporting in joint replacement with support from key regulators. It is essential that future PROM studies adopt standard reporting practices, minimum data guidelines, and PROM conversion crosswalks5 to prevent research waste.
Patient consent for publication
Contributors AYL, MN, JHH, ACC, SA, and P-HR contributed to inclusion and exclusion criteria, orthopedic study review, data extraction, and provided consultation on methodology. Authors AYL, MN, JHH, and P-HR were additionally responsible for analysis and manuscript writing and editing.
Funding This work was supported by the Food and Drug Administration, Center for Devices and Radiological Health, grant number U01FD006292.
Disclaimer Marc Nieuwenhuijse is an Editorial Board Member.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.