Purpose: Selection of osteoporosis (OP) treatment is affected by patients’ disease severity and fracture risk, potentially confounding real-world comparative effectiveness and safety studies of antiresorptive medications. To inform the choice of valid treatment contrasts for subsequent real-world comparative studies, we assessed comparability of antiresorptive OP treatment groups using negative control outcomes (NCOs). Patients and Methods: Women aged ≥ 55 years in Optum © Clinformatics ® Data Mart from October 2010 through June 2019 who received denosumab, zoledronic acid (ZA), or oral bisphosphonates (BPs) were included. We estimated the 1-year cumulative risks for 12 NCOs by treatment group among treatment-naïve and treatment-experienced women using augmented inverse-probability of treatment and censoring weighted (AIPW) estimation. A Bayesian sensitivity analysis was conducted to aggregate estimates and associated variances into a form characterized by magnitude and probability. Results: Women in both treatment-naïve (n = 199,335) and treatment-experienced (n = 33,296) cohorts initiated treatment at a mean age of 71.8 years. Treatment-naïve women initiating denosumab had similar 1-year risks of most NCOs compared with initiators of ZA (maximum observed RD = 2.47% for colon cancer screening). However, significant risk differences were observed for seven NCOs when comparing ZA or denosumab with oral BPs. Among treatment-experienced women, all NCOs indicated similar risks when comparing denosumab to alendronate alone. Only one NCO (dementia: RD = 0.42%) was associated with treatment when comparing denosumab to oral BPs, and one (influenza vaccine: RD = 3.57%) was associated with treatment when comparing ZA to oral BPs. Results of the Bayesian analysis aligned with our qualitative interpretations. Conclusion: Comparative studies including denosumab or ZA versus oral BPs among treatment-experienced, commercially insured women aged ≥ 55 years in the United States are likely valid with respect to comparability of treatment groups. Our results do not support conducting observational studies examining these treatment contrasts in the overall treatment-naïve population. However, comparison of ZA and oral BPs among treatment-naïve women with a prior fracture may be undertaken with minimal expected residual bias. Plain Language Summary: Osteoporosis is a chronic condition that makes bones weaker and more likely to break, especially in older women. There are several medications available to prevent fractures. These include tablets called oral bisphosphonates and injections like zoledronic acid and denosumab. Doctors choose which treatment to prescribe based on many factors such as the person’s health and fracture risk. However, these choices can make it difficult for researchers to fairly compare how well treatments work in real-world settings. To better understand which treatments can be reliably compared, we looked at insurance claims data from more than 230,000 US women aged 55 years and older who started or switched osteoporosis medications. We compared groups of women taking different treatments by measuring their risk of having unrelated health events—such as getting a flu shot or a check-up—that should not be affected by any osteoporosis drug. If one group experienced more of these events compared to another, it might mean the two groups are different in ways that could bias future research. We found that women who switched from one osteoporosis medication to another were similar enough to allow for fair comparisons across treatments. However, among women starting treatment for the first time, only comparisons between denosumab and zoledronic acid appeared valid. Comparisons involving oral bisphosphonates showed signs of bias, unless we restricted analyses to women who had recently broken a bone. These findings will help guide future studies that aim to accurately evaluate the real-world effectiveness and safety of osteoporosis medications. Keywords: osteoporosis treatment, comparative effectiveness, negative control outcomes, real-world evidence, Bayesian framework
Hurwitz et al. (Sun,) studied this question.