
Background: Comparing drug effectiveness in observational settings is hampered by several major threats, among them confounding and attrition bias bias (patients who stop treatment no longer contribute information, which may overestimate true drug effectiveness).
Objectives: To present points to consider (PtC) when analysing and reporting comparative effectiveness with observational data in rheumatology (EULAR-funded taskforce).
Methods: The task force comprises 18 experts: epidemiologists, statisticians, rheumatologists, patients, and health professionals.
Results: A systematic literature review of methods currently used for comparative effectiveness research in rheumatology and a statistical simulation study were used to inform the PtC (table). Overarching principles focused on defining treatment effectiveness and promoting robust and transparent epidemiological and statistical methods increase the trustworthiness of the results.
Points to consider
| Reporting of comparative effectiveness observational studies must follow the STROBE guidelines |
| Authors should prepare a statistical analysis plan in advance |
| To provide a more complete picture of effectiveness, several outcomes across multiple health domains should be compared |
| Lost to follow-up from the study sample must be reported by the exposure of interest |
| The proportion of patients who stop and/or change therapy over time, as well as the reasons for treatment discontinuation must be reported |
| Covariates should be chosen based on subject matter knowledge and model selection should be justified |
| The study baseline should be at treatment initiation and a description of how covariate measurements relate to baseline should be included |
| The analysis should be based on all patients starting a treatment and not limited to patients remaining on treatment at a certain time point |
| When treatment discontinuation occurs before the time of outcome assessment, this attrition should be taken into account in the analysis. |
| Sensitivity analyses should be undertaken to explore the influence of assumptions related to missingness, particularly in case of attrition |
Conclusion: The increased use of real-world comparative effectiveness studies makes it imperative to reduce divergent or contradictory results due to biases. Having clear recommendations for the analysis and reporting of these studies should promote agreement of observational studies, and improve studies’ trustworthiness, which may also facilitate meta-analysis of observational data.
Disclosure of Interests: Delphine Courvoisier: None declared, Kim Lauper: None declared, Sytske Anne Bergstra: None declared, Maarten de Wit Grant/research support from: Dr. de Wit reports personal fees from Ely Lilly, 2019, personal fees from Celgene, 2019, personal fees from Pfizer, 2019, personal fees from Janssen-Cilag, 2017, outside the submitted work., Consultant of: Dr. de Wit reports personal fees from Ely Lilly, 2019, personal fees from Celgene, 2019, personal fees from Pfizer, 2019, personal fees from Janssen-Cilag, 2017, outside the submitted work., Speakers bureau: Dr. de Wit reports personal fees from Ely Lilly, 2019, personal fees from Celgene, 2019, personal fees from Pfizer, 2019, personal fees from Janssen-Cilag, 2017, outside the submitted work., Bruno Fautrel Grant/research support from: AbbVie, Lilly, MSD, Pfizer, Consultant of: AbbVie, Biogen, BMS, Boehringer Ingelheim, Celgene, Lilly, Janssen, Medac MSD France, Nordic Pharma, Novartis, Pfizer, Roche, Sanofi Aventis, SOBI and UCB, Thomas Frisell: None declared, Kimme Hyrich Grant/research support from: Pfizer, UCB, BMS, Speakers bureau: Abbvie, Florenzo Iannone Consultant of: Speaker and consulting fees from AbbVie, Eli Lilly, Novartis, Pfizer, Roche, Sanofi, UCB, MSD, Speakers bureau: Speaker and consulting fees from AbbVie, Eli Lilly, Novartis, Pfizer, Roche, Sanofi, UCB, MSD, Joanna KEDRA: None declared, Pedro M Machado Consultant of: PMM: Abbvie, Celgene, Janssen, Lilly, MSD, Novartis, Pfizer, Roche and UCB, Speakers bureau: PMM: Abbvie, BMS, Lilly, MSD, Novartis, Pfizer, Roche and UCB, Lykke Midtbøll Ørnbjerg Grant/research support from: Novartis, Ziga Rotar Consultant of: Speaker and consulting fees from Abbvie, Amgen, Biogen, Eli Lilly, Medis, MSD, Novartis, Pfizer, Roche, Sanofi., Speakers bureau: Speaker and consulting fees from Abbvie, Amgen, Biogen, Eli Lilly, Medis, MSD, Novartis, Pfizer, Roche, Sanofi., Maria Jose Santos Speakers bureau: Novartis and Pfizer, Tanja Stamm Grant/research support from: AbbVie, Roche, Consultant of: AbbVie, Sanofi Genzyme, Speakers bureau: AbbVie, Roche, Sanofi, Simon Stones Consultant of: I have been a paid consultant for Envision Pharma Group and Parexel. This does not relate to this abstract., Speakers bureau: I have been a paid speaker for Actelion and Janssen. These do not relate to this abstract., Anja Strangfeld Speakers bureau: AbbVie, BMS, Pfizer, Roche, Sanofi-Aventis, Robert B.M. Landewé Consultant of: AbbVie; AstraZeneca; Bristol-Myers Squibb; Eli Lilly & Co.; Galapagos NV; Novartis; Pfizer; UCB Pharma, Axel Finckh Grant/research support from: Pfizer: Unrestricted research grant, Eli-Lilly: Unrestricted research grant, Consultant of: Sanofi, AB2BIO, Abbvie, Pfizer, MSD, Speakers bureau: Sanofi, Pfizer, Roche, Thermo Fisher Scientific