27 Nov 2024 Introduction to a new risk of bias tool for network meta-analysis
This live webinar has already taken place. Scroll down to view the video recording.
—
In this TI Methods Speaker Series webinar Dr. Carole Lunny described a new risk of bias tool for network meta-analysis, developed using rigorous evidence based methodology including piloting and refinement. She presented examples to illustrate each item in the tool and demonstrated how the tool will allow objective rating of the risk of bias in a network meta-analysis.
—
TITLE: Introduction to a new risk of bias tool for network meta-analysis (RoB NMA tool) with examples
WHEN: Wednesday, November 27th, 2024 at 12:00 PM PST [convert to your local time]
WHERE: This is a free online webinar.
SPEAKER: Dr. Carole Lunny, MPH, PhD, Senior Research Scientist, HEOR division of Precision AQ; and affiliated with the Cochrane Hypertension Group, Therapeutics Initiative, UBC.
About the topic: Network meta-analyses (NMAs) provide comparative evidence about the effects of all healthcare interventions for a given condition. However, NMA results can be undermined by flaws in design, conduct, analyses and reporting. Several tools are available for the critical appraisal of an NMA. However, none aim specifically to assess the risk of bias (RoB) in an NMA. We aim to describe a new RoB NMA tool to assess the risk of bias in an NMA, developed over 4 years using rigorous methodology. We will present examples to illustrate each item in the tool. As an international steering committee, we developed a protocol and made conceptual decisions about the tool’s structure. We developed the tool using a multi-step approach: definition of the scope of the tool; conduct a methodological review to compile a preliminary list of concepts related to bias in NMAs; web-based Delphi survey to collate expert opinion regarding the quality of NMAs; an online survey to solicit decision makers needs; and refinement through piloting. The RoB NMA tool includes three domains: bias arising from the network characteristics/geometry, bias arising from potential effect modifiers, and bias arising from statistical synthesis. The three domains comprise a total of 17 statements which can identify potential limitations of the NMA, leading to a judgement about the risk of bias within each domain (low, high or unclear risk of bias). The tool should be used to identify potential limitations in the way an NMA was conducted that may lead to bias in its results or conclusions. The RoB NMA tool should be conducted as a supplement to the assessment of the risk of bias in the underlying evidence review, for example using the ROBIS tool. Piloting of the RoB NMA tool is ongoing and if you are interested please reach out.
About the speaker: Dr. Carole Lunny is a Senior Research Scientist, HEOR division of Precision AQ and affiliated with the Cochrane Hypertension Group, Therapeutics Initiative at the University of British Columbia. Dr Lunny completed her PhD training as a clinical epidemiologist and methodologist at Cochrane Australia in January 2019 from Monash University’s School of Public Health and Preventive Medicine. Dr Lunny specialises in methods for research synthesis and critical appraisal of systematic reviews, network meta-analyses, randomised controlled trials, overviews of reviews, and observational studies. She routinely tells people she is an expert in identifying bias and error in clinical research studies. Dr Lunny’s current academic research is focused on further testing of the the RoB NMA tool, methods for ‘overviews of reviews’, and an AI tool to automate the methodological quality and risk of bias at the systematic review-level called “WISEST AI”. You can access her publication at: https://pubmed.ncbi.nlm.nih.gov/?term=lunny+c&sort=date.
About the TI Methods Speaker Series: The TI Methods Speaker Series are offered free of charge and everyone is welcome. The event is usually held at noon on the last Wednesday of each month via Zoom videoconference. The presentations are recorded and the video recordings are posted online. Click here to view the list of talks offered in 2024.
No Comments