CRITICAL APPRAISAL GUIDE

Cochrane Risk of Bias 2 (RoB 2) Tool: Step-by-Step Practical Guide

The Cochrane RoB 2 tool is the gold standard for critical appraisal of randomized trials in systematic reviews. This comprehensive guide explains the 5 bias domains, signalling question logic, and how to reach consistent domain and overall judgments without struggling with legacy macro-enabled spreadsheets.

Published October 12, 2026

Perform dual-blind RoB 2 appraisal in EvidenceFlow

Automatic domain scoring, reviewer conflict resolution, and PRISMA traffic light summaries.

Start Free Review →

1. Overview of the 5 RoB 2 Domains

Unlike the original RoB 1 tool (which relied on subjective reviewer impressions), RoB 2 introduces structured decision algorithms anchored by signalling questions across five core domains:

DomainFocus AreaKey ConsiderationsQuestions
Domain 1Randomization processAllocation sequence generation, concealment, baseline imbalances.1.1, 1.2, 1.3
Domain 2Deviations from intended interventionsBlinding of participants and carers, adherence, protocol deviations.2.1 – 2.7
Domain 3Missing outcome dataAttrition rates, reasons for dropout, sensitivity of findings to missingness.3.1 – 3.4
Domain 4Measurement of the outcomeBlinding of outcome assessors, objectivity of diagnostic criteria.4.1 – 4.5
Domain 5Selection of the reported resultPre-registration in clinical trial registries, selective reporting of analysis.5.1 – 5.3

2. How to Answer Signalling Questions

For each signalling question within a domain, reviewers must choose one of five standardized responses:

  • Yes (Y): Clear evidence in the trial report or registry protocol that the criterion was met.
  • Probably Yes (PY): Direct evidence is incomplete, but contextual trial details strongly imply the criterion was met.
  • Probably No (PN): Contextual details suggest the safeguard was absent or breached.
  • No (N): Definitive evidence that the safeguard was not used (e.g., explicit unblinded allocation).
  • No Information (NI): The published paper and supplementary files omit the detail entirely.

3. The Three Judgment Levels

Once signalling questions are answered, the algorithm assigns one of three levels to the domain:

Low Risk of Bias: The study is comparable to a well-conducted randomized trial; bias is unlikely to alter the clinical direction of findings.
Some Concerns: The trial has limitations or incomplete reporting that raise doubts, but lacks fatal methodological flaws.
High Risk of Bias: Significant methodological flaws that substantially diminish confidence in the estimate of effect.

4. Calculating Overall Risk of Bias

The overall judgment is determined according to strict rules:

  • Low overall risk: The trial is judged at low risk across all five domains.
  • Some concerns overall: The trial is judged to have some concerns in at least one domain, but no domain is judged at high risk.
  • High overall risk: The trial is judged at high risk in at least one domain, OR has some concerns across multiple domains that collectively compromise confidence.

5. Modern RoB 2 vs Legacy Macro Spreadsheets

Cochrane's official Excel template relies on VBA macros that frequently fail on macOS, trigger antivirus blocks, and make dual-reviewer reconciliation laborious. EvidenceFlow incorporates the official 2019 Cochrane algorithms natively, allowing independent reviewers to score studies, detect disagreements automatically, and export clean summary tables alongside your data extraction forms.

Start appraising studies in EvidenceFlow

Streamline screening, RoB 2 appraisal, extraction, and meta-analysis in one connected platform.

Create Free Account