FROM MY PT SCHOOL NOTES · EVIDENCE-BASED PHYSICAL THERAPY · CHAPTER 14
How Do You Read a Systematic Review Without Being Misled?
A systematic review can organize evidence, but a pooled estimate does not erase weaknesses in its component studies.
What was the review question?
The lecture distinguishes a narrative review, which may summarize selected literature with less formal methods, from a systematic review that begins with a focused question and explicit search, selection and appraisal methods. A systematic review treats individual studies as the units being evaluated.
How were studies selected and appraised?
Major appraisal questions in the source: were search methods described, were inclusion/exclusion criteria defined in advance, were relevant studies missed because of language or publication restrictions, was study quality examined, and do the findings follow from the evidence that was actually included?
What does a pooled result mean?
A meta-analysis statistically pools compatible results from multiple studies. Potential advantages discussed include more precise effect estimates and improved ability to detect effects, while heterogeneity in participants, interventions, outcomes or study methods may limit whether pooling is appropriate.
The source also discusses publication bias, uncertainty and differences between results of individual studies and the review’s overall conclusions. The key distinction is that statistical pooling cannot eliminate limitations inherited from weak or biased studies.
Check your reasoning: If a meta-analysis pools many weak studies, is its answer automatically trustworthy?
No. Pooled precision does not guarantee low bias, appropriate outcomes or relevance.
Updated-standard context
The class references historical QUOROM reporting guidance. PRISMA 2020 is the current widely used reporting standard for systematic reviews. Reporting quality is different from methodological quality; a pooled estimate does not guarantee trustworthy evidence. Compare with your lecture notes and https://www.prisma-statement.org/prisma-2020.
Put it into practice
Scenario: Two systematic reviews reach different conclusions about an exercise intervention. One includes studies of very different populations and outcomes.
What should you conclude?
Reasoning: Compare eligibility, search methods, risk-of-bias appraisal, outcome definitions and heterogeneity. A pooled number isn’t automatically more relevant than a carefully selected, well-appraised body of evidence.
Common trap: Equating ‘meta-analysis’ with guaranteed high-quality evidence. Remember: Appraise the review and the studies it contains.
Current reference (separate from my class notes): PRISMA 2020 reporting guideline. Check review search, selection and reporting details; PRISMA guides transparent reporting but does not itself guarantee low risk of bias.
Based on my Evidence-Based PT class-notes companion, source lecture Chapter 17. Examples and knowledge checks are educational, not official NPTE material. Compare with your course and current primary sources.
