Mixed-Methods Systematic Reviews: Combining Quantitative and Qualitative Evidence

A mixed-methods systematic review deliberately combines quantitative and qualitative evidence within a single review, addressing questions that neither evidence type alone can fully answer -- for instance, not just whether an intervention works, but also why it works or doesn't, and how patients or practitioners actually experience it. Doing this well requires more than running two separate syntheses side by side.

Why combine evidence types at all

Quantitative evidence, through meta-analysis, can establish whether an intervention has a statistically measurable effect. Qualitative evidence can illuminate why an intervention succeeds or fails in practice, what barriers or facilitators exist, and how the people actually receiving or delivering the intervention experience it. Neither answers the other's question, and a genuinely comprehensive review of complex interventions often needs both.

The three main integration designs

A convergent design runs the quantitative and qualitative syntheses in parallel, largely independently, and brings them together only at the final interpretation stage, comparing and contrasting what each synthesis found. A sequential design lets one synthesis inform the other's design -- for instance, an initial qualitative synthesis identifying which outcomes matter most to patients, which then shapes which quantitative outcomes the subsequent meta-analysis prioritizes. A fully integrated design synthesizes both evidence types together from the start, using a framework or matrix explicitly designed to combine quantitative and qualitative findings within a single synthesis process, rather than treating them as two separate products merged only afterward.

JBI's framework for mixed-methods reviews

JBI provides one of the more developed formal methodologies specifically for mixed-methods systematic reviews, offering structured guidance on convergent, sequential, and other integration approaches, alongside specific guidance on appraising and extracting data from both quantitative and qualitative included studies within the same review.

Searching for both evidence types

Your search strategy needs to be built to capture both quantitative and qualitative studies relevant to your question, which often means broader or differently structured search terms than a purely quantitative systematic review would use, since qualitative studies are frequently indexed and described using different terminology and are sometimes less consistently indexed by controlled vocabulary than quantitative trial literature.

Appraisal across two different traditions

Quantitative included studies get appraised using RoB 2, ROBINS-I, or another design-matched quantitative tool. Qualitative included studies get appraised using CASP or an equivalent qualitative-specific tool, reflecting qualitative research's different epistemological standards. A mixed-methods review genuinely needs both appraisal traditions applied correctly to their respective study types, not a single tool stretched to cover both.

The actual integration step

The genuinely challenging part of a mixed-methods review is the integration itself -- meaningfully connecting what your quantitative synthesis found about effect size with what your qualitative synthesis found about mechanism, experience, or context, rather than simply presenting two separate results sections with a brief concluding paragraph gesturing at their relationship. A matrix or table explicitly mapping specific quantitative findings against related qualitative themes is one practical way to make this integration concrete and visible to readers, rather than left implicit.

Reporting standards for mixed-methods reviews

Reporting guidance for mixed-methods systematic reviews is less universally standardized than PRISMA is for purely quantitative reviews, though guidance continues to develop specifically for this review type. In the meantime, transparently reporting your specific integration design, your separate appraisal approaches for each evidence type, and your actual integration method is the most defensible current practice, even without a single universally agreed checklist to follow.

Common pitfalls in mixed-methods reviews

Treating the qualitative synthesis as a decorative addition to a quantitative review's main conclusions, rather than genuinely integrating it, is a frequent and avoidable weakness. Applying a purely quantitative mindset to appraising qualitative studies, expecting the same kind of appraisal criteria that don't actually reflect qualitative research's own standards, is another common mismatch worth actively guarding against.

When a mixed-methods approach is genuinely warranted

Not every systematic review question benefits from combining evidence types -- a narrow, purely effectiveness-focused question may be well served by a standard quantitative systematic review alone. Mixed-methods design is most valuable specifically when your research question genuinely requires understanding both whether something works and why or how it works in practice, and forcing a mixed-methods structure onto a question that doesn't actually need it adds complexity without adding genuine value to the review's conclusions.

Training a team for mixed-methods work specifically

Because mixed-methods reviews require genuine fluency in two different research traditions, quantitative and qualitative, within the same project, teams new to this review type benefit from explicit upfront discussion of how each tradition's standards and expectations differ, rather than assuming a team member skilled in one automatically transfers that skill directly to appraising or synthesizing the other evidence type. Pairing team members with complementary strengths, one more experienced in quantitative synthesis and another in qualitative methods, working the integration stage together rather than separately, often produces a more genuinely combined final synthesis than either working in isolation and handing off a finished section to the other. This kind of genuinely collaborative integration work, done together rather than sequentially, is often what distinguishes a mixed-methods review that reads as a single, coherent piece of scholarship from one that reads as two separately authored sections stapled together under a shared title. Readers, and particularly experienced peer reviewers, tend to notice this difference readily, and a genuinely integrated mixed-methods review reads as considerably more valuable and more carefully constructed than one that merely presents two adjacent, loosely connected analyses. Done well, a mixed-methods systematic review offers a genuinely richer, more complete answer than either a purely quantitative or purely qualitative approach could provide alone, which is exactly the value proposition that justifies its additional methodological complexity. That richer answer is, in the end, the entire reason this more demanding integration work is worth the additional effort it requires. That value is precisely why the additional complexity is worth taking on when the question genuinely calls for it. Teams that recognize this early tend to plan their integration approach more deliberately from the very start.