There are a number of different terms used in relation to reviewing literature:
- Literature reviews
- Scoping reviews
- Systematic reviews
- Meta-analyses
Use of these terms is often confusing. In this page we look at the differences and similarities. Before proceeding, have a look at this flowchart:
Literature reviews
A literature review is a generic term for the discussion of the literature on a given topic. Both scholarly, semi-scholarly and non-scholarly literature reviews exist but they are never described in these terms. The term ‘literature review’ is applied indiscriminately to all three. But there are differences between them.
- Scholarly literature reviews are formal documents usually written for a doctoral dissertation or as part of a publication such as a journal article. They normally aim to uncover a research gap within a specific area of scholarship, with a view to exposing this gap by means via the formulation of a hypothesis or research question. This gap in then explored in detail in subsequent chapter/sections of the paper/thesis.
- Semi-scholarly literature reviews appear in undergraduate essays and honours theses. While putatively ‘scholarly’ in terms of writing style, they closely approximate non-scholarly literature reviews as they rarely expose a research gap. They can be considered non-scholarly in all but writing style.
- Non-scholarly literature reviews do not expose a research gap, and merely wish to present a broad overview of an area of scholarship often for entertainment and/or educational purposes. There is little attempt to be comprehensive. The prose is written in simple, informal language to appeal to non-specialist audiences. Academics often write non-scholarly literature reviews for non-specialist online and print media publications (e.g., The Conversation, The Economist, and major newspapers) to draw attention to their scholarly literature reviews published in peer-reviewed papers. This is a form of self-promotion.
We cover how to write a scholarly literature review here and here.
Scoping reviews
A Scoping review (aka a “scoping exercise” or a “scoping study”) is an exploratory review that aims to investigate a broad research area in order to decide on what to investigate further. It aims to help in deciding the most appropriate research question to ask. Thus, a scoping review can lead to the need for a systematic review. In other words, one undertakes a scoping review to decide what to research ‘systematically’. Scoping reviews are used to determine the volume and extent of literature and for examining emerging evidence and when specific questions are still unclear. It does not attempt to answer a specific discrete question (Suchrew & Macaluso, 2019) Additionally, a scoping review will “map” or “chart” the evidence that might need further systematic review.
There are a number of reasons to write a scoping review:
- To identify the types of available evidence in a given field
- To clarify key concepts/definitions in the literature
- To examine how research is conducted on a certain
- topic or field
To identify key characteristics or factors related to a - concept
- As a precursor to a systematic review
- To identify and analyse knowledge gaps (Munn, et al. 2018)
A similar process to systemic reviews is followed for scoping reviews with minor variations:
- Identification of question or objectives
- Definition of inclusion and exclusion criteria
- Adoption of a systematic search strategy
- Selection of studies to review
- Extraction of data
- Charting of evidence
- Interpretation and presentation of results (Mellor, nd).
No such formal “charting” process is followed for literature reviews or systematic reviews. This makes literature reviews, systematic reviews and scoping reviews quite different.
Systematic reviews
A Systematic review poses a specific (usually clinical) research question and then outlines the literature that relates to that specific question. It uses pre-specified criteria in deciding on the literature to include/exclude and the evidence to admit in the discussion (Mellor, nd). A systematic review will often first produce a research protocol that outlines the need, aims and participants involved in the research (Carmeli, et al 2018). These kinds of reviews are often produced in the health sciences and other applied disciplines. Reviews are normally registered and submitted to an international research network, the Campbell-Cochrane Collaboration Library.
There are a number of reasons to write a systematic review:
- Uncover international evidence on a specific question
- Confirm current practice/address any variation/identify new practices
- Identify and inform areas for future research
- Identify and investigate conflicting results
- Produce statements to guide decision-making (Munn, et al. 2018)
Some of these are common to scholarly literature reviews, e.g., identify and inform areas of future research, but others are unique, e.g., guiding decision-making, in particular, clinical decisions. This distinguishes systematic review from literature reviews, as the latter tend to focus on theoretical contributions. Sometimes systematic review, like a literature review, can identify the need for further research (a ‘gap’), but this is usually a by-product of insufficient information to answer the clinical question posed. It is not the aim of a systematic review.
Typically, the following process occurs in a systematic review:
- Identification of the research question
- Definition of inclusion and exclusion criteria for selecting research articles
- Conduct of a search
- Selection of studies to review (sometimes done by two people independently)
- Extraction of data from included studies
- Evaluation of risk of bias in included studies
- Assessment of validity of findings
- Interpretation and presentation of results (Mellor, nd).
References
- Carmeli, M., Novo, G., Tusa, M., Mandoli, G. E., Corrado, G., Benedetto, F., Antonini-Canterin , F. & Citro, R. (2018). How to write a research protocol: Tips and tricks. Journal of Cardiovascular Echography, 28(3), 151-153. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6172884/
- Curtin University (2021). Systematic reviews in the health sciences. https://libguides.library.curtin.edu.au/Systematic-Reviews
- Curtin University (2021)). Research tips: What is a systematic review and how does it differ from a literature review? https://kemh.libguides.com/library/search_tips/faqs/what_is_systematic_review
- Hanratty, J. (2018). What is the difference between a systematic review and a meta-analysis. Campbell Collaboration. Meta-evidence blog. http://meta-evidence.co.uk/difference-systematic-review-meta-analysis/
- Kysh, K. (nd). What’s in a name? The difference between a systematic review and a literature review and why it matters? https://guides.libraries.psu.edu/ld.php?content_id=36146097
- Mellor, L. (nd). The difference between as systematic review and a scoping review. Covidence. https://www.covidence.org/blog/the-difference-between-a-systematic-review-and-a-scoping-review/
- Munn, J., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., and Aromataris, E. (2018). Systemic review or scoping review? Guidance for authors when choosing between a systemic or scoping review approach. BMC Medical Research Methods, 18(143), 1-7. https://doi.org/10.1186/s12874-018-0611-x
- Penn State Universities Libraries (2021). Nursing: A guide for locating nursing information resources for nursing education, practice and research. https://guides.libraries.psu.edu/c.php?g=319063&p=5222056
- PRISMA (2021). PRISMA extension of scoping reviews. http://prisma-statement.org/Extensions/ScopingReviews
- Siddaway, A. (nd). What is a systematic literature review and how do I do one? https://create.twu.ca/drheatherstrong/files/2018/02/WHAT-IS-A-SYSTEMATIC-LITERATURE-REVIEW-AND-HOW-DO-I-DO-ONE.pdf
- Suchrew, H. & Macaluso, M. (2019). Methods for research evidence synthesis The scoping review approach. Journal of Hospital Medicine, 14(7), 416-418. doi: 10.12788/jhm.3248
- University of Adelaide. JBI Manual for Evidence Synthesis (2020). JBI global wiki. https://wiki.jbi.global/display/MANUAL/11.2.7+Data+extraction University of Maryland (2021). Steps of a systematic review.https://lib.guides.umd.edu/SR/steps
For a downloadable helpsheet, see Reviewing the literature. See also: