- University Libraries
- Subject Guides
- Systematic and Scoping Reviews
- 5. Organize & Screen Search Results
Systematic and Scoping Reviews: 5. Organize & Screen Search Results
To Do during this step
- Combine and de-duplicate your search results
- Title/abstract screening by 2 or more people
- Full-text screening by 2 or more people
- Conduct citation searching on included articles
- Record the data from these steps in PRISMA flow diagram
Pro tip: Save time and stress by piloting the title/abstract and full-text screening with the whole team. There will be fewer conflicts to resolve later.
Reporting Your Process
You will need to report your screening process. Use these tools to record how many results are removed during each stage of screening.
The PRISMA Statement: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Evidence-based minimum set of items for reporting in systematic reviews and meta-analyses. Focused on randomized trials, PRISMA can also be used as a basis for reporting systematic reviews of other types of research, particularly evaluations of interventions.
The PRISMA flow diagram is a tool for recording and reporting the number of records during the different steps of a systematic review, along with reasons for exclusion. It is often included within the review or as supplemental material.
Tool for Generating a PRISMA Search Flow Diagram - from the Evidence Synthesis Hackathon
Complying with PRISMA and Standards for Cochrane: See Cochrane Handbook > Methodological Expectations of Cochrane Intervention Reviews (MECIR)
Managing References
Manage Your Search Results
Export the results of your search from each database. For instructions, check the Help or Support for the database.
Import the file into your citation management tool. For instructions, see your chosen citation management tool's Support or Help documentation.
De-duplicating
In your searches across multiple databases, there will be some articles that are retrieved in more than one database. This is expected, but you don't need to evaluate that article more than once. Before you start screening, de-duplicate. The processes described below are methods for removing duplicates while minimizing the risk of accidentally removing similar non-duplicate articles. Some of the screening tools also have effective de-duplication.
SRA-DM tool: Rathbone J, Carter M, Hoffmann T, Glasziou P. Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module. Syst Rev. 2015 Jan 14;4:6. doi: 10.1186/2046-4053-4-6. PubMed PMID: 25588387.
For desktop version of EndNote only: Bramer WM, Giustini D, de Jonge GB, Holland L, Bekhuis T. De-duplication of database search results for systematic reviews in EndNote. Journal of the Medical Library Association : JMLA. 2016;104(3):240-243. doi:10.3163/1536-5050.104.3.014<
Make a note of how many duplicates were removed for reporting in your paper. Your PRISMA flow diagram is a good place to keep track.
Screening the Articles
Steps for screening
The purpose of article screening to remove studies that are not eligible for inclusion.
Use your inclusion/exclusion criteria, two or more team members will conduct the following:
- Title/abstract screening: First, screen the title and abstracts of the studies and determine whether they are relevant to your research question. Since you conducted a comprehensive search, there will be items that were captured that are clearly not relevant.
- Full text screening: For studies included based on the title/abstract screening, obtain the full text and evaluate for inclusion/exclusion.
During both steps, record the reason for excluding an item. Review support software commonly contains features to simplify this.
Review support software will typically include a record screening/study selection function. This allows more than one reviewer to independently screen the records without seeing other reviewers' decisions to include or exclude studies, and thus reduces bias. Areas of disagreement can be resolved by consensus or by a third party who is an expert in the field.
Project management software for systematic reviews and other evidence synthesis:
These tools provide support for independent screening of the title/abstracts and the full text of articles. Some have additional features, such as support for data extraction or machine-learning to sort results. The health sciences librarian are not trained in these tools and there are currently no institutional subscriptions to these tools.
- RayyanFree web software and mobile app for SR project teams. Does not include data extraction.
- Rayyan tutorial seriesShort Rayyan video tutorials from Northeastern University Library
- CovidenceWeb-based software with support for quality appraisal/Risk of Bias phase and for data extraction. Easy export to popular statistical analysis programs. UW has site license - see Covidence guide for more information. Additional training resources below.
- ColandrWeb-based software with support for data extraction phase and export in CSV format (openable in Excel). Algorithms assist during screening and extraction. Free.
- DistillerSRWeb-based software with support for data extraction and analysis. Algorithms assist during screening and extraction. Free trial for individual students; fee-based for faculty and longer student projects.
- RevMan 5Facilitates preparation of protocols and full reviews, including text, characteristics of studies, comparison tables, and study data. It can perform meta-analysis of the data entered, and present the results graphically. Free for Cochrane authors. Note: Download of desktop RevMan 5 for free academic use ends April 2023.
- JBI SumariWeb-based software with support for quality appraisal/Risk of Bias phase, data extraction, and meta-analysis. Fee-based; free 14-day trial.
- EPPI-ReviewerWeb-based software with support for data extraction and analysis, including analysis of qualitative data. Algorithms assist during screening. Designed to support reviews that inform policy-makers.
- SR ToolboxSearch for systematic review tools: software, guides, checklists, standards.
Chart showing the features of different tools and which step during which they are relevant:
"Digital Tools for Managing Different Steps of the Systematic Review Process". Wu W, Akers K, Hu E, Sarkozy A, Vinson P. Library Scholarly Publications. 2018; 136. https://digitalcommons.wayne.edu/libsp/136
Reviewing retrieved references for inclusion in systematic reviews using Endnote. Bramer WM, Milic J, Mast F. J Med Libr Assoc. 2017 Jan; 105(1): 84-87.
Reference checking for systematic reviews using Endnote. Bramer WM. J Med Libr Assoc. 2018 Oct; 106(4): 542-6.
Covidence and Rayyan. Kellermeyer L, Harnke B, Knight S. J Med Libr Assoc. 2018 Oct; 106(4): 580-3. (Review)
Translation Services
GVSU does not have an official translation service for research articles. The following resources are worth trying, but may not be able to provide everything you need.
- Google TranslateStart here for initial title and abstract screening.
- Cochrane's Task ExchangeSign up and request translation help.
- Odegaard Writing & Research Center (OWRC)May be able to provide direction for more resources for translation.
- EthnoMedProvides student-translated handouts and may be willing to connect you with students or groups available to translate.
Citation Searching
Once you have completed the full-text screening, you will use the included articles to identify additional potentially similar articles in a process often called citation searching or citation chasing. This is done on the basis that it is probable that studies which cite or are cited by a source study will contain similar content. This practice is recommended in section 1.1.4 of the Technical Supplement to Chapter 4 of the 2022 Cochrane Handbook.
- Backward citation searching: Consult the reference lists for the included articles. Locate the title and abstract information for the references, then screen them according to your screening criteria.
- Forward citation searching: Locate articles which cite your included articles, then screen them according to your screening criteria.
Tools to make this easier:
- SpiderCite from SR-Accelerator
Export your included articles as an EndNote library, then import them into SpiderCite. SpiderCite will generate libraries of the references and the articles citing your included articles that can be imported back into EndNote for review. - citationchaser by Neal Haddaway
Paste in a list of the doi's or PMIDs for your included articles or import as an Excel or RIS file. citationchaser will generate RIS libraries of the references and the articles citing your included articles that can be imported into a citation manager or screening software for review. - OpenAlex from OurResearch (in development)
Mentioned in the 2022 Cochrane Handbook. Its API is currently operative, but as of Sept. 2022 its website is still in progress. - Reference checking for systematic reviews using Endnote. Bramer WM. J Med Libr Assoc. 2018 Oct; 106(4): 542-6.
- Last Updated: Nov 19, 2024 4:23 PM
- URL: https://libguides.gvsu.edu/SR