Extended definition
Gray literature is the body of research output disseminated outside commercial channels and the peer-reviewed journal circuit: theses and dissertations, conference abstracts, technical reports, government and non-governmental documents, working papers, preprints, and institutional materials. The name marks the middle zone between the formally published and the unpublished. It is not lower-value literature by definition; it is literature that did not pass through the bottleneck of commercial publishing and therefore tends to escape the traditional indexing databases. Paez (2017) argues that it is an important resource in systematic reviews precisely because it captures evidence that never reached a journal. Mahood and colleagues (2014) detail why it should be searched and how much that costs: gray literature broadens a review’s scope and gives a more complete view of the available evidence, but searching it is laborious, with no standardized indexing or uniform controlled vocabulary.
When it applies
Gray literature applies centrally to evidence synthesis, especially the systematic review, where ignoring it biases the search. It applies directly to countering publication bias: since null and negative results are less likely to become an article, part of them exists only in reports, theses, and proceedings, and incorporating them corrects the distortion that affects meta-analyses. Adams and colleagues (2016) show its role in public health, a field where government and agency documents carry evidence that does not appear in journals. It applies to technology assessment, evidence-based policy, and applied areas where the relevant knowledge circulates in reports. It also applies to timeliness: preprints give access to findings before formal publication.
When it does not apply
Gray literature does not apply without critical appraisal: not having passed peer review means rigor must be judged case by case, and treating every gray document as reliable evidence is an error symmetric to ignoring it. It does not apply as a casual search: including it requires an explicit strategy, a record of the sources consulted, and reproducibility, on pain of selection becoming convenience. It does not apply cheaply: Mahood and colleagues (2014) document the high time cost, which must be anticipated in the protocol. It does not apply as a substitute for the peer-reviewed literature, but as a complement that balances it. And it does not apply without attention to transience: gray documents change address or vanish, which requires recording the access date and, when possible, archiving the consulted version.
Applications by field
- Public health: government and agency reports carry evidence absent from journals, central to policy.
- Evidence synthesis: systematic reviews that search gray literature to reduce publication bias.
- Applied social sciences and economics: working papers and institute reports as a current source of results.
- Technology assessment and regulation: technical documents and submissions that do not become journal articles.
Common pitfalls
The first pitfall is ignoring gray literature and thereby inheriting publication bias in the search. The second is the opposite extreme: accepting every gray document as reliable evidence without appraising its rigor. The third is searching it without a strategy, turning inclusion into non-reproducible convenience. The fourth is not budgeting the time the search requires, underestimating the effort documented in the literature. The fifth is failing to record the access date or archive the consulted version, leaving the review dependent on documents that may change or disappear.