How reliable and useful is Cabell's Blacklist ? A data-driven analysis

Authors

  • Christophe Dony ULiège Library, University of Liège, Belgium.
  • Maurane Raskinet ULiège Library, University of Liège, Belgium.
  • François Renaville ULiège Library, University of Liège, Belgium.
  • Stéphanie Simon ULiège Library, University of Liège, Belgium.
  • Paul Thirion ULiège Library, University of Liège, Belgium.

DOI:

https://doi.org/10.18352/lq.10339

Keywords:

predatory journals, scholarly publishing, academic libraries, blacklists, research integrity

Abstract

In scholarly publishing, blacklists aim to register fraudulent or deceptive journals and publishers, also known as “predatory”, to minimise the spread of unreliable research and the growing of fake publishing outlets. However, blacklisting remains a very controversial activity for several reasons: there is no consensus regarding the criteria used to determine fraudulent journals, the criteria used may not always be transparent or relevant, and blacklists are rarely updated regularly. Cabell’s paywalled blacklist service attempts to overcome some of these issues in reviewing fraudulent journals on the basis of transparent criteria and in providing allegedly up-to-date information at the journal entry level. We tested Cabell’s blacklist to analyse whether or not it could be adopted as a reliable tool by stakeholders in scholarly communication, including our own academic library. To do so, we used a copy of Walt Crawford’s Gray Open Access dataset (2012-2016) to assess the coverage of Cabell’s blacklist and get insights on their methodology. Out of the 10,123 journals that we tested, 4,681 are included in Cabell’s blacklist. Out of this number of journals included in the blacklist, 3,229 are empty journals, i.e. journals in which no single article has ever been published. Other collected data points to questionable weighing and reviewing methods and shows a lack of rigour in how Cabell applies its own procedures: some journals are blacklisted on the basis of 1 to 3 criteria – some of which are very questionable, identical criteria are recorded multiple times in individual journal entries, discrepancies exist between reviewing dates and the criteria version used and recorded by Cabell, reviewing dates are missing, and we observed two journals blacklisted twice with a different number of violations. Based on these observations, we conclude with recommendations and suggestions that could help improve Cabell’s blacklist service.

Author Biography

Christophe Dony, ULiège Library, University of Liège, Belgium.

Christophe Dony, PhD, works as a liaison and research librarian at the University of Liège. His research interests include open science, scholarly communications, comics studies, and postcolonial literatures.

Downloads

Published

2020-09-10

How to Cite

Dony, C., Raskinet, M., Renaville, F., Simon, S., & Thirion, P. (2020). How reliable and useful is Cabell’s Blacklist ? A data-driven analysis. LIBER Quarterly: The Journal of the Association of European Research Libraries, 30(1), 1–38. https://doi.org/10.18352/lq.10339

Issue

Section

Articles
Received 2020-04-08
Published 2020-09-10