Pleiade

Management & Consultancy

Blog

APCs in the (French) wild

by

A shopping spree for data

My French colleagues Antoine Blanchard and Diane Thierry (from Datactivist) and me had the opportunity to do a study on APC costs for the French Ministry of Higher Education and Research (MESR).

Our proposal – to build a dataset with articles by French authors from the ground up and use that for a calculation of the APC costs – was accepted. We had a plan to do this, but – as is the case with many plans – we had to adjust it many times to circumvent unexpected obstacles.

It became a shopping spree for data. We started with data from the French Open Science Barometer (BSO). They delivered data of all journal articles with a French author for the year 2013-2020. This we put in our shopping cart (my colleague Diane did all the shopping cart work with R) and started shopping around for more relevant data.

Who are the corresponding authors? We shopped these data from the Web of Science. Which articles were Open Access published in Gold or Hybrid journals? We shopped these data from OpenAlex. Couperin gave us a dataset with journal titles they had contracts with and with DOAJ and QOAM data we identified hybrid, Gold and Diamond journal titles. BSO already had made the connection with OPEN APC data for the prices. I have to admit that sometimes our shopping efforts failed: we had originally misunderstood the exact data set-up of some datasets so that incorporation was not possible.

However, in the end we were able to reach our goal – a dataset with trustworthy data of articles by French authors from 2012 to 2020. This made a retrospective analysis possible and based upon that Antoine and Diane built a model with R for a prospective analysis.

Our whole data shopping spree and the analyses made it a super interesting study, while – I think – the results have interesting implications for the future. I show below the main results.

You see in the picture that – if all trends as seen in 2012 to 2020 continue unchanged – the French institutions will pay around €50 million in 2030 on APCs in the wild (the red line). We also made – with the help of Couperin – an estimate of the subscription expenditures in that year (the grey line). Finally we calculated the cost in a fully Open Access world, which we defined as 90% APC-paid OA and 10% Diamond OA.

Personally I found it very interesting that the hybrid situation (subscriptions and APCs in the wild) would cost around 150 million euro in 2030, while the full OA situation would take around 170 million of APC payments. Not much of a difference if you take into account all the margins of error of these calculations.

Let me finish with a warning: predicting the future is always a tricky business. However, with using a lot of data and some modelling, we noticed at presentations that some people think these predictions are absolutely sure to happen. But in reality, these predictions are based on the 2013-2020 data and are nothing more (or less) that extending the trend-lines of that period, albeit with a very complicated statistical model.

For more information, see the poster or the full report

Dashboards on the scholarly journal landscape

by

Asking your questions to the data

During the first lockdown period I learned to work with Microsoft Power BI and the world of big data opened up for me. I used my limited competences to prepare dashboard on two datasets on scholarly journals: (1) the GOAJ5 dataset which is produced by Walt Crawford based on the DOAJ dataset and solely consists of fully Open Access journals (2) the dataset used by Quality Open Access Market, which aggregates data from JournalTOCs, DOAJ and CrossRef, and thus also includes hybrid journals.

The first dashboard I prepared together with Rob Johnson for a presentation at the OASPA conference in 2020 and the results were published at the blog of the site of Research Consulting.

The dashboard is fully interactive and clickable, and, with the Ctrl key, it is possible to click several items simultaneously. With the symbol in the bottom right corner, it is possible to enlarge the dashboard for greater visibility (as circled in red below).

The other dashboard is published at the site of QOAM and republished below:

There are two important differences between the two datasets: the GOAJ dataset does not include hybrid journals and the articles per journal title are hand counted by Walt Crawford (hats off to him!), while the article counts in the QOAM datasets are from CrossRef and thus includes only articles with a DOI.

Both datasets together give a rather accurate view on the journal landscape. However, questions remain: subscription journals are not included (and are estimated to have 6000 titles with about 500,000 articles a year). Also, there are thousands of Chinese and Japanese journal titles (J-Stage, Kiyo), often in their languages, some with English-language abstracts (and quite a lot are OA) that seem not included in these datasets. This also might explain the discrepancy between the total number of articles in these datasets (QOAM counts 2.1 million articles for the year 2019) and what Dimensions.ai shows (4.3 million articles in 2019). Another question is which journals are truly international. For example, Dutch authors publish only in about 10,000 journal titles of the about 40,000 journal titles. Clearly, there is more to study on the scholarly journal landscape and surely more dashboards will follow.

The road to 100% Open Access

by

Three studies for the VSNU and dashboards on the scholarly journal landscape

From September 2020 to January 2021 I carried out studies for the VSNU on Open Access: a feasibility study on 100% OA for Dutch research publications and a study into alternative publication platforms . This study led to 3 reports with so many pages that I think not many people have read these in their entirety. The reason for all those pages being that it was a collage of quite different studies: trend analyses, an analysis of the Dutch research publications, interviews with other consortia working on OA, group discussions with stakeholders, and studies on OA monographs and alternative platforms (you can find the 3 reports under publications).

In this blog I would like to highlight the present status of OA in journal articles and focus on the trends and possible developments in OA. For this, I also can use of the dashboards that I made based on the DOAJ data as they are processed by Walt Crawford and that I made based on the data set used by QOAM which includes also hybrid journals.

The trend is clearly up. The figure presents the results of a study by Piwowar, assessing the OA percentages in 2019 and extrapolating the trends to 2025. She expects in 2025 52% Gold or Diamond OA, either in fully OA journals or in hybrid journals. If this trend continues, one can expect that in 2030 about 80% of the articles will be published Gold OA. Thus, mission accomplished? Hopefully yes, but there are two potential problems with this: (1) Will it really increase to 80% and more? (2) If so, does this not create another problem: inequity for authors who cannot pay the publication costs?

Will it really increase to 80% and up? In Europe, albeit that some countries go for the gold route and others for green, one can expect that the trend in Europe will go up. However, the rest of the world might be a different story. In the USA, the HE sector is very decentralised and a mix of public and private institutions. The University of California is the eye-catcher with regard to OA, but the question is how representative it is for the HE-institutes in the USA. China is nowadays the biggest producer of scientific articles in the international journal literature: which direction will they choose to go? These factors make the continuation of the trend in the direction of 100% quite incertain.

Let’s assume that the trend will lead to universal OA. Are we then in the ideal situation? In my view, that depends on the mix between Gold OA journals (the author/institution pays the publication costs) and Diamond journals (a sponsor pays for the publication costs).

If you click on the link above, you will see a dashboard on Gold and Diamond journals. The dashboard is based on the GOAJ5 data by Walt Crawford. You can see two things:

  • The top 5, 10 or 25 publishers of 2019 articles mainly have Gold OA journals: an oligopoly similar to the subscription/hybrid journal market appears to be forming in this market.
  • The Diamond journal market is very fragmented with lots of (very) small publishers.
  • About 39% of the articles in these journals are published in Diamond journals.

Looks like plenty of choice for authors who cannot afford the publication costs, doesn’t it? However, this percentage is misleading: in another dashboard https://www.qoam.eu/qoam-journal-composition you can see that the percentage of articles in Diamond journals with a DOI is down to 7% if you include the articles in hybrid journals. There are two reasons for this: (1) over half of the Diamond journal titles do not give DOI’s to their articles and (2) most articles are (still) published in hybrid journals. Let us suppose that in the situation of universal OA, a mix of 20% Diamond and 80% Gold OA articles would give authors who cannot afford publication costs enough choice to select an adequate publication channel. In that case, there is still a lot of work to do for Diamonds journals/platforms: an increase in article production and a better adherence to standard operational and technical requirements in scholarly publishing (such as DOI’s per article) will be needed. Can I coin a new term here? The fact that many Diamond journal publishers cannot keep up with the rapidly changing operational and technical publication standards is logical: they publish only 1 or 2 journal titles with a shoestring operation. Therefore I propose the term ‘minimum viable publishing unit’, the minimum operation that is needed to keep up with the publishing standards. I do not know what this minimum viable publishing unit would entail. My guess would be that you will need at least two dozen of staff to keep up with the technological side of publishing. Of one thing you can be assured: the debate on how to design an universal Open Access scholarly journal system will continue, if we ever get there…

Gebruikersgedrag bij Digitaal Erfgoed

by

Gedragsprofielen vruchtbare benadering

Het project Klantinzicht van het Netwerk Digitaal Erfgoed nadert zijn afronding. In de zomer 2018 is de voorloper van het project van start gegaan: Chris Groeneveld benaderde me om te kijken of de invalshoek van John Falk voor fysieke musea – namelijk het segmenteren van gedrag van gebruikers in plaats van het segmenteren in gebruikersgroepen – van toepassing zou zijn op digitaal erfgoed. John Falk bestudeerde gedrag van museumbezoekers en maakte onderscheid in verschillende soorten gedrag, dat bezoekers afhankelijk van de context (een bezoek alleen of met kinderen bijvoorbeeld) vertonen.

Gedragsprofielen Digitaal Erfgoed waren het resultaat. We begonnen met een uitgebreide literatuurstudie en een aantal workshops met mensen uit het erfgoedveld. Dit leidde tot de ontwikkeling van de acht Gedragsprofielen. Deze werden ook getoetst: eerst door interviews met gebruikers (de acht dekten de lading van alle soorten gedrag m.b.t. digitaal erfgoed) en door een grote publieksenquête met meer dan 1500 respondenten. Dit vormde de start voor het officiële NDE project Klantinzicht. Met de Gedragsprofielen onder de arm werd er ook een onderzoek uitgevoerd naar de klantreizen naar digitaal erfgoed. 26 personen hebben een week lang elke avond een klantreizen uitgevoerd naar digitaal erfgoed én deze gedocumenteerd. De 75 gedocumenteerde klantreizen gaven een goed beeld van hoe de klantreizen tot stand komen, wat de keuze tussen de erfgoedsites bepaalt en hoe mensen van Gedragsprofielen kunnen switchen.

Wat zouden we nog verder kunnen onderzoeken? Met die vraag organiseerden we digitale denktanksessies tijdens de eerste lockdown met mensen uit het erfgoedveld. Hun reactie was algemeen: ‘Mooi hoor, die onderzoeksresultaten, maar graag een vertaling naar onze praktijk’. Aldus geschiedde: we ontwikkelden een praktische handleiding voor de presentatie van erfgoed op een website voor de kleinere instellingen, we formuleerden functionele specificaties per Gedragsprofiel en keken hoe je die Gedragsprofielen kon meten in de praktijk. De publicaties van het project staan op de website van NDE maar je kan ze ook hieronder vinden.