{"id":2853,"date":"2015-12-04T11:24:06","date_gmt":"2015-12-04T10:24:06","guid":{"rendered":"http:\/\/occamstypewriter.org\/scurry\/?p=2853"},"modified":"2015-12-11T12:30:56","modified_gmt":"2015-12-11T11:30:56","slug":"jolly-good-fellows-royal-society-publishes-journal-citation-distributions","status":"publish","type":"post","link":"https:\/\/occamstypewriter.org\/scurry\/2015\/12\/04\/jolly-good-fellows-royal-society-publishes-journal-citation-distributions\/","title":{"rendered":"Jolly good fellows: Royal Society publishes journal citation distributions"},"content":{"rendered":"

Full marks and a side order of brownie points for the Royal Society: they have started publishing the citation distributions<\/a> for all their journals<\/a>.<\/p>\n

This might seem like an unusual and rather technical move to celebrate but it matters. It will help to lift the heavy stone of the journal impact factor that has been\u00a0squeezing the life out of the body scientific<\/a>. The Royal Society has now joined the EMBO Journal<\/a> in committing to be more transparent about the origins of this dubious and troubling metric.<\/p>\n

I don\u2019t wish to rehearse the details in full since I have previously\u00a0described the pernicious effects<\/a> of scientists\u2019 and publishers\u2019 obsession with journal impact factors and the value of making citation distributions available<\/a>. But in brief: I hope that the ready availability of these distributions \u2013 to show the skew and variation of the citation performance of the papers in any journal \u2013 will enable researchers to develop a more sophisticated approach to the evaluation of the work of our\u00a0peers.<\/p>\n

The image below shows the citation distribution for the Royal Society\u2019s Proceedings B journal<\/a>\u00a0\u2013 you can find the original by clicking on the \u2018Citation Metrics\u2019 link in the \u2018About Us\u2019 tab. As is the case for every academic journal, it shows that the impact factor, an arithmetic mean, is an indicator that over-estimates average performance and conceals a huge range in citation counts.<\/p>\n

\"ProcB<\/a><\/p>\n

As I wrote back in June<\/a>:<\/p>\n

\u2026the IF is a poor discriminator between journals<\/a> and a dreadful one for papers. Publishing citation distributions therefore directs the attention of anyone who cares about doing evaluation properly back where it belongs: to the work itself.<\/p><\/blockquote>\n

So three cheers for the Royal Society for having the courage to be so open with these data!<\/p>\n

Now: who\u2019s next?<\/p>\n

I have been discussing the idea of making citation distributions available with a number of other publishers and have heard some encouraging noises. It seems likely that there will be further significant moves in this direction in the new year, which I will be happy to report.<\/p>\n

I dare to be optimistic that before too long the practice may become widespread, and that we may have at our disposal a tool that helps us to do a better job of assessing research and researchers. This is by no means a revolution and we all know that old habits\u00a0die hard. Even so, this is a step in the right direction and I will take what I can get.<\/p>\n

Update (05\/12\/15, 00:55):<\/b>\u00a0<\/span>Better late than never, but I really should have thanked the Royal Society’s publishing director, Dr Stuart Taylor, for taking this initiative forward.<\/p>\n

Update (05\/12\/15, 01:05):<\/b> <\/span>Well I didn’t have to wait long to find out which would be the next journal to join the club. Nature Chemistry’s editor Dr Stuart Cantrill crunched the numbers, posted the distribution and has\u00a0written up his analysis<\/a>\u00a0on the Sceptical Chymist blog. He tells me there’ll be a link to his post from the journal homepage when it’s next updated.<\/p>\n

Update (11\/12\/15, 11:26):<\/b>\u00a0<\/span>Stuart Cantrill has clearly caught the citations distribution bug. He’s now also done a very nice comparative analysis of a selection of chemistry journals<\/a>. It shows, as expected, that the distributions are all approximately of the same shape and helped to re-infornce the message that journals with low impact factors can be relied on to still have papers that attract large numbers of citations.<\/p>\n","protected":false},"excerpt":{"rendered":"

Full marks and a side order of brownie points for the Royal Society: they have started publishing the citation distributions for all their journals. This might seem like an unusual and rather technical move to celebrate but it matters. It … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[152,6],"tags":[],"class_list":["post-2853","post","type-post","status-publish","format-standard","hentry","category-open-access-2","category-science"],"_links":{"self":[{"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/posts\/2853","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/comments?post=2853"}],"version-history":[{"count":0,"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/posts\/2853\/revisions"}],"wp:attachment":[{"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/media?parent=2853"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/categories?post=2853"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/occamstypewriter.org\/scurry\/wp-json\/wp\/v2\/tags?post=2853"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}