Last weekend I made my first foray to Science Online or, as it is now called SpotOn, in London. It doesn’t matter that I still regard myself as a novice in the world of social media (and yes, the words impostor syndrome did pass my lips at one point during the afternoon), I had been invited to serve on two panel discussions. One, on the (in)visibility of women in science, I have already written a little about in advance, with its ever-growing roll-call of blogs and associated resources; the other dealt with the challenge of juggling science communication work – broadly interpreted – with the day job. The latter was a very interactive session, with plenty of thoughtful input from the floor, and a diverse bunch of us on the panel: Brian Wecht, a theoretical physicist recently arrived from the US as a Lecturer at QMUL who had dreamed up the Story Collider; Jenny Rohn, novelist, OT blogger and scientist (not necessarily in that order); Anne Osterreider, a postdoc in love with the Golgi apparatus and with a half-time position to oversee engagement work at Oxford Brookes University and myself. We were directed, steered and otherwise enthusiastically prompted by joint session organisers Heather Doran (just completing her PhD at Aberdeen) and Jonathan Lawson, a genetics student from Cambridge, who together had set up a great session.
It is interesting to reflect how times have changed on the ‘engagement/outreach’ front since I was a student. No one suggested such a thing to me back then, and Physics at Work, which now gives most of the PhD students at the Cavendish an annual opportunity to share their enthusiasm for science with school children, had not yet come into existence. I think there are various current drivers which encourage PI’s themselves to engage with the public, broadly defined, and also to be enthusiastic when their students want to do likewise. These drivers, fruitful though they may be on the engagement front, are most certainly not necessarily welcomed by academics across the board. I would identify both the dreaded ‘pathways to impact’ statements required by UK Research Councils and the REF2014 exercise to be relevant here; the latter requires each Unit of Assessment to produce an Impact Statement although, confusingly, their definition of impact is not identical to that of the Research Councils.
Additionally we now live in a world where public engagement may be explicitly identified as an appropriate part of an applicant for promotion’s ‘general contribution’, as it is in my own University’s promotion criteria. This may not be the norm elsewhere, as it was singled out by one of BIS’ s expert groups on Science and Society as notable, and a quick Twitter trawl only threw up a handful of places which did the same. Furthermore, both Brian Wecht and (from the floor) Paula Salgado pointed out how their engagement activities had played a very positive role in their appointments as lecturers. For those setting out on an academic career who share a love of standing up in front of a hall full of kids, putting science videos out on YouTube or writing a student science magazine, all this can only be encouraging.
At the session I was handed a copy of my own University’s student science magazine, Bluesci, the oldest of several local magazines now being produced by UK Universities, and currently edited by session organiser Jonathan Lawson. Reading this copy on the train home, I was struck by some thoughts on citizen science in an article by a trio of graduate students in the Life Sciences (Luke Mashman, Jordan Ramsay and Nick Crumpton) on ‘Armchair Experimentation’, because they seem so reminiscent of a worry that Victorian scientists such as Joseph Hooker would have recognized. Discussing these crowdsourced projects, of which Galaxy Zoo is the prime example, they write
‘The worry is that without scientific training, citizen scientists may not accurately collect data and may introduce bias into the results. Simple projects, like counting the number of animals in an area, leave little room for error, however as projects increase in complexity, such as identifying the species of animal in the area, the risk of inaccuracy also increases, with one study suggesting that volunteers are only just over 10 per cent more accurate at identifying species than random guessing.’
Hooker spent much of his life as Director at Kew, once his own travelling days on the Erebus voyage to Australasia were over, succeeding his father William Hooker in this role. He relied on ‘amateurs’, in far-flung parts of the Empire, to send him samples of new plants to facilitate identification, classification and the search for what might be ‘useful’ plants for Imperial Britain. He found the nature of these interactions intensely frustrating. He clearly felt that Kew, being the centre of the botanical universe, should be responsible for identifying new species and naming them, but some of those sending him specimens were unwilling to concede this to him and strains often arose, as the biography by Jim Endersby makes very clear. This was in part due to tension between colonialists proud of their own country’s natural history and the mother country who sought control. It was also due to dispute between ‘lumpers’ and ‘splitters’ ie those who saw small variations as implying speciation as opposed to fluctuation in detail, possibly arising from differences in local soil or micro-climate so that ‘minute differences…when long dwelt upon…assume undue value’, as Hooker expressed it.
To quote from one of his letters
‘…..I feel sure that the New Zealand student will at first find it difficult to agree with me in many cases, as for example on so protean a Fern as Lomaria procera, whose varieties (to an inexperienced eye) are more dissimilar than are other species of the same genus. In this (and in many similar cases) he must bear in mind that I have examined many hundred specimens of the plant, gathered in all parts of the south temperate hemisphere, and have found, after a most laborious comparison, that I could not define its characters with sufficient comprehensiveness from a study of its New Zealand phases alone.’
In other words, I the ‘metromopolitan’ London expert, know more than you the local seeker and I can’t trust what you say. His solution was to ask the many local naturalists simply to send him their samples, with great care and attention as to the packaging, without attempting to name the species, but simply with a short description of ‘time, place and situation where it was gathered; of the stature, habit and other particulars of the kind of root it has; of the colour of the flower or of any other particulars which the specimen itself cannot supply or which may be lost in the process of drying’.
This was citizen science of a very different, Victorian and imperialist kind, but its concerns about accuracy are very similar to those expressed today. Some projects lend themselves better than others to mass observation and one always has to be aware of the dangers. Reading Endersby’s biography, I have to say Hooker came across as something of a control freak, but it may well have been no more than justified anxiety that misclassification did not propagate and confuse the work at Kew. Similar fears may well be shared by those who wish to draw upon some citizen science projects today, but that is not to say such ventures do not have many benefits which it would be a shame to lose. Nevertheless, it is worth remembering that just because there have been periods when encouraging non-technical experts was not the norm, citizen science, with all its attendant concerns, is in fact nothing new although its manifestation may be.
Really interesting blog. Citizen science is a powerful way of engaging people with current research and developments because they feel involved in the outcome, and then they in turn become wider ambassadors. But I also appreciate that scientists need accurate data for those same results and outcomes to be valid. Maybe in an ideal world there would be funding for scientists to train the citizen scientists in simple techniques that improve the accuracy (but I don’t work in research academia, so that may be completely ‘pie in the sky’ for other reasons than funding that I’m unaware of). What is not engaging is when laypeople become aware that scientists are doubtful about their input, as it tends to come across as an ‘ivory tower’ attitude rather than the genuine concern for validity that it actually is. I’ll be interested if any other commenters have any answers!
I think one difference between the Victorian citizen science and today’s version is that now, the observation can be published instantly, and can then be checked instantly. There isn’t the problem that all specimens must ben evaluated by Hooker – there are a thousand (or more) experts around the world who can put the time in.
However, it does still mean that there’s room for faulty observation, so as you say, there are some projects which are better suited to mass observation than others.
It’s important to remember that in Galaxy Zoo (and other projects put out by Zooniverse), each item is looked at by multiple citizen scientists. In Galaxy Zoo, in particular, on the order of 50 (fifty!) citizen scientists look at each image and record data on it. Even if each individual person is only able to make observations slightly above random (which seems a bit unlikely), the combination of many people making the same observation will yield a correct result (and with statistic significance with enough people, if you’re concerned about that).
Great post – I really enjoyed it. I’ve been particularly struck by citizen scientist projects that turn boring repetitive tasks of analysis into MPG video-games.
Great post (and thanks very much for your thoughts on the bluesci piece).
However, as one of the authors of the bluesci article I must point out that “our” thoughts were preceded by the sentence:
“Despite its increasing popularity citizen science is not without its critics, with some scientists expressing concerns over the validity of volunteer-generated data.”
Without this context, it sounds a lot like we the authors were ourselves being critical of citizen science (and although I can only comment for myself I, for one, am 100% for interested ‘non-scientists’ (ugh) being incorporated into scientific data gathering/analysis – especially after the excellent panel discussion at Spot On London earlier this month).
In fact the article (beginning on page 25 here: http://issuu.com/bluesci/docs/merge_final) is supportive of citizen science programmes and continues on to mention FoldIt, which has allowed citizen scientists to generate new and innovative ways of folding a protein in order to minimise its energy state, and our piece ended with the rather rosy paragraph:
“Citizen science projects have created a symbiotic relationship between the scientific community and the general public. By harnessing the computing power of the general public, scientists are able to analyse significantly more data and achieve far more than they could alone. Meanwhile, the public gains a greater understanding of science, the excitement of scientific discovery and, as gamification shows, entertainment.”
p.s. I think Verity’s point is a fine one: that the availability of information today means that the Hooker-era, ivory-tower-reality of locked-up knowledge is disappearing. If only all science was open access, then there’d be no need to worry about validity at all. Citizen scientists could just be called scientists.
p.p.s. @Margaret. Apologies we missed out that about the Zooniverse projects. The paper that that 10% figure came from should have been referenced in the issue but wasn’t. My editor’s away, but she included it in order to balance out all the citizen-science-is-really-really-good rhetoric. But, as she emailed me…
“When I was trying to find negative points on citizen science for the article I remember I spent hours trying to find something. It’s strange because so many popular science articles on citizen science claim that the data obtained by volunteers is inaccurate but very little primary data [seems to] exists to back this up.”
I’ll post up the doi as soon as she gets back to me.