{"id":1233,"date":"2011-08-08T19:46:37","date_gmt":"2011-08-08T19:46:37","guid":{"rendered":"http:\/\/occamstypewriter.org\/mindthegap\/?p=1233"},"modified":"2011-08-08T20:01:15","modified_gmt":"2011-08-08T20:01:15","slug":"in-which-i-seek-the-evidence-and-ideas","status":"publish","type":"post","link":"https:\/\/occamstypewriter.org\/mindthegap\/2011\/08\/08\/in-which-i-seek-the-evidence-and-ideas\/","title":{"rendered":"In which I seek the evidence &#8211; and ideas"},"content":{"rendered":"<p>A post I initially wrote about <a href=\"https:\/\/occamstypewriter.org\/mindthegap\/2011\/08\/02\/in-which-my-heart-goes-out-to-postdoc-b\/\">the consequences of putting arbitrary sell-by dates on post-docs seeking fellowships<\/a> has been <a href=\"http:\/\/occamstypewriter.org\/athenedonald\/2011\/08\/07\/whoever-said-life-is-fair\/\">rebutted<\/a> by my esteemed OT colleague Athene Donald. It\u2019s an interesting post and I encourage people to have a look at it along with the many comments (and, since I don\u2019t want you to interpret the below quotes out of context, do go back and read them in their entirety). However, I\u2019d like to extract three assumptions that came up that interested me the most \u2013 and I\u2019d love to hear your views on them (paraphrased below):<\/p>\n<p><strong>Assumption 1.<\/strong> <em>People who\u2019ve taken a bit longer to achieve a decent track record and a portable line of independent research are less likely to become world-leading scientists (and are therefore less worthy of funding).<\/em><\/p>\n<p>Athene speculated that funding bodies probably see meanderers as a bad risk: \u201cI think the general view (of those on the committees) would be someone who has, apparently happily, taken postdoc after postdoc probably lacks the creative spark to go off and be an independent leader.\u201d <\/p>\n<p>She acknowledges, of course, that appearances are deceptive. But is it a generally sound assumption? There is also an alternative hypothesis: someone with more experience might actually do <em>more<\/em> for the money than someone with less experience. Athene admits she knows of no evidence one way or the other, and neither do I (aside from an unscientific gut feeling that experience is a good thing, not a detriment) so I\u2019m throwing this out to the crowd: has anyone seen any such studies? If so let me know.<\/p>\n<p>It would be reassuring if the eligibility criteria used by the bodies that fund science turned out to be evidence-based.<\/p>\n<p><strong>Assumption 2:<\/strong> <em>The current fellowship evaluation systems of the major funding bodies is as fair as is humanly possible, and it\u2019s not theoretically possible to remove arbitrary experience cutoffs without crippling the system.<\/em><\/p>\n<p>I think this one is a non-starter, personally. As far as I\u2019m concerned, anything that doesn\u2019t violate the laws of physics is not impossible, and I wouldn\u2019t accept this argument as a reason not to take a look at how things are done with a fresh eye. (I heard the word &#8220;impossible&#8221; quite a bit at the beginning of the <a href=\"http:\/\/scienceisvital.org.uk\/\">Science Is Vital<\/a> campaign, for example.)<\/p>\n<p>Deevybee noted: \u201cLike Athene, I have sat on committees that evaluate postdoc fellowships and I can only support what she says. When you have a heap of 50 applications in front of you and know that you can recommend 5 of them to go forward to the next stage and only half of those will get funded, the last thing you want to see is broadened criteria.\u201d<\/p>\n<p>The thing is, we\u2019re brainstorming here, so we\u2019re allowed to be creative. Nobody is suggesting that we ought to dump 200 more files of the same length onto poor Dorothy\u2019s desk. How about if those files were shorter in the first round, more manageable? As a nice analogy, do you remember when pre-submission enquiries started becoming increasingly common? Many of the scientists I knew worried that they wouldn\u2019t be able to make the quality of their paper shine through in an abstract format, and a few journal editors in my acquaintance were similarly concerned. A few decades later and, by and large, the humble \u201cpre-sub\u201d has become a genre appreciated by editors and authors alike for the most competitive journals, probably saving years of wasted time on both sides. I\u2019m not suggesting fellowship apps could be dealt with by abstract alone, but the analogy is meant to show that (1) it is theoretically possible for selection criteria of complex science to be successfully streamlined, and (2) it doesn\u2019t necessarily make more work to let in more applicants if your streamlining has been designed with care to compensate for the increase.<\/p>\n<p>As an aside, I\u2019m not convinced that removing the cut-off dates would lead to the magnitude of inundation feared. As Athene mentioned, many postdocs don\u2019t want to be independent. One way to test this is to ask the RS to supply the total numbers they received last year for the URF compared to this year; the difference might be this elusive figure. It wouldn\u2019t be perfect, as numbers can fluctuate year by year, but it would be a start.<\/p>\n<p><strong>Assumption 3:<\/strong> <em>People who are directly affected by an issue cannot think about it dispassionately or objectively.<\/em><\/p>\n<p>Although this issue does affect me directly, I am genuinely trying to explore it in a manner that is balanced and that takes into account all the factors. I don\u2019t think my post or any of my comments has been particularly heated. Rather, I\u2019m just enjoying the stimulating discussion \u2013 despite the implication that folks in my plights should just suck up and \u201ctake the cards they\u2019re dealt\u201d and that we\u2019re too close to the issue to see the other side. I\u2019ve been interested to hear from people who are adversely affected by these issues, and I\u2019ve been interested to hear from others who are on the other side and are helping to allocated the limited resources as fairly as they can. I would also point out that it\u2019s possible to turn this around: those on the other side are also capable of being overly passionate and could be at the risk of not weighing the opposite argument as fairly as they could either. <\/p>\n<p>I\u2019d suggest we think about this as scientists \u2013 with curiosity, with a practical bent and with maximum creativity. Is it a good idea to open up fellowship applicants to all mid-career postdocs? If so, what&#8217;s the best way to make it happen logistically &#8211; how could we consider streamlining the search for great projects and the future PIs to make them happen?<\/p>\n<p>All ideas welcome!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A post I initially wrote about the consequences of putting arbitrary sell-by dates on post-docs seeking fellowships has been rebutted by my esteemed OT colleague Athene Donald. It\u2019s an interesting post and I encourage people to have a look at &hellip; <a href=\"https:\/\/occamstypewriter.org\/mindthegap\/2011\/08\/08\/in-which-i-seek-the-evidence-and-ideas\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,19,34,22],"tags":[],"class_list":["post-1233","post","type-post","status-publish","format-standard","hentry","category-careers-2","category-science-funding","category-scientific-thinking","category-the-profession-of-science"],"_links":{"self":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/posts\/1233","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/comments?post=1233"}],"version-history":[{"count":0,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/posts\/1233\/revisions"}],"wp:attachment":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/media?parent=1233"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/categories?post=1233"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/tags?post=1233"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}