{"id":687,"date":"2008-12-10T23:22:19","date_gmt":"2008-12-10T23:22:19","guid":{"rendered":"http:\/\/occamstypewriter.org\/mindthegap\/2008\/12\/10\/in_which_i_am_bested_by_an_algorithm\/"},"modified":"2008-12-10T23:22:19","modified_gmt":"2008-12-10T23:22:19","slug":"in_which_i_am_bested_by_an_algorithm","status":"publish","type":"post","link":"https:\/\/occamstypewriter.org\/mindthegap\/2008\/12\/10\/in_which_i_am_bested_by_an_algorithm\/","title":{"rendered":"In which I am bested by an algorithm"},"content":{"rendered":"<p>In many B-movies, machines try to take over the world. And in real life, we often joke about losing our lab jobs to them. As case in point, three of my five years in graduate school were largely consumed by sequencing a few megabases of DNA. After performing the radioactive chain-termination reactions, I&#8217;d carefully clean and tape up the big glass plates, prepare the fresh polyacrylamide gel and run the samples through. When the dye ran off I&#8217;d dry down the gel and put it on film. Every day, there was also the previous evening&#8217;s film to develop and then \u2013 the worst part, as far as I was concerned \u2013 staring at this film, with its ladders of tiny horizontal black dash marks, and entering the sequences manually into the computer, running one finger upward as I went so I wouldn&#8217;t lose my place. After those three years, the G, C A and T keys on my computer were visibly faded compared to their neighbors.<\/p>\n<p>\nToday, the latest production-scale sequencers can analyze millions of base pairs of DNA in <em>less than a day<\/em>.<\/p>\n<p>\nSobering, isn&#8217;t it? Viewed in this light, machines become the things that free up our time to do things that are a lot more creative. Back in the &#8217;90&#8217;s, the only way to understand viral evolution was to roll up my sleeves and sequence strains of the same virus over and over, documenting the mutations that occurred in a population during the course of infection. But imagine if I&#8217;d seen the lay of the land in a few weeks, and could have spent the next three years probing into the question in more meaningful ways? How much more would I have achieved?<\/p>\n<p>\nOf course one could argue that every generation has its tedious chore \u2013 for every megalithic task that has become routine, the latest state-of-the-art technique consumes our time in much the same way. I guess I&#8217;m living through this right now, as I do high-throughput RNA screens using only minor automation on five-year-old platforms and process hundreds of thousands of images visually. But I&#8217;ve seen the future (and have unsuccessfully dodged its o&#8217;er-enthusiastic sales reps): wardrobe-sized machines with robotic arms that do your entire screen with no human intervention. Indeed, they practically make you a cup of tea and nip down to the shops to pick up  your dry-cleaning.<\/p>\n<p>\nAs far as the automated image analysis, it&#8217;s still early days with regard to the features that I&#8217;m interested in. But I found last week that the future lurks around that corner too. I can&#8217;t go into any detail at the moment, but let&#8217;s just say I&#8217;m involved in a collaboration with some computer scientists who are keen to try out their image algorithms on something completely different. Enter my dataset. We started simply, choosing one morphological characteristic of interest: the tendency of some of my gene knockdowns to turn fried-egg-shaped cells into vaguely geometric objects. Although the human brain can see this differences instantly, it turns out to be surprisingly challenging for a computer to make the same call. But this new algorithm, after a few rounds of training, managed the task with about a 96% success rate. And when I nipped over to the CS department to see where it had gone wrong, I was mortified to find out that my eye had misclassified some fried eggs as triangles, and the programme was actually 100% correct.<\/p>\n<p>\nOK, this was embarrassing. But it was also fascinating, because the algorithm wasn&#8217;t looking at the same thing that I look at. All the pixel intensities had been isolated, plotted on polar coordinates, snipped into patches: strange random-looking patterns of light and dark that would not be out of place hanging in the Tate Modern. I am quite sure that whatever my visual cortex is doing, it is not seeing the data in this warped form. But nevertheless, the correct answer emerged.<\/p>\n<p>\nI&#8217;m not looking for a new job just yet. But I might think about more creative ways to fill my time.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In many B-movies, machines try to take over the world. And in real life, we often joke about losing our lab jobs to them. As case in point, three of my five years in graduate school were largely consumed by &hellip; <a href=\"https:\/\/occamstypewriter.org\/mindthegap\/2008\/12\/10\/in_which_i_am_bested_by_an_algorithm\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-687","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/posts\/687","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/comments?post=687"}],"version-history":[{"count":0,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/posts\/687\/revisions"}],"wp:attachment":[{"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/media?parent=687"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/categories?post=687"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/occamstypewriter.org\/mindthegap\/wp-json\/wp\/v2\/tags?post=687"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}