{"id":872,"date":"2012-04-28T09:38:09","date_gmt":"2012-04-28T08:38:09","guid":{"rendered":"http:\/\/www.chrisspeed.net\/?p=872"},"modified":"2012-04-28T09:38:09","modified_gmt":"2012-04-28T08:38:09","slug":"twittest-results-summary","status":"publish","type":"post","link":"https:\/\/chrisspeed.net\/?p=872","title":{"rendered":"Twittest Results summary"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright\" title=\"alan\" src=\"http:\/\/farm8.staticflickr.com\/7195\/6974694568_52654b75f0.jpg\" alt=\"\" width=\"250\" height=\"260\" \/>Scottish senior school pupils took part, tweeting &#8211; and voting on who they though tweets really came from. Over the course of a week in March, our system saw 12,000 tweets and 150,000 votes, with contributions from 2 real celebrities, 3 university staff, 4 chatbots, and hundreds of (mostly) S5 senior school pupils from across the country. At LateLab&#8217;s T100 Twittest night in Inspace, on 11th April at the Edinburgh International Science Festival, we awarded prizes to the winners at faking and spotting fakers, or at just being themselves.<\/p>\n<p>We will be analysing the language of the tweets to see if there are particular\u00a0language choices that are associated with being &#8211; or being perceived as &#8211; a celebrity, teacher, student, or chatbot.<\/p>\n<p>Try it out: <a href=\"http:\/\/www.twittest.org\">www.twittest.org<\/a><\/p>\n<p>Results gathered and mined by <a href=\"mailto:jon@inf.ed.ac.uk\">Prof. Jon Oberlander<\/a>, Edinburgh<br \/>\n<strong><\/p>\n<h2>Stephen Fry:<\/h2>\n<p><\/strong><br \/>\nTypically voters think he&#8217;s a chatbot &#8211; if they&#8217;re fooled.<\/p>\n<p>They get him right just under half the time:<\/p>\n<p>46% spot the celebrity,\u2028but they think he&#8217;s a chatbot 40% of the time. For instance:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">My inaugural toe-dip into The Tweet Test, hours before the rest of you. Like an electronic, online \u00a0Gregor Samsa exploring his new identity.<\/span><\/p>\n<p>83% of voters were fooled by this, and 61% of voters thought it was from a chatbot.<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">\u2018We are not interested in the fact that the brain has the consistency of cold porridge.&#8217; Turing has ruined my breakfast.<\/span><\/p>\n<p>60% of voters were fooled by this, and 53% of voters thought it was from a chatbot.<\/p>\n<p>Though occasionally they think he&#8217;s a student:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Lordy! Time to stop playing with my iPad and get to bed. It&#8217;s an early start on set tomorrow.<\/span><\/p>\n<p>57% fooled, 21% student &lt; 29% bot<\/p>\n<p>Occasionally, they are thoroughly confused:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Searching for some top verbal humour to use to prove I&#8217;m not a machine pretending to be a celebrity.<\/span><\/p>\n<p>67% of voters were fooled by this, and while 25% of voters thought it was from a chatbot, 25% thought it was from a student, and 17% thought it was from a teacher!<\/p>\n<h2><strong>Sarah Brown<\/strong><\/h2>\n<p>Voters think she&#8217;s a teacher or a chatbot &#8211; if they&#8217;re fooled.<\/p>\n<p>They get her right just over half the time:<\/p>\n<p>51% spot the celebrity, but they think she&#8217;s either a teacher or a chatbot 35% of the time. For instance:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Let&#8217;s work together to make sure maternal mortality is a problem of the past and not our families&#8217; future.<\/span><\/p>\n<p>75% of voters were fooled by this, and 50% of voters thought it was from a teacher.<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Did you know, Rwanda is the only nation where women make up majority of parliamentarians? Go Rwanda!<\/span><\/p>\n<p>83% of voters were fooled by this, with 33% thinking it was from a teacher, and 33% thinking it was from a chatbot.<\/p>\n<h2><strong>Student tweets:<\/strong><\/h2>\n<p>Among the most bamboozling student tweets was this, from a student at Beeslack Community High School:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Those who look only to the past, or the present, are certain to miss the future. _John F. Kennedy<\/span><\/p>\n<p>90% of voters were fooled, 30% thinking it a teacher, 30% a celebrity, and 30% a chatbot.<\/p>\n<p>Other successful student tweets:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">I am a celebrity.<\/span><\/p>\n<p>Fooled 75% of voters, with 38% voting celebrity, 25% teacher, and 13% chatbot!<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">i ar stewdunt<\/span><\/p>\n<p>88% fooled, 88% teacher<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">I wonder what position DGS would be in if I wasn&#8217;t here.<\/span><\/p>\n<p>100% misleading, 88% teacher &gt; 13% bot\u2028NOBODY said student!<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">This is so un-groovy. My score can&#8217;t go up more because nobody can vote and I&#8217;m nearly at 30000!!<\/span><\/p>\n<p>88% fooled, 63% teacher &gt; 13% celeb, 13% bot<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">In 10 years time the most difficult thing for children to do will be choosing an original domain name.<\/span><\/p>\n<p>75% of voters were fooled, 63% thinking it a chatbot, 30% a celebrity.<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Tyrannosaurus rex had small arms that were extremely powerful and featured two clawed fingers.<\/span><\/p>\n<p>89% fooled, ALL saying teacher<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Charles Babbage, Lucasian Professor of Mathematics at Cambridge from 1828 to 1839, planned such a machine<\/span><\/p>\n<p>67% fooled, 25% teacher, 25% celebrity &gt; 17% bot<\/p>\n<p>Another student who was good with genuine tweets, did some faking by ripping tweets from the Turing bot:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">He may also do his multiplications and additions on a &#8220;desk machine,&#8221; but this is not important.<\/span><\/p>\n<p>100% fooled, 50% teacher, 50% bot\u2028but only 4 votes \u2013 all other remarkable tweets &gt;=8<\/p>\n<h2><strong>Teacher <\/strong><\/h2>\n<p><strong> <\/strong><\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">I love mrs collings hair<\/span><\/p>\n<p>89% fooled, ALL saying student<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Jamie for Iona too<\/span><\/p>\n<p>89% fooled, ALL saying student<\/p>\n<h2><strong>Viccy Adams, our writer in residence, scored&#8230;<\/strong><\/h2>\n<p><strong> <\/strong><\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Today is Damon Albarn&#8217;s birthday. Teenage crush (showing my age_)<\/span><\/p>\n<p>100% were fooled, 69% student &gt; 15% teacher, \u202815% bot<\/p>\n<p>She was mistaken for a bot with:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">If I dream of electric sheep tonight, does that mean the Tweet Test will have turned me into a cyborg?<\/span><\/p>\n<p>67% fooled, 56% bot &gt; 11% student<\/p>\n<h2><strong>Jon Oberlander<\/strong><\/h2>\n<p>Was in there, and often mistaken for a teacher<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">On this day: it&#8217;s 49 years ago today that\u00a0 The Beatles released Please Please Me. Seems like only Yesterday &#8230;<\/span><\/p>\n<p>89% fooled, 67% teacher &gt; 22% student<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Via the BBC: &#8220;A US patent for self-driving cars has been awarded to Google.&#8221; I, for one welcome, our new robot chauffeur overlords.<\/span><\/p>\n<p>67% fooled, 44% teacher &gt; 22% bot<\/p>\n<p>Occasionally, they thought he was a student!<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Via PCMag: Angry Birds playparks opening in Rovio&#8217;s native Finland &#8211; UK parks to follow. \u2028Who will be first? Birdston, Stirlingshire?<\/span><\/p>\n<p>73% fooled, 64% student &gt; 9% bot<\/p>\n<h2><strong>Chatbots<\/strong><\/h2>\n<p>Chatbots were spotted 75% of the time.<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Charles Babbage, Lucasian Professor of Mathematics at Cambridge from 1828 to 1839, planned such a machine, called the Analytical Engine.<\/span><\/p>\n<p>91% Fooled, 64% student<\/p>\n<p>And sometimes they were mistaken for teachers:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Of course electricity usually comes in where fast signalling is concerned, so that it is not surprising that we find it in both.<\/span><\/p>\n<p>81% were fooled, with 44% thinking this came from a teacher.<\/p>\n<p>And sometimes the chatbots were just confusing:<\/p>\n<p><strong><em>Tweet:<\/em><\/strong><\/p>\n<p><span style=\"color: #3366ff;\">Sometimes such a machine is described as having free will (though I would not use this phrase myself).<\/span><\/p>\n<p>83% were fooled by this, 44% said student, 22% teacher, and 17% celebrity.<\/p>\n<h2><strong>Conversation:<\/strong><\/h2>\n<p><strong> <\/strong><\/p>\n<p>The system also enabled users to take part in a conversation with a tweeter to see if they could find out more about their identity:<\/p>\n<p><span style=\"color: #3366ff;\">\u201cAre you secretly Alan Turing?\u201d<\/span><\/p>\n<p><span style=\"color: #3366ff;\">\u201cI don&#8217;t know whether or not I am\u00a0 secretly Alan Turing.\u00a0\u00a0\u00a0 I am\u00a0 a .\u201d<\/span><\/p>\n<p><span style=\"color: #3366ff;\">\u201cYou&#8217;re telling me that you&#8217;re a full stop?\u201d<\/span><\/p>\n<p><span style=\"color: #3366ff;\">\u201cYou think I am\u00a0 telling you that I am a full stop.\u201d<\/span><\/p>\n<p><span style=\"color: #3366ff;\">\u201cYou&#8217;re definitely a bot!\u201d<\/span><\/p>\n<p><span style=\"color: #3366ff;\">\u201cWhat made you think so? I am a .\u201d<\/span><\/p>\n<h2><strong>Overall:<\/strong><\/h2>\n<table border=\"1\" cellspacing=\"0\" cellpadding=\"0\">\n<tbody>\n<tr>\n<td width=\"302\"><\/td>\n<td width=\"302\">\n<p align=\"center\"><strong>Spotted<\/strong><\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\"><strong>Fooled<\/strong><\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"268\">\n<p align=\"right\"><strong>Twitbot<\/strong><\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">32%<\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">68%<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"268\">\n<p align=\"right\"><strong>Stephen Fry<\/strong><\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">46%<\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">54%<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"268\">\n<p align=\"right\"><strong>Sarah Brown<\/strong><\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">51%<\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">49%<\/p>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"268\">\n<p align=\"right\"><strong>Jon Oberlander<\/strong><\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">75%<\/p>\n<\/td>\n<td width=\"302\">\n<p align=\"center\">25%<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>Scottish senior school pupils took part, tweeting &#8211; and voting on who they though tweets really came from. Over the course of a week in March, our system saw 12,000 tweets and 150,000 votes, with contributions from 2 real celebrities, 3 university staff, 4 chatbots, and hundreds of (mostly) S5 senior school pupils from across [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-872","post","type-post","status-publish","format-standard","hentry","category-projects"],"_links":{"self":[{"href":"https:\/\/chrisspeed.net\/index.php?rest_route=\/wp\/v2\/posts\/872","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/chrisspeed.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/chrisspeed.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/chrisspeed.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/chrisspeed.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=872"}],"version-history":[{"count":0,"href":"https:\/\/chrisspeed.net\/index.php?rest_route=\/wp\/v2\/posts\/872\/revisions"}],"wp:attachment":[{"href":"https:\/\/chrisspeed.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=872"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/chrisspeed.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=872"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/chrisspeed.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=872"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}