{"id":775,"date":"2013-04-22T16:37:37","date_gmt":"2013-04-22T16:37:37","guid":{"rendered":"http:\/\/inspiredtoeducate.net\/inspiredtoeducate\/?p=775"},"modified":"2013-04-22T16:43:15","modified_gmt":"2013-04-22T16:43:15","slug":"can-chatbots-increase-student-engagement-and-learning-case-study","status":"publish","type":"post","link":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/can-chatbots-increase-student-engagement-and-learning-case-study\/","title":{"rendered":"Can ChatBots Increase Student Engagement And Learning? [Case Study]"},"content":{"rendered":"\n<!-- Facebook Like Button v1.9.6 BEGIN [http:\/\/blog.bottomlessinc.com] -->\n<iframe src=\"http:\/\/www.facebook.com\/plugins\/like.php?href=https%3A%2F%2Finspiredtoeducate.net%2Finspiredtoeducate%2Fcan-chatbots-increase-student-engagement-and-learning-case-study%2F&amp;layout=standard&amp;show_faces=false&amp;width=450&amp;action=like&amp;colorscheme=light\" scrolling=\"no\" frameborder=\"0\" allowTransparency=\"true\" style=\"border:none; overflow:hidden; width:450px; height: 30px; align: left; margin: 2px 0px 2px 0px\"><\/iframe>\n<!-- Facebook Like Button END -->\n<p><a href=\"http:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-content\/uploads\/2013\/04\/Siri-snapshot.jpg\"><img loading=\"lazy\" class=\"alignnone size-full wp-image-776\" title=\"SIRI\" src=\"http:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-content\/uploads\/2013\/04\/Siri-snapshot.jpg\" alt=\"SIRI\" width=\"500\" height=\"350\" srcset=\"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-content\/uploads\/2013\/04\/Siri-snapshot.jpg 500w, https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-content\/uploads\/2013\/04\/Siri-snapshot-300x210.jpg 300w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><\/a><\/p>\n<p><strong>\u00a0<\/strong>Our ability to speak and have conversations to pass on knowledge is one of our most cherished human qualities.\u00a0\u00a0 As a young father, I have enjoyed seeing my little ones learn new words and learn how to communicate their needs.\u00a0 Learning language is one of our first big lessons of life.<\/p>\n<p>For me, it has been exciting to see the increasing capacity of computers emulating humans.\u00a0\u00a0 In chess programs, computers show remarkable strengths in solving planning problems.\u00a0\u00a0 Researchers have built cars that can drive without human guidance over challenging desert. \u00a0[2] Programs like WATSON can now win game shows like Jeopardy. [3] This is amazing science!<\/p>\n<p>Emulating human conversation, however, is still a frontier to be conquered.\u00a0\u00a0\u00a0 While programs exist that emulate human conversation (i.e. chatbots), these programs still feel like computer programs.\u00a0\u00a0 We can do better!\u00a0 Researchers from the center for Psychology at Athabasca University performed a study to answer the question if chatbots can emulate a historical figure and serve as a teaching tool in their distance learning programs.\u00a0\u00a0 For complete details on their study, please visit the <a href=\"http:\/\/psych.athabascau.ca\/html\/chatterbot\/ChatAgent-content\/EdMediaFreudbotFinal.pdf\" target=\"_blank\">following link<\/a>.<\/p>\n<p><strong>Results from study:<\/strong><\/p>\n<p>A sample of 53 students from Athabasca University psychology students were asked to chat with FreudBot for 10 minutes, a chatbot programmed with domain knowledge of Sigmund Freud.\u00a0\u00a0 The students were asked focused questions regarding the quality of the activity and how they would prioritize improvements to the Freudbot.\u00a0 Students replied to questions using a scale from 1 to 5 (1=negative, 5=very positive).\u00a0 [1]<\/p>\n<p>Let M = {average response from students}<\/p>\n<ul>\n<li>Would you recommend this activity be expanded to include other topics? Yes (M=4)<\/li>\n<li>How engaging did you find this activity? Yes (M=3.08)<\/li>\n<li>How memorable do you think this activity will be for learning about Freud? (M=3.04)<\/li>\n<li>How useful did you find this activity for learning about Freud? (M=2.96)<\/li>\n<\/ul>\n<p>The study observed that students had no issues on staying on task.<\/p>\n<p><strong>Opportunities for improvement for FreudBot:<\/strong><\/p>\n<ul>\n<li>The students desired to see improvements in the quality of chat responses.<\/li>\n<li>The students also desired to see improvements in the audio response of the system.<\/li>\n<\/ul>\n<p><strong>Personal reflections:<\/strong><\/p>\n<p>I believe we can achieve greater educational impact by exploring the following questions and observations:<\/p>\n<ul>\n<li style=\"text-align: left;\"><strong>ChatScript: <\/strong>This study used a technology known as AIML.\u00a0 In particular, I would be interested in seeing if ChatScript can produce measured improvements in the quality of chat responses.\u00a0\u00a0 AIML pattern matches by string or text matching.\u00a0 Let\u2019s say you wanted to make your chatbot vegetarian.\u00a0\u00a0 In AIML, you would need to manually encode rules for every form of meat. (i.e. turkey, bacon, ham, steak, etc.)\u00a0\u00a0 Using ChatScript\u2019s concept syntax (note the ~), you could express the rule elegantly in one line of code. [4]<span style=\"color: #3366ff;\">?: (Do you like ~meat?) No.\u00a0 I am vegetarian.<\/span>To learn more about the advantages of ChatScript from the creator of the system, please visit a .\u00a0 \u00a0It should be noted that Bruce\u2019s work won the<a href=\"http:\/\/www.loebner.net\/\" target=\"_blank\"> Loebner Prize<\/a> in 2010 and 2011.<\/li>\n<\/ul>\n<ul>\n<li><strong>Less is more: <\/strong>Is it easier to improve the educational impact of the chatbot when fewer rules need to be drafted and maintained?<\/li>\n<li><strong>Student modified chatbots:<\/strong> Can we make changing chatbots accessible to students? What would be the benefits of students correcting the chatbot?<\/li>\n<li><strong>Video: <\/strong>Let\u2019s say we\u2019re talking with a chatbot of Albert Einstein.\u00a0\u00a0 If the student asks \u201cwhat is your theory of relativity,\u201d then the system can provide a brief answer with a link to a YouTube video.<\/li>\n<li><strong>Link to virtual worlds:<\/strong> Can the learning outcomes and the level of engagement improve if the students used <a href=\"SecondLife.com\" target=\"_blank\">SecondLife<\/a> or <a href=\"minecraft.com\" target=\"_blank\">Minecraft<\/a> to encounter the historical character?\u00a0\u00a0 In an American history class, it would be cool to encounter Benjamin Franklin in his print shop or library in a virtual world.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>As always, we love to hear your comments and ideas. \u00a0 \u00a0Have a great week!<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Please consider supporting our Kickstarter project. \u00a0<\/strong><br \/>\n<iframe loading=\"lazy\" src=\"http:\/\/www.kickstarter.com\/projects\/1302746742\/histochat-chat-with-history-be-a-part-of-history\/widget\/card.html\" frameborder=\"0\" width=\"220\" height=\"380\"><\/iframe><\/p>\n<p>[1] Heller, B., Proctor, M., Mah, D., Jewell, L. &amp; Cheung, B. (2005). Freudbot: An Investigation of Chatbot Technology in Distance Education. In P. Kommers &amp; G. Richards (Eds.),\u00a0<cite>Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2005<\/cite>\u00a0(pp. 3913-3918). Chesapeake, VA: AACE.<\/p>\n<p>[2] <a href=\"http:\/\/en.wikipedia.org\/wiki\/Stanley_(vehicle)\">http:\/\/en.wikipedia.org\/wiki\/Stanley_(vehicle)<\/a><\/p>\n<p>[3] <a href=\"https:\/\/en.wikipedia.org\/wiki\/Watson_(computer)\">https:\/\/en.wikipedia.org\/wiki\/Watson_(computer)<\/a><\/p>\n<p>[4] <a href=\"http:\/\/sourceforge.net\/projects\/chatscript\/\">http:\/\/sourceforge.net\/projects\/chatscript\/<\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n\n<!-- Facebook Like Button v1.9.6 BEGIN [http:\/\/blog.bottomlessinc.com] -->\n<iframe src=\"http:\/\/www.facebook.com\/plugins\/like.php?href=https%3A%2F%2Finspiredtoeducate.net%2Finspiredtoeducate%2Fcan-chatbots-increase-student-engagement-and-learning-case-study%2F&amp;layout=standard&amp;show_faces=false&amp;width=450&amp;action=like&amp;colorscheme=light\" scrolling=\"no\" frameborder=\"0\" allowTransparency=\"true\" style=\"border:none; overflow:hidden; width:450px; height: 30px; align: left; margin: 2px 0px 2px 0px\"><\/iframe>\n<!-- Facebook Like Button END -->\n","protected":false},"excerpt":{"rendered":"<p>\u00a0Our ability to speak and have conversations to pass on knowledge is one of our most cherished human qualities.\u00a0\u00a0 As a young father, I have enjoyed seeing my little ones learn new words and learn how to communicate their needs.\u00a0 Learning language is one of our first big lessons of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[16,11,3,8],"tags":[],"_links":{"self":[{"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/posts\/775"}],"collection":[{"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/comments?post=775"}],"version-history":[{"count":4,"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/posts\/775\/revisions"}],"predecessor-version":[{"id":778,"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/posts\/775\/revisions\/778"}],"wp:attachment":[{"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/media?parent=775"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/categories?post=775"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/inspiredtoeducate.net\/inspiredtoeducate\/wp-json\/wp\/v2\/tags?post=775"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}