{"id":4976,"date":"2015-07-02T10:35:31","date_gmt":"2015-07-02T10:35:31","guid":{"rendered":"http:\/\/revoscience.com\/en\/?p=4976"},"modified":"2015-07-02T10:35:31","modified_gmt":"2015-07-02T10:35:31","slug":"helping-students-stick-with-moocs","status":"publish","type":"post","link":"https:\/\/www.revoscience.com\/en\/helping-students-stick-with-moocs\/","title":{"rendered":"Helping students stick with MOOCs"},"content":{"rendered":"

New techniques could help identify students at risk for dropping out of online courses.<\/strong><\/em><\/span><\/p>\n

\"Image:<\/a>
Image: iStock (edited by MIT News)<\/figcaption><\/figure>\n

CAMBRIDGE, Mass<\/strong>—\u00a0MOOCs \u2014 massive open online courses \u2014 grant huge numbers of people access to world-class educational resources, but they also suffer high rates of attrition.<\/span><\/p>\n

To some degree, that\u2019s inevitable: Many people who enroll in MOOCs may have no interest in doing homework, but simply plan to listen to video lectures in their spare time.<\/span><\/p>\n

Others, however, may begin courses with the firm intention of completing them but get derailed by life\u2019s other demands. Identifying those people before they drop out and providing them with extra help could make their MOOC participation much more productive.<\/span><\/p>\n

The problem is that you don\u2019t know who\u2019s actually dropped out \u2014 or, in MOOC parlance, \u201cstopped out\u201d \u2014 until the MOOC has been completed. One missed deadline does not a stopout make; but after the second or third missed deadline, it may be too late for an intervention to do any good.<\/span><\/p>\n

Last week, at the International Conference on Artificial Intelligence in Education, MIT researchers showed that a dropout-prediction model trained on data from one offering of a course can help predict which students will stop out of the next offering. The prediction remains fairly accurate even if the organization of the course changes, so that the data collected during one offering doesn\u2019t exactly match the data collected during the next.<\/span><\/p>\n

\u201cThere\u2019s a known area in machine learning called transfer learning, where you train a machine-learning model in one environment and see what you have to do to adapt it to a new environment,\u201d says Kalyan Veeramachaneni, a research scientist at MIT\u2019s Computer Science and Artificial Intelligence Laboratory who conducted the study together with Sebastien Boyer, a graduate student in MIT\u2019s Technology and Policy Program. \u201cBecause if you\u2019re not able to do that, then the model isn\u2019t worth anything, other than the insight it may give you. It cannot be used for real-time prediction.\u201d<\/span><\/p>\n

Generic descriptors<\/strong><\/span><\/p>\n

Veeramachaneni and Boyer\u2019s first step was to develop a set of variables that would allow them to compare data collected during different offerings of the same course \u2014 or, indeed, offerings of different courses. These include things such as average time spent per correct homework problem and amount of time spent with video lectures or other resources.<\/span><\/p>\n

Next, for each of three different offerings of the same course, they normalized the raw values of those variables against the class averages. So, for instance, a student who spent two hours a week watching videos where the class average was three would have a video-watching score of 0.67, while a student who spent four hours a week watching videos would have a score of 1.33.<\/span><\/p>\n

They ran the normalized data for the first course offering through a machine-learning algorithm that tried to find correlations between particular values of the variables and stopout. Then they used those correlations to try to predict stopout in the next two offerings of the course. They repeated the process with the second course offering, using the resulting model to predict stopout in the third.<\/span><\/p>\n

Tipping the balance<\/strong><\/span><\/p>\n

Already, the model\u2019s predictions were fairly accurate. But Veeramachaneni and Boyer hoped to do better. They tried several different techniques to improve the model\u2019s accuracy, but the one that fared best is called importance sampling. For each student enrolled in, say, the second offering of the course, they found the student in the first offering who provided the closest match, as determined by a \u201cdistance function\u201d that factored in all the variables. Then, according to the closeness of the match, they gave the statistics on the student from the first offering a greater weight during the machine-learning process.<\/span><\/p>\n

In general, the version of the model that used importance sampling was more accurate than the unmodified version. But the difference was not overwhelming. In ongoing work, Veeramachaneni and Boyer are tinkering with both the distance function and the calculation of the corresponding weights, in the hope of improving the accuracy of the model.<\/span><\/p>\n

They also continue to expand the set of variables that the model can consider. \u201cOne of the variables that I think is very important is the proportion of time that students spend on the course that falls on the weekend,\u201d Veeramachaneni says. \u201cThat variable has to be a proxy for how busy they are. And that put together with the other variables should tell you that the student has a strong motivation to do the work but is getting busy. That\u2019s the one that I would prioritize next.\u201d<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

New techniques could help identify students at risk for dropping out of online courses. CAMBRIDGE, Mass—\u00a0MOOCs \u2014 massive open online courses \u2014 grant huge numbers of people access to world-class educational resources, but they also suffer high rates of attrition. To some degree, that\u2019s inevitable: Many people who enroll in MOOCs may have no interest […]<\/p>\n","protected":false},"author":6,"featured_media":4977,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[],"class_list":["post-4976","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-education"],"featured_image_urls":{"full":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"thumbnail":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc-150x150.jpg",150,150,true],"medium":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc-300x200.jpg",300,200,true],"medium_large":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"large":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"1536x1536":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"2048x2048":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"ultp_layout_landscape_large":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"ultp_layout_landscape":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"ultp_layout_portrait":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",600,400,false],"ultp_layout_square":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",600,400,false],"newspaper-x-single-post":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"newspaper-x-recent-post-big":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",540,360,false],"newspaper-x-recent-post-list-image":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",95,63,false],"web-stories-poster-portrait":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",639,426,false],"web-stories-publisher-logo":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",96,64,false],"web-stories-thumbnail":["https:\/\/www.revoscience.com\/en\/wp-content\/uploads\/2015\/07\/MIT-Predict-Mooc.jpg",150,100,false]},"author_info":{"info":["Amrita Tuladhar"]},"category_info":"Education<\/a>","tag_info":"Education","comment_count":"0","_links":{"self":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/posts\/4976","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/comments?post=4976"}],"version-history":[{"count":0,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/posts\/4976\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/media\/4977"}],"wp:attachment":[{"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/media?parent=4976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/categories?post=4976"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.revoscience.com\/en\/wp-json\/wp\/v2\/tags?post=4976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}