Tampere University of Technology

TUTCRIS Research Portal

Using and collecting fine-grained usage data to improve online learning materials

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Details

Original languageEnglish
Title of host publicationProceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering and Education Track, ICSE-SEET 2017
PublisherIEEE
Pages4-12
Number of pages9
ISBN (Electronic)9781538626719
DOIs
Publication statusPublished - 29 Jun 2017
Publication typeA4 Article in a conference publication
EventIEEE/ACM INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING -
Duration: 1 Jan 1900 → …

Conference

ConferenceIEEE/ACM INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING
Period1/01/00 → …

Abstract

As educators seek to create better learning materials, knowledge about how students actually use the materials is priceless. The advent of online learning materials has allowed tracking of student movement on levels not previously possible with on-paper materials: Server logs can be parsed for details on when students opened certain pages. But such data is extremely coarse and only allows for rudimentary usage analysis. How do students move within the course pages? What do they read in detail and what do they glance over? Traditionally, answering such questions has required complex setups with eye tracking labs. In this paper we investigate how fine-grained data about student movement within an online learning material can be used to improve said material in an informed fashion. Our data is collected by a JavaScript-component that tracks which elements of the online learning material are visible on the student's browser window as they study. The data is collected in situ, and no software needs to be installed on the student's computer. We further investigate how such data can be combined with data from a separate learning environment in which students work on course assignments and if the types of movements made by the students are correlated with student self-regulation metrics or course outcomes. Our results indicate that the use of rather simple and non-invasive tracking of students' movements in course materials allows material creators to quickly see major problem-areas in their materials and to highlight sections that students keep returning to. In addition, when the tracking data is combined with student course assignment data, inferring meaningful assignment-specific areas within the course material becomes possible. Finally, we determine that high-level statistics of user movements are not correlated with course outcomes or certain self-regulation related metrics.

Keywords

  • course material usage, e-learning, heat map, learning material evaluation, student behavior, visualization

Publication forum classification

Field of science, Statistics Finland