TELS Logo Banner Banner

Model Logging and Reporting

Added by Stephen Bannasch, last edited by Stephen Bannasch on Jul 30, 2006  (view change)

Model Logging and Reporting

This set of pages is for the discussion of what type of data to collect about learner use of interactive models to enable both generalized reporting tools to present selections and aggregations of useful data as well as model specific tools used by researchers to dig deeply into student interaction with a model. In addition

I have been inspired by Bob Tinker's draft paper: Student Learning With Models and Kevin McElhaney's research with his Airbag project, http://www.telscenter.org/confluence/download/attachments/9069/McElhaney_AERA_Proposal_2006_final.pdf?version=1.

I have been categorizing learner data into three types. Not every learner interaction with a model needs to produce all three types of data.

  1. learner artifacts: these are the data needed to save the state of the learners interaction with the component. In general this is useful only when the state needs to be re-rendered at some point. So for example it would obviously be essential for a note, question, discussion post, or drawing. It could well be useful for a model (either just the state of the model inputs or the inputs and the current state). Additionally the general architecture should support the continuation of of an activity where a learner left off. Saving of learner artifacts would not be needed for a step that had just a Flash visualization or a web page to read.
  2. learner meta data: this is schematized meta data about the learners interaction with the component and where appropriate it also includes schematized data about learner artifacts. At its simplest it encodes how long the learner used the component (from first click inside the component to when they close it). These data should be produced everytime a learner interacts with a component but my definition above: "from first click inside the component to when they close it" doesn't work as well for something that is just viewed/read. These are the main data that a reporting system can aggregate from.
  3. detailed log data of user actions: these data are normally only generated by components with rich interaction models and are saved for a researcher to data mine.

More details and drafts ...

Labels

 
(None)