Is it possible to see the distribution of answers to a specific question across all students? Having this capability would help me identify the common mistakes

and address those in class.

The "Answer log" page gives this information, but only to a single student at a time. When you have 150 students, checking each one separately would take a while.

Yoav

I have never figured out how to parse such a table so that it makes any sense in terms of finding patterns of mistakes.

On the other hand, I have thought about using something similar to "Answer Hints" and code what I would expect students to answer based on known common mistakes. It would then be possible to count how many students' answers matched the corresponding predicted mistake answers.

However, this would require significant work, both to the problem library and to the supporting WeBWorK system. The "pg" file defining problems would have to include some type of coded method (like ANS) that would define expected answers based on common errors. Then the student evaluation routine of WeBWorK would parse the same PG files but would interpret them to compute predicted erroneous answers and then check the student answers in the database for matches to these answers.

I have settled on giving students feedback for common mistakes within the problem using the AnswerHints macros. But this does not let me, as instructor, know which/how many students are encountering these issues.

Best wishes,

D. Brian Walton

For example, entering "*" in the student field will get you the answers for all the student for that problem, or entering "*" in the problem number field will get you all the problems for a given student. I don't remember if they use regex syntax (with * handled as a special case), or file glob wildcards, but expect the former.

Davide

I have found a slightly different way to analyze the answers - download the

file "answer_log" and use my own script to do it.

Here are two lines from the file:

[Sun Aug 19 00:40:19 2012] |yfreund|multi-Step_questions|1|0000000 1345351219 1 1 0

[Sun Aug 19 00:41:01 2012] |yfreund|multi-Step_questions|1|1000000 1345351261 {0,2,3,4,5,6,7,8} 1 0

Most of the fields in each line are self explanatory. But what is 1345351261 ?

Is it maybe the random seed for this procedure?

Is it possible to add to the log file the correct answers?

Actually, now that I think of it. There is a simple solution, I can

ask the students to type in the problem parameters, this is not much work for the student, and would provide me with the input they saw as part of the log file. From this input I can compute the correct answer.

Yoav

$ perl -e 'print scalar(localtime("1345351219")),"\n";' Sun Aug 19 00:40:19 2012Gavin