Difference between revisions of "Data mine good questions"

From WeBWorK_wiki
Jump to navigation Jump to search
(New page: * Project: '''Data mine WW database for good/bad questions'''. Write software that allows one to determine which WeBWorK questions are hard, which ones are defective? which ones are effec...)
 
m (marked as historical, added tags)
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
  +
{{Historical}}
   
 
* Project: '''Data mine WW database for good/bad questions'''. Write software that allows one to determine which WeBWorK questions are hard, which ones are defective? which ones are effective?
 
* Project: '''Data mine WW database for good/bad questions'''. Write software that allows one to determine which WeBWorK questions are hard, which ones are defective? which ones are effective?
 
** The basic plan would be to data mine the databases existing at each site to catalog questions that have an unusual number of wrong attempts before the question is answered correctly. This requires software to do the preliminary extraction and then software to make it fairly easy for humans to analyze the questions and determine what causes the large number of wrong attempts. Bad question wording? just hard? used in inappropriate course? How to determine effectiveness is even more nebulous -- although that is what would most like to know. Another statistic might be which questions are most widely used? A flexible tool that allowed asking many related questions would be most useful.
 
** The basic plan would be to data mine the databases existing at each site to catalog questions that have an unusual number of wrong attempts before the question is answered correctly. This requires software to do the preliminary extraction and then software to make it fairly easy for humans to analyze the questions and determine what causes the large number of wrong attempts. Bad question wording? just hard? used in inappropriate course? How to determine effectiveness is even more nebulous -- although that is what would most like to know. Another statistic might be which questions are most widely used? A flexible tool that allowed asking many related questions would be most useful.
 
** Add other statistical questions here:
 
** Add other statistical questions here:
** Preliminary plan of attack: [[Data mine WW database details]]
+
** Preliminary plan of attack: Data mine WW database details
   
 
* Related project: '''User interface for question statistics'''. Develop user interface software that mapped collection of statitical metadata about questions described above onto the NationalProblemLibrary and Library browser so that instructors would have this information easily available as they chose questions for their classes. This would probably involve perl programming to interoperate properly with the existing WW course management interface.
 
* Related project: '''User interface for question statistics'''. Develop user interface software that mapped collection of statitical metadata about questions described above onto the NationalProblemLibrary and Library browser so that instructors would have this information easily available as they chose questions for their classes. This would probably involve perl programming to interoperate properly with the existing WW course management interface.
  +
  +
[[Category:Events]]

Latest revision as of 15:00, 22 June 2021

This article has been retained as a historical document. It is not up-to-date and the formatting may be lacking. Use the information herein with caution.
  • Project: Data mine WW database for good/bad questions. Write software that allows one to determine which WeBWorK questions are hard, which ones are defective? which ones are effective?
    • The basic plan would be to data mine the databases existing at each site to catalog questions that have an unusual number of wrong attempts before the question is answered correctly. This requires software to do the preliminary extraction and then software to make it fairly easy for humans to analyze the questions and determine what causes the large number of wrong attempts. Bad question wording? just hard? used in inappropriate course? How to determine effectiveness is even more nebulous -- although that is what would most like to know. Another statistic might be which questions are most widely used? A flexible tool that allowed asking many related questions would be most useful.
    • Add other statistical questions here:
    • Preliminary plan of attack: Data mine WW database details
  • Related project: User interface for question statistics. Develop user interface software that mapped collection of statitical metadata about questions described above onto the NationalProblemLibrary and Library browser so that instructors would have this information easily available as they chose questions for their classes. This would probably involve perl programming to interoperate properly with the existing WW course management interface.