Testing Checklist

This is a checklist of things to test when verifying that a new version/pull/merge/whatever is working.

Basic Checklist

• Create a course.
• Create a user.
• Create a homework set.
• View library problems.
• Add library problems to homework set.
• Assign homework set to students.
• Answer a problem correctly.

Intermediate Checklist

• Course Admin
  • Delete Course
  • Archive Course
  • Unarchive course
  • Upgrade courses
  • Rename Course
• Student Pages
  • Check rendering of Homework Sets page and Set List page
  • Change password and change email
  • Check grades page
• Classlist Editor 2
  • Check filter/sort functionality
  • Edit a user and change permissions
  • Change the password for a user
  • Import and export Users
  • Add user manually
  • Delete a user
• Homework Sets Editor
  • Check Filter/Sort
  • Edit multiple sets
  • Change options and dates (using datepicker)
  • Check Publish functionality
  • Check Import/Export
  • Check Create/Delete
  • Manually assign, unassign homework to users
• Homework Set Detail Page
  • View and rearrange problems
  • Check header functionality (edit, change header, view, etc...)
  • Check that options can be changed for default sets
  • Check options for gateway sets
• Problem Page
  • Check problem rendering
    • Check rendering of functions
    • Check rendering of graphs
    • Check rendering of matricies
  • Check that hints and solutions work as advertised
  • Check that the mathview editor functions (including typeahead)
  • Check different display options
• Hardcopy Page
  • Check that you can generate a hardcopy
  • Check that the solutions/hints functionality works
  • Check that you can enable/disable student answers
• Gateway Page
  • Check that you can generate new versions of gateways
  • Check that the versions are generated according to the gateway options
  • Check that proctoring works correctly
  • Check that locations filter works correctly
• Library Browser
  • Check to see that the library has been fully loaded and things are accessable
  • Check Local Problems, From This Course, etc...
  • Check Advanced Search options
  • View some Problems
  • Create a set and edit a set using the browser
  • Check reseed, edit, view and hide buttons
• PG Editor
  • Edit a problem
  • Create a new version
  • append
  • View and then Update
  • Check links at top
• Past Answer
  • Check past answer page formats correctly (including typsetting formulas)
  • Check that you can view other users past answers as the instructor
  • Check that wildcards work correctly
  • Check that "allowed to view past answers" permission works correctly
  • Check that when students view past answers they cannot see which answers are correct
• Statistics, Progress and Grades
  • Check that statistics page still function and render correctly
  • Check that the student progress page still works correctly
  • Score some sets and check that the scoring is sane
• Email
  • Send email
  • Check macros
• File Manger
  • Check that file list is sane
  • Check every function of side buttons
  • Upload a file
• Course Configuration
  • Change theme
  • Change language, inactivity time, timezone
  • Test Datepicker option
  • Change a permission
  • Check mathview option

Thorough Checklist

• Recheck rendering of all pages using math3
  • Recheck math3 limited bootstrap functionity for set descriptions and achievements.
• Recheck rendering of all pages on both Firefox, IE 8 & 9 & 10 (IE8 will be a little janky)
• Recheck rendering of all pages in smaller windows
• Recheck rendering of student pages using a phone/tablet.
• Check functionality of permissions
• Achievements
  • Enable course achievements
  • Import/export achievemetns
  • Score achievements
  • Manually assign and award achievements
  • Check evaluator
  • Edit an achievement
  • Create/Delete achievements
  • Earn an achievement
  • Check formatting of achievement page
  • Enable achievement items
  • Use an achievement item
• Do PG editor checks with PG editor 3
• Essay Questions
  • Assign an essay question and answer it
  • Check that the grading link appears in the appropriate places (statistics page, problem set detail, and the problem set page)
  • Check the problem grader
  • Assign a grade
  • Give a comment and check the comment is displayed to a student
  • Check that formatted math can be produced using both latex (\( and \) ) and asciimath ( ` and ` )
  • Check formatting of submitted answers on both the grader page and the problem page