I never really used Gateway quizzes until recently as part of rearranging things for the virus response. We are seeing an issue with quizzes, and I wonder if it is a real issue or just me not understanding something about quiz settings.
In March, I set up a quiz. It had a 120 minute time limit and a close date of March 18. Just now (a month later) I logged in as one of the students (who never changed their original password). I went into the quiz (test/version 1) and went to a question where I had verified they had it wrong. The message was there at the top as expected about 0 minutes remaining. I entered a correct answer, scrolled down, and the "Grade test" button was showing. This itself came as a surprise. I clicked it. Then after logging in as instructor, I saw that here quiz score had indeed gone up by one (in Scoring Tools, Student Progress, and the page that shows points for each problem for this student).
So the time limit is seemingly ineffective. I was prompted to do this by a colleague who built a simpler test quiz and discovered the same thing happening.
Is anyone else able to reproduce this? Either like my colleague, by conducting a controlled experiment. Or like I did, logging in to an old course as a student with an incomplete quiz and seeing what happens? (It may be important to actually be logged in as a student.)
We are using version 2.15. If it is something about my quiz settings, the set details page has the following settings:
Opens: 03/17/2020 at 12:00am
Reduced Scoring Date: 03/18/2020 at 11:59pm
Closes: 03/18/2020 at 11:59pm
Answers Available: 03/18/2028 at 11:59pm
Visible to Students: Yes
Reduced Scoring Enabled: No
Hide Hints from Students: Yes
Assignment Type: gateway/quiz
Test Time Limit: 120
Cap Test Time at Set Close Date: No
Number of Graded Submissions per Test: 0 (infinity)
Time Interval for New Test Versions: 0 (infinite)
Number of Tests per Time Interval: 1
Order Problems Randomly: No
Number of Problems per Page: 1
Show Scores on Finished Assignments: No
Show Problems on Finished Tests: No