Canvas and Multiple Attempts
Appendix C of Smith, Wooten, and Perrigan redefined terms to enable multiple-attempt assignments via Project Based Assessment; this converter maps Canvas New Quizzes attempts to the app’s columns.
In some assessments, students can attempt a question multiple times before succeeding. For instance, in a programming class, a student might need their code to produce a value before entering it into a quiz. Appendix C of Smith, Wooten, and Perrigan showed that this type of assessment could be analyzed by redefining the terms. The Convert Canvas Quiz Attempts tool converts Canvas New Quizzes Student Analysis files into a format appropriate for Project Based Assessment.
After downloading Student Analysis CSV file from the Canvas New Quizzes, use the "Choose File" button to select the file on your computer.
The converter detects the unique items in the CSV file. Based on the structure, it extracts the provided item descriptions in the CSV. However, you likely want to modify these friendly names as they will appear as the rubric rows in the Project Based Assessment report. For readability, you want them short but descriptive.
The conversion occurs entirely in the browser and produces a file that Project Based Assessment can read. You can then use this file normally in the Project Based Assessment software.
The image shows Project Based Assessment output using data generated by Canvas New Quizzes. Under the redefined terms, interpret these values as probabilities of success rather than failure. Censoring occurs when students give up, not when they reach the top box and cannot earn additional points. Therefore, Average Logistic represents the average probability of success on one attempt for an item. Average Marginal Logistic and Average Discrete Marginal Logistic represent changes in difficulty. Harder items have positive marginal logistic values, while easier items have negative values.
Last updated