The major assessment in PHCM9517 Advanced Biostatistics and Statistical Computing requires the students to conduct an analysis of a real-world dataset and write a report of their findings. The individual nature of this assessments reflects the typical scenario of a researcher working solo on a statistical analysis. However, this solo work is conducted as part of a team of colleagues who can provide advice when needed. This differs from the typical student experience of working on an assessment where they cannot ask questions related to the assessable content.
To bring authenticity to the assessment tasks, a new pre-submission check was implemented in 2022. This was entirely optional and gave students the opportunity to ask the course convenor any question, including those directly related to content, in order to help them progress with their analysis. Students were limited to one question and had to provide a proposed solution for their question.
The main goal of the assessment was to build a statistical model. Students encounter grey areas as they navigate the options and decisions that need to be made during the analysis. The majority of the submitted pre-submission checks focused on two particularly grey areas – whether or not to remove an outlier and whether a variable was acting as a confounder. The pre-submission check is not about giving the students the answer but rather building confidence in the approaches they are taking. In nearly all instances, students provided sound rationale for their decisions and I was able to provide reassurance they were on the right track.
Students were asked for feedback on this feature. A student who used the pre-submission check wrote:
"I was very happy to see the pre-submission check largely because it's just flat out more realistic to what would occur in the workforce.”
The student went on to write that he didn’t see the check as free-pass but rather a chance to engage deeper with the content. Another student provided feedback despite not using the check saying that the option was kept “up my sleeve” but ultimately didn’t use it due to “my poor time management”.
There were some additional benefits to the pre-submission check. The option closed two days prior to the assessment due date, intended as a nudge for students to get started early. For example, the above student who ran out of time to use the option for the first assessment did go on to use it for the second assessment, perhaps having improved time management skills.
An unexpected benefit was the sense of having a dialogue with the students. Around 80% of the students complete the course asynchronously online. The pre-submission check was one of the few opportunities I had to have an informal dialogue with the students which made the online space feel a little less anonymous and a little more human.