Centralise evaluator scores and make adjustements based on individual perspectives
Moderation scoring (sometimes called consensus scoring) is conducted by the assigned moderator. Moderation will be able to begin once all individual evaluations have been completed.
You will be able to see the progress of individual evaluations and how the panel are progressing their scoring. It is always worth ensuring you provide enough time for your panel to conduct their scoring before organising a moderation session.
Adjusting scores
Once individual evaluation is complete all scores will be visible side by side. From there, once moderation begins individual scores can be adjusted after discussion and additional commentary captured. The final score for that vendor will be the average of the adjusted scores. Additional comments can also be captured against each criterion if justification or consensus needs to be captured.
If scores are adjusted, the original score will be maintained and a delta will be visible showing the change post-moderation. This will ensure traceability in the process from the final results back to the original scores.
Finalising moderation
Once moderation has been completed, you will need to mark each submission as reviewed. This will enable you to progress through the final evaluation and produce the results.