Multiple-Choice Question Scoring Scale Based on Inconsistencies

What is the discrepancy-based scoring scale?

The discordance scoring scale is an alternative method for grading multiple-choice questions, as opposed to the traditional scoring scale. It evaluates both the options selected and those not selected by the learner, whereas the traditional scoring scale evaluates only the selected options.

Other names: discordance scoring, discordance grading, discordant scoring, medical scoring.

For each option, the learner’s response is compared to the expected correct answer.
Each discrepancy is called a discordance:

• an incorrect option that was checked (which should not have been checked)

• or a correct option that was not selected (which should have been selected)

The more discrepancies the learner has, the fewer points they receive. Unlike a traditional scoring scale, identifying an incorrect choice is valued just as much as identifying a correct choice.

This scoring system has historically been used in medical schools and health science programs (PACES, PASS/LAS, ECN, EDN, SIDES, IFMK), but applies to any assessment where the goal is to evaluate the ability to distinguish between correct and incorrect answers.

How does Evalmee calculate the score?

For each question, Evalmee counts the discrepancies between the given answer and the correct answer, then assigns a number of points based on the number of discrepancies and the number of options in the question.

You define these correspondences yourself in a table, which allows you to replicate the main medical grading scales or create your own.

Example: PACES / SIDES grading scale

For a question with 5 options:

This is the historical scoring scale for medical school entrance exams, standardized nationally by SIDES for the EDN (formerly ECN).

Other reproducible grading scales

• PS50: 1 incorrect answer = 50% of the points (more lenient) → 1 / 0,5 / 0 / 0 / 0 / 0 for 5 choices

• PS1/n: Points decrease proportionally to the number of choices for the question

• Any variations specific to your institution

Enable the discrepancy-based scoring scale

In the "Configure" step of a multiple-choice exam, select "Discrepancy-Based Scoring" instead of "Classic Scoring." Then define your correspondence table.

This mode applies to all multiple-choice and true/false questions in the exam.

Good to know: You can modify the grading scale at any time, even after students have taken the test. Scores are instantly recalculated based on the new grading scale.

When should you use this scoring scheme?

Use the discrepancy-based grading scale when:

• You want to assess critical thinking rather than simple memorization

• Your questions include multiple correct AND incorrect options, where “not checking a false statement” is also a skill to be assessed

• You’re preparing students for medical school entrance exams that use this grading scale

• A pass/fail scoring scale seems too binary to you for measuring your learners’ actual proficiency