AnsweredAssumed Answered

Multiple Answer Questions are scored incorrectly.

Question asked by vvolz on Apr 12, 2016
Latest reply on Nov 22, 2016 by rg36293

Hello

I have a problem with the way Blackboard Learn (VLE) calculates points for Multiple Answer Questions.

Ideally each multiple-answer question would be worth 5 points. Here is the desired outcome: 1 point for each correct response, -1 for each incorrect response.

Therefore:

Question 1-

Question: Which of the following statements are true?

A False (Correct, 1 point) (box not ticked)

B True (Correct, 1 point) (box ticked)

C True (Correct, 1 point) (box ticked)

D True (Correct, 1 point) (box ticked)

E False (Correct, 1 point) (box not ticked)

 

Student answers:

Question: Which of the following statements are true?

A False (Correct, 1 point) (box not ticked)

B True (Correct, 1 point) (box ticked)

C True (Correct, 1 point) (box ticked)

D False (Incorrect, -1 point) (box not ticked)

E True (Incorrect, -1 point) (box ticked)

 

Therefore the score on this question SHOULD be 3 out of 5 points.

 

However, since the VLE Test Tool calculates answers as percentages it is impossible to score this correctly.

 

All correct answers must add up to 100 percent, so B, C, D are currently programmed to be worth 33.3333%

If negative marking is applied, A and E are programmed to be worth –33.3333%. By the way, negative marking MUST be applied, else students could tick every box and get the maximum points.

 

So in the above scenario, if set to be worth 5 points, the VLE would score this question 1.66667 out of 5 points.

 

Now currently we are setting the question points equal to the number of correct answers, with negative marking. This is not a good method at all but it the only way I have found to be scored correctly in the VLE. Also, students can see the points values and know how many responses are correct, and there is no way I know to hide this in this test.

 

Therefore, the question is worth 3 points only:

Question: Which of the following statements are true?

A False

B True

C True

D True

E False

 

Student answers:

 

A False (Correct, no points)

B True (Correct, 1 point)

C True (Correct, 1 point)

D False (Incorrect, no points, even though it is wrong!)

E True (Incorrect, -1 point)

 

VLE score is 1 out of 3 points. It is neither awarding a point for knowing an answer is False, nor is it removing a point for not knowing an answer is True. See below:

Screen Shot 2016-04-12 at 10.08.50.png

 

Question 2- When 1 out of 5 are correct:

Question: Which of the following statements are true?

A True (Correct, 1 point) (box ticked)

B False (Correct, 1 point) (box not ticked)

C False (Correct, 1 point) (box not ticked)

D False (Correct, 1 point) (box not ticked)

E False (Correct, 1 point) (box not ticked)

 

Student answers:

A False (incorrect, -1 point) (box not ticked)

B False (Correct, 1 point) (box not ticked)

C False (Correct, 1 point) (box not ticked)

D False (Correct, 1 point) (box not ticked)

E True (incorrect, -1 point) (box ticked)

Screen Shot 2016-04-12 at 10.21.30.png

 

If the student knows that B, C, and D are incorrect, they should receive points for not ticking them. In the “ideal” 5-point question scenario, they would receive 3 points overall (out of 5), and not zero. But the VLE won’t do this. (Same 1 out of 5 question now worth 5 points):

Screen Shot 2016-04-12 at 10.26.17.png

 

 

So for these 2 questions:

Final score, “Ideal" method: 6 out of 10 = 60% Pass

Final score, VLE method: 1 out of 4 = 25% …FAIL

 

 

Can anyone offer some helpful advice if I'm missing something? Or a better way to score these types of questions?

 

Thanks,

 

Veronica

Outcomes