No Cover Image

Journal article 1671 views 150 downloads

Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety

A. Elizabeth Bond, Owen Bodger, David Skibinski Orcid Logo, D. Hugh Jones, Colin Restall, Ed Dudley, Geertje van Keulen, Hugh Jones, Geertje Van Keulen Orcid Logo

PLoS ONE, Volume: 8, Issue: 2

Swansea University Authors: David Skibinski Orcid Logo, Colin Restall, Ed Dudley, Hugh Jones, Geertje Van Keulen Orcid Logo

  • 14174.PDF

    PDF | Version of Record

    Distributed under the terms of a Creative Commons Attribution (CC-BY-4.0)

    Download (255.8KB)

Abstract

Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introdu...

Full description

Published in: PLoS ONE
ISSN: 1932-6203
Published: 2013
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa14174
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract: Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The ‘Single Answer’ (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the elimination answering methods in MCQ tests via rewarding partial and full knowledge.
Keywords: science education, multiple choice, gender
College: Faculty of Medicine, Health and Life Sciences
Issue: 2