Searching for Best Practice in the Application of Mark Schemes

Top Ten Tips for Successful Post-hoc Marking

Authors

  • Simon Lock
  • Lucy Berthoud
  • Becky Selwyn

DOI:

https://doi.org/10.56433/jpaap.v11i2.555

Keywords:

Post-hoc marking, mark scheme adaptation, assessment guidelines

Abstract

Uncertainties within most teaching and learning contexts make it difficult for assessment designers to predict the challenge experienced by students during an assignment. For this reason, “post-hoc” adaptation of mark schemes sometimes take place after an assessment has been completed. This is often to compensate for inaccurate assumptions embedded within the assessment itself. Such adjustments occur within many spheres of education and a goal here is to open conversations around the use of these strategies. The overall aim of this paper is to explore and investigate some of these practices and propose a set of guidelines for educators in designing flexible mark schemes and achieving adaptable, yet consistent, marking processes.

References

Ahmed, Ayesha, and Alastair Pollitt. 2011. "Improving marking quality through a taxonomy of mark schemes." Assessment in Education: Principles, Policy & Practice 18 (3): 259-278. https://doi.org/10.1080/0969594X.2010.546775.

Baird, Jo‐Anne, Jackie Greatorex, and John F. Bell. 2004. "What makes marking reliable? Experiments with UK examinations." Assessment in Education: Principles, Policy & Practice 11 (3): 331-348. https://doi.org/10.1080/0969594042000304627.

Biggs, John. 1996. "Enhancing teaching through constructive alignment." Higher Education 32 (3): 347-364. https://doi.org/10.1007/BF00138871.

Black, Beth. 2019. "11 things we know about marking and 2 things we don’t …yet." The Ofqual blog (blog). 12/8/2021. https://ofqual.blog.gov.uk/2019/03/05/14572/.

Bloxham, Sue, Birgit den-Outer, Jane Hudson, and Margaret Price. 2016. "Let’s stop the pretence of consistent marking: exploring the multiple limitations of assessment criteria." Assessment & Evaluation in Higher Education 41 (3): 466-481. https://doi.org/10.1080/02602938.2015.1024607.

Braun, Virginia, and Victoria Clarke. 2020. "Can I use TA? Should I use TA? Should I not use TA? Comparing reflexive thematic analysis and other pattern‐based qualitative analytic approaches." Counselling and Psychotherapy Research 21 (1): 37-47. https://doi.org/10.1002/capr.12360.

Bristol, University of. 2021. Regulations and Code of Practice for Taught Programmes. Bristol: University of Bristol.

Brooks, Val. 2012. "Marking as judgment." Research Papers in Education 27 (1): 63-80. https://doi.org/10.1080/02671520903331008.

Brown, Sally. 2005. "Assessment for Learning." Learning and Teaching in Higher Education 1: 81-89. http://eprints.glos.ac.uk/3607/1/.

Crisp, Victoria. 2013. "Criteria, comparison and past experiences: how do teachers make judgements when marking coursework?" Assessment in Education: Principles, Policy & Practice 20 (1): 127-144. https://doi.org/10.1080/0969594X.2012.741059.

Dictionary, Cambridge. 2021. "Mark scheme." Cambridge University Press. Accessed 8th September 2021. https://dictionary.cambridge.org/dictionary/english/mark-scheme.

Educators, Pearson UK. 2017. "How are grade boundaries set?" https://www.youtube.com/watch?v=JGIbFFt5bv8&t=157s.

Howell, Rebecca J. 2013. "Grading rubrics: hoopla or help?" Innovations in Education and Teaching International 51 (4): 400-410. https://doi.org/10.1080/14703297.2013.785252.

Lock, Simon, Lucy Berthoud, and Becky Selwyn. 2021. "Searching for Best Practice in the Successful use of Mark Schemes: Top Ten Tips for Successful Post-hoc Marking." Horizons in STEM Higher Education Conference, Online, 29th - 20th June 2021.

Lok, Beatrice, Carmel McNaught, and Kenneth Young. 2016. "Criterion-referenced and norm-referenced assessments: compatibility and complementarity." Assessment & Evaluation in Higher Education 41 (3): 450-465. https://doi.org/10.1080/02602938.2015.1022136. https://doi.org/10.1080/02602938.2015.1022136.

Millar, Robin. 2013. "Improving Science Education: Why Assessment Matters." In Valuing Assessment in Science Education: Pedagogy, Curriculum, Policy, edited by Deborah Corrigan, Richard Gunstone and Alister Jones, 55-68. Dordrecht: Springer Netherlands.

Norton, Lin, Sarah Floyd, and Bill Norton. 2019. "Lecturers’ views of assessment design, marking and feedback in higher education: a case for professionalisation?" Assessment & Evaluation in Higher Education 44 (8): 1209-1221. https://doi.org/10.1080/02602938.2019.1592110.

Pollitt, Alastair, Ayesha Ahmed, Jo-Anne Baird, Jim Tognolini, and Michelle Davidson. 2008. Improving the quality of GCSE assessment. (London: QCA). http://www.camexam.co.uk/.

Pownall, Ian, and Victoria Kennedy. 2019. "Cognitive influences shaping grade decision-making." Quality Assurance in Education 27 (2): 166-178. https://doi.org/10.1108/qae-04-2018-0040.

Smith, Calvin Douglas, Kate Worsfold, Lynda Davies, Ron Fisher, and Ruth McPhail. 2013. "Assessment literacy and student learning: the case for explicitly developing students ‘assessment literacy’." Assessment & Evaluation in Higher Education 38 (1): 44-60. https://doi.org/10.1080/02602938.2011.598636.

Stobart, Gordon. 2009. "Determining validity in national curriculum assessments." Educational Research 51 (2): 161-179. https://doi.org/10.1080/00131880902891305.

Tisi, Jo, Gillian Whitehouse, Sarah Maughan, and Newman Burdett. 2013. A review of literature on marking reliability research (report for Ofqual). (Slough). https://www.nfer.ac.uk/media/2002/mark01.pdf.

Turnbull, Jeffrey M. 1989. "What Is… Normative versus Criterion-referenced Assessment." Medical Teacher 11 (2): 145-150. https://doi.org/10.3109/01421598909146317. https://doi.org/10.3109/01421598909146317.

Wiliam, Dylan. 2001. "Reliability, validity, and all that jazz." Education 3-13 29 (3): 17-21. https://doi.org/10.1080/03004270185200311.

Yorke M, Bridges P, Woolf H. 2000. "Mark Distributions and Marking Practices in UK Higher Education: Some Challenging Issues." Active Learning in Higher Education. 1 (1): 7-27.

Published

2023-07-05

Issue

Section

Original Research