Back
to top
Exam grades
Watch
Announcements
Page 1 of 1
Go to first unread
Skip to page:
According to the evidence given by Dame Glenys Stacey at the Select Committee hearing on 2 September, exam grades are reliable to "one grade either way". So ABB really means "any grades from A*AA to BCC". What use is that? What action is Ofqual taking so that the summer 2021 grades are fully reliable and trustworthy, and that a certificate showing ABB really means ABB and nothing else?
0
reply
(Original post by Theloniouss)
I'd be interested to see this evidence
I'd be interested to see this evidence
"Reliable to one grade either way" is in fact code for "On average, 1 exam grade in every 4 is wrong, and has been wrong for years" - which is about 1.5 million wrong grades every year.
The evidence for that is here https://rethinkingassessment.com/ret...e-exam-grades/, and also here https://www.hepi.ac.uk/2019/02/25/1-...the-good-news/, with everything going back to Ofqual's measurements of grade reliability published in Figure 12 here https://assets.publishing.service.go...FINAL64492.pdf.
"1 grade in 4 is wrong" is true, and based on Ofqual's own research. But not many people have read that research - why would they? - so very few people, especially students and teachers, know about it. And unless Ofqual do something to fix this, 1.5 million grades will be wrong in summer 2021 too...
0
reply
Report
#5
It's always been like this. If they didn't change it when things were normal, what makes you think they'd change it for an exceptional exam series?
However, I am so glad that someone is finally bringing this to light.
However, I am so glad that someone is finally bringing this to light.
Last edited by Tolgash; 1 month ago
0
reply
Report
#6
Grades are not always accurate, but universities can be lenient and might consider your UMS. I don't really think there's a solution to this other than students who need a grade working harder.
0
reply
(Original post by Tolgash)
It's always been like this. If they didn't change it when things were normal, what makes you think they'd change it for an exceptional exam series?
However, I am so glad that someone is finally bringing this to light.
It's always been like this. If they didn't change it when things were normal, what makes you think they'd change it for an exceptional exam series?
However, I am so glad that someone is finally bringing this to light.
(Original post by Theloniouss)
Grades are not always accurate, but universities can be lenient and might consider your UMS. I don't really think there's a solution to this other than students who need a grade working harder.
Grades are not always accurate, but universities can be lenient and might consider your UMS. I don't really think there's a solution to this other than students who need a grade working harder.
0
reply
Report
#8
(Original post by Theloniouss)
Grades are not always accurate, but universities can be lenient and might consider your UMS. I don't really think there's a solution to this other than students who need a grade working harder.
Grades are not always accurate, but universities can be lenient and might consider your UMS. I don't really think there's a solution to this other than students who need a grade working harder.
0
reply
Report
#9
(Original post by gradenutter)
Actually, the UMS score is unreliable too - and it's the unreliability in the UMS score that drives the unreliability in the grade. Working harder is, arguably, a good thing to do, but the "system" can still get you - especially for a subject like History where about half the awarded grades are wrong. There are easier, and more practical, ways to deliver reliable grades - here are 22 of them - https://www.hepi.ac.uk/2019/07/16/st...do-you-prefer/ - with some being better than others.
Actually, the UMS score is unreliable too - and it's the unreliability in the UMS score that drives the unreliability in the grade. Working harder is, arguably, a good thing to do, but the "system" can still get you - especially for a subject like History where about half the awarded grades are wrong. There are easier, and more practical, ways to deliver reliable grades - here are 22 of them - https://www.hepi.ac.uk/2019/07/16/st...do-you-prefer/ - with some being better than others.
Those solutions are not terribly unreasonable, but the article doesn't talk about their characteristics wrt anything but making grades more accurate. None of them are really more practical, though?
0
reply
Report
#10
(Original post by Muttley79)
There is no UMS in the linear A levels - at least you can get grades reviewed which was not even available in the past.
There is no UMS in the linear A levels - at least you can get grades reviewed which was not even available in the past.
0
reply
(Original post by Theloniouss)
Yes, but UMS is reliable to a lesser extent because of the greater range of possible values. A difference of 3 marks that amounts to one grade is a change of 14%, but 3 marks that amounts to 3 UMS is a change of closer to 1%. It makes the difference smaller.
Those solutions are not terribly unreasonable, but the article doesn't talk about their characteristics wrt anything but making grades more accurate. None of them are really more practical, though?
Yes, but UMS is reliable to a lesser extent because of the greater range of possible values. A difference of 3 marks that amounts to one grade is a change of 14%, but 3 marks that amounts to 3 UMS is a change of closer to 1%. It makes the difference smaller.
Those solutions are not terribly unreasonable, but the article doesn't talk about their characteristics wrt anything but making grades more accurate. None of them are really more practical, though?
Right now, grades are very unreliable - about 1 in 4 is wrong. So making grades more reliable is, I believe, fundamentally a 'good thing'. And yes, many of them are very practical and easy to implement, especially any of numbers 10 to 22.
0
reply
Report
#12
(Original post by gradenutter)
The issue with the UMS is not the UMS itself, but the likelihood that you would get a (quite different) UMS had your script been marked by a different examiner. And it's the difference between the UMS's attributable to different examiners that is the fundamental cause of the unreliability of the grades on your certificate.
The issue with the UMS is not the UMS itself, but the likelihood that you would get a (quite different) UMS had your script been marked by a different examiner. And it's the difference between the UMS's attributable to different examiners that is the fundamental cause of the unreliability of the grades on your certificate.
Last edited by Tolgash; 1 month ago
0
reply
(Original post by Tolgash)
I believe reviews of marking are a little different to the old appeals process: now, a senior examiner simply checks if the mark scheme has been applied correctly before any changes rather than marking the piece from scratch. Thus, if an answer was rightfully placed in level three of the mark scheme, but it was in the middle, and the pupil merely needed an extra mark (taking it to the top of the level), they wouldn't receive it as the mark scheme was applied correctly. Before, another examiner could have easily given the pupil an extra mark to increase their grade. It's tougher these days.
I believe reviews of marking are a little different to the old appeals process: now, a senior examiner simply checks if the mark scheme has been applied correctly before any changes rather than marking the piece from scratch. Thus, if an answer was rightfully placed in level three of the mark scheme, but it was in the middle, and the pupil merely needed an extra mark (taking it to the top of the level), they wouldn't receive it as the mark scheme was applied correctly. Before, another examiner could have easily given the pupil an extra mark to increase their grade. It's tougher these days.
0
reply
(Original post by gradenutter)
Toglash - thank you, you are absolutely right. Since 2016, the grounds for appeal - and for a re-mark - have been very much narrowed, and made more technical. Ofqual made it harder to appeal - or, too borrow your word, "tougher". Much tougher.
Toglash - thank you, you are absolutely right. Since 2016, the grounds for appeal - and for a re-mark - have been very much narrowed, and made more technical. Ofqual made it harder to appeal - or, too borrow your word, "tougher". Much tougher.
0
reply
Report
#15
(Original post by gradenutter)
Toglash - thank you, you are absolutely right. Since 2016, the grounds for appeal - and for a re-mark - have been very much narrowed, and made more technical. Ofqual made it harder to appeal - or, too borrow your word, "tougher". Much tougher.
Toglash - thank you, you are absolutely right. Since 2016, the grounds for appeal - and for a re-mark - have been very much narrowed, and made more technical. Ofqual made it harder to appeal - or, too borrow your word, "tougher". Much tougher.
Last edited by Compost; 1 month ago
0
reply
Report
#16
(Original post by Theloniouss)
UMS meaning your actual mark (that might not be the right word but that's what it says when you get your results).
UMS meaning your actual mark (that might not be the right word but that's what it says when you get your results).
1
reply
Report
#17
(Original post by Compost)
UMS has not existed for the majority of subjects in the UK since 2017 (A levels) and 2018 (GCSEs) and now does not exist at all. They are just marks.
UMS has not existed for the majority of subjects in the UK since 2017 (A levels) and 2018 (GCSEs) and now does not exist at all. They are just marks.
0
reply
X
Page 1 of 1
Go to first unread
Skip to page:
Quick Reply
