The Student Room Group

How accurate is ChatGPT at grading assignments?

When I do an assignment I usually put the finished thing through ChatGPT and ask it to grade my work according to UK university standards. I'm not using it to cheat as no part of my essay is AI generated and it doesn't give concrete enough feedback for me to actually improve much (for example it just says things like "try to develop your argument more"), I just like doing it as a rough estimate of what I will get so I can be less worried about the grade.

How accurate is ChatGPT's estimate of grades though? One week it told me I would get 65-75 and I actually got 64, another week it told me same and I got 68, and another week it told me I would get 70-85 and I actually got 65. So it usually estimates a range that it is very loosely accurate. But this week it told me I would get 63, which I'm quite worried about as I worked very hard on my assignment and would be disappointed if I only got 63 as it is lower than what I have been getting these last few weeks. Is it worth redoing my essay or are ChatGPT predictions not accurate enough to worry about?
Not something I would trust.

It’s very very clever & it’s ability to script sophisticated literature on a nominal subject is impressive.

However it massively falls down on precision, and deciphering depth of understanding of topics. The problem it also has is it works like a feedback loop, however feedback loops rely on accurate input feedback & unfortunately its source data is good & bad (and it lacks ability to determine the good from the bad & even worse - it often entangles the bad information into the good information).
(edited 5 months ago)
Original post by Username123ab
When I do an assignment I usually put the finished thing through ChatGPT and ask it to grade my work according to UK university standards. I'm not using it to cheat as no part of my essay is AI generated and it doesn't give concrete enough feedback for me to actually improve much (for example it just says things like "try to develop your argument more"), I just like doing it as a rough estimate of what I will get so I can be less worried about the grade.

How accurate is ChatGPT's estimate of grades though? One week it told me I would get 65-75 and I actually got 64, another week it told me same and I got 68, and another week it told me I would get 70-85 and I actually got 65. So it usually estimates a range that it is very loosely accurate. But this week it told me I would get 63, which I'm quite worried about as I worked very hard on my assignment and would be disappointed if I only got 63 as it is lower than what I have been getting these last few weeks. Is it worth redoing my essay or are ChatGPT predictions not accurate enough to worry about?


Hi there!

Like others have mentioned, I do not recommend putting your faith in ChatGPT, as it can give you a false sense of security as opposed to your academics who specialise in your subject.

I would recommend, if you can, having your tutors look over drafts for your assignments, as they can tell you if you are heading in the right direction. You can only improve from their feedback, so relying on AI to put your mind at ease is not truly worth it! It is not great to get your hopes up as it can affect your confidence and can make you question your ability.

If you are unsure about where your assignment stands, have you tutor look over your plans or drafts, as they have the best knowledge!

I hope this helps :smile:

Estelle
Graduate Advocate
If it was in any way reliable then universities wouldn't have had any problems with the Marking and Assessment Boycott
I wouldn't consider it accurate.
Reply 5
I've not heard of this before! It is a nice idea, but believe me - if ChatGPT could reliably mark assessments we'd be using it! Sadly, it's not the case. Marking assessments, though tedious and repetitive, requires serious and subtle academic judgment, especially with essay subjects. ChatGPT is just spitting out something that seems like the sort of thing people say when asked to give feedback on an assessment. It doesn't have access to a reliable sample of actual university essays with actual grades, it doesn't know how academics grade assessments, and it isn't capable of judgment, so it is just guessing. It is saying something that sounds roughly like the sort of answer you'd expect to the query, but it doesn't have any validity. This is similar to how ChatGPT will 'hallucinate' legal cases or people's biographies: it gives something that has the right form, language, tone, etc., that sounds like the right sort of thing, but in fact it is just made up. Don't give any weight to it. Ask your tutors for advice on essay writing, and if your institution has learning development/ academic skills/academic support tutors go to them for help as well.

Quick Reply

Latest

Trending

Trending