How to determine inter-rater reliability in this case?

Watch
Em.qu
Badges: 7
Rep:
?
#1
Report Thread starter 9 months ago
#1
I am a first year UG studying educational psychology. My data set is 3 observers tallying how often actors of different races appear in children's adverts. Because this is, to some extent, subjective (racial biases etc), the data set is not binary. There is no set of data where all 3 observers agree. E.G. In one advert, observer A observed 4 white actors, observer B observed 8 white actors, and observer C observed 6 white actors.

How would I calculate inter-rater agreement/reliability? Many thanks.
0
reply
X

Quick Reply

Attached files
Write a reply...
Reply
new posts
Back
to top
Latest
My Feed

See more of what you like on
The Student Room

You can personalise what you see on TSR. Tell us a little about yourself to get started.

Personalise

What's worrying you most about starting back at school/college this year?

The potential for Covid to keep disrupting things (109)
14.53%
My mental health (110)
14.67%
Feeling behind academically (142)
18.93%
Making friends/social anxiety (135)
18%
How to organise myself (25)
3.33%
How to revise/study effectively (89)
11.87%
Future career, uni, pathway planning and applications (125)
16.67%
Something else - let us know in the thread (15)
2%

Watched Threads

View All