In statistics, inter-rater reliability is the degree of agreement among independent observers who rate, code, or assess the same phenomenon. In contrast, intra-rater reliability is a score of the consistency in ratings given by the same person across multiple instances.

What is meant by inter-rater reliability?

Inter-rater reliability, which is sometimes referred to as interobserver reliability (these terms can be used interchangeably), is the degree to which different raters or judges make consistent estimates of the same phenomenon. For example, medical diagnoses often require a second or third opinion.

What is inter-rater reliability example?

Interrater reliability is the most easily understood form of reliability, because everybody has encountered it. For example, watching any sport using judges, such as Olympics ice skating or a dog show, relies upon human observers maintaining a great degree of consistency between observers.