Inter-rater reliability (IRR) quantifies the consistency of measurements or classifications assigned by multiple observers to the same set of items. Central to IRR analysis is the distinction between ...