Fleiss' Kappa - Inter-annotator reliability

hasloe
Mon, 12 Jun 2023 14:30:11 +0000

As a follow up on this: it appeared that especially the combination of Fleiss’ kappa and manual tier selection is not correctly implemented. In this particular case, tier matching based on suffixes turned out to be (after a file exchange) a working alternative, but that may not always be the case.
We’ll try to fix this problem.