Cohen's Kappa separated annotations

valerie
Tue, 11 Feb 2025 07:53:44 +0000

Hello, my name is Valerie and I have 2 questions about the flexibility of Cohen’s Kappa analysis.

First, can 1 annotation (i.e. annot_A_and_B) be separated into 2 annotations (i.e. annot_A, annot_B) within the same tier at the same period?
If yes, is it possible to compute Cohen’s Kappa values for the 2 annotations simultaneously? (i.e. kappa of union(annot_A, annot_B)). In other words, is it possible to compute 1 kappa value for 2 annotations simultaneously?

Thank you for your time and assistance!