Cohen's Kappa separated annotations

valerie
Wed, 19 Feb 2025 23:34:03 +0000

Hi Divya,

Thank you again for the reply!
I wanted to clarify my question further as I think my question is still unclear according to your response.
According to the image below, I was actually referring to running 1 kappa analysis on 2 sets of 2 tiers.
Each set will include “annot_A” and “annot_B”, separating “annot_A_and_B” from 1 into 2 tiers, so essentially comparing agreement between 2 sets of 2 combined tiers.

Please let me know if this is possible, and again if you need more clarification.

Thank you,
Valerie Fan