-
|
Can you help understanding Annotator Agreement and how to annotate documents in AnnotationLab? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Inter Annotator Agreement (IAA) refers to how well two (or more) annotators working on the same task can make the same annotation decision for a certain label. IAA shows you how clear the annotation guidelines are, how uniformly the annotators understood it, and how reproducible the annotation task is. |
Beta Was this translation helpful? Give feedback.
Inter Annotator Agreement (IAA) refers to how well two (or more) annotators working on the same task can make the same annotation decision for a certain label. IAA shows you how clear the annotation guidelines are, how uniformly the annotators understood it, and how reproducible the annotation task is.
IAA has a direct effect on the quality of your training data, thus on the accuracy of the model, you will obtain after training.
A complete guide on how to annotate documents in Annotation Lab is available here.