Fast computation of Krippendorff's alpha agreement measure.
Based on Thomas Grill implementation.
Given a reliability data matrix, run:
import krippendorff
krippendorff.alpha(reliability_data=...)
See sample.py
and alpha
's docstring for more details.
pip install krippendorff
The implementation is fast as it doesn't do a nested loop for the coders. However, V
should be small, since a VxV
matrix it's used.
If you use this code in your research, please cite Fast Krippendorff:
@misc{castro-2017-fast-krippendorff,
author = {Santiago Castro},
title = {Fast {K}rippendorff: Fast computation of {K}rippendorff's alpha agreement measure},
year = {2017},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/pln-fing-udelar/fast-krippendorff}}
}