Comparative analysis of three approaches for rater agreement.
M. Ato, A. Benavente, and J. López. Psicothema, 18 (3):
638-45(August 2006)6335<m:linebreak></m:linebreak>PT: J; NR: 41; TC: 2; J9: PSICOTHEMA; PG: 8; GA: 064QO; UT: WOS:000239104400046;<m:linebreak></m:linebreak>Mesures de concordància.
Abstract
This work is a comparative analysis of three general approaches for rater agreement measurement which produce three different statistical coefficients: descriptive (sigma, pi y kappa coefficients), based on log-linear models and on mixture models. Although loglinear and mixture approaches assume a different concept of chance correction, their flexibility allow using its parameters to analyze agreement and disagreement patterns. We show that all descriptive measures can also be obtained by introducing constraints to a basic loglinear (or mixture) quasi-independence model. Due to the different measurement scale used, both loglinear and mixture approaches have a similar interpretation when diagonal parameters are positive but a different interpretation otherwise.
%0 Journal Article
%1 Ato2006
%A Ato, Manuel
%A Benavente, Ana
%A López, Juan J
%D 2006
%J Psicothema
%K DataInterpretation Humans Models ObserverVariation Psychological Psychology Psychology:methods Psychology:statistics&numericaldata Statistical
%N 3
%P 638-45
%T Comparative analysis of three approaches for rater agreement.
%U http://www.ncbi.nlm.nih.gov/pubmed/17296098
%V 18
%X This work is a comparative analysis of three general approaches for rater agreement measurement which produce three different statistical coefficients: descriptive (sigma, pi y kappa coefficients), based on log-linear models and on mixture models. Although loglinear and mixture approaches assume a different concept of chance correction, their flexibility allow using its parameters to analyze agreement and disagreement patterns. We show that all descriptive measures can also be obtained by introducing constraints to a basic loglinear (or mixture) quasi-independence model. Due to the different measurement scale used, both loglinear and mixture approaches have a similar interpretation when diagonal parameters are positive but a different interpretation otherwise.
%@ 0214-9915
@article{Ato2006,
abstract = {This work is a comparative analysis of three general approaches for rater agreement measurement which produce three different statistical coefficients: descriptive (sigma, pi y kappa coefficients), based on log-linear models and on mixture models. Although loglinear and mixture approaches assume a different concept of chance correction, their flexibility allow using its parameters to analyze agreement and disagreement patterns. We show that all descriptive measures can also be obtained by introducing constraints to a basic loglinear (or mixture) quasi-independence model. Due to the different measurement scale used, both loglinear and mixture approaches have a similar interpretation when diagonal parameters are positive but a different interpretation otherwise.},
added-at = {2023-02-03T11:44:35.000+0100},
author = {Ato, Manuel and Benavente, Ana and López, Juan J},
biburl = {https://www.bibsonomy.org/bibtex/2ac7471828b4480c6b452ff7d169cdf24/jepcastel},
city = {Univ Murcia, Fac Psicol, Murcia 30080, Spain; Ato, M (reprint author), Univ Murcia, Fac Psicol, Murcia 30080, Spain; matogar@um.es},
interhash = {f1e93f948fe0bc5b441c348cdfb04a6d},
intrahash = {ac7471828b4480c6b452ff7d169cdf24},
isbn = {0214-9915},
issn = {0214-9915},
journal = {Psicothema},
keywords = {DataInterpretation Humans Models ObserverVariation Psychological Psychology Psychology:methods Psychology:statistics&numericaldata Statistical},
month = {8},
note = {6335<m:linebreak></m:linebreak>PT: J; NR: 41; TC: 2; J9: PSICOTHEMA; PG: 8; GA: 064QO; UT: WOS:000239104400046;<m:linebreak></m:linebreak>Mesures de concordància},
number = 3,
pages = {638-45},
pmid = {17296098},
timestamp = {2023-02-03T11:44:35.000+0100},
title = {[Comparative analysis of three approaches for rater agreement].},
url = {http://www.ncbi.nlm.nih.gov/pubmed/17296098},
volume = 18,
year = 2006
}