[developers] Inter-annotator agreement for Redwoods treebanks

Emily M. Bender ebender at uw.edu
Tue Oct 15 18:56:02 CEST 2013

Hi all,

Is there an accepted, chance-corrected measure for inter-annotator
agreement with Redwoods treebanks?  It seems to me that measuring
chance agreement over discriminants would make more sense than
measuring over trees, and I'm not quite sure how to conceptualize the
chance agreement for the "reject all trees" option...


Emily M. Bender
Associate Professor
Department of Linguistics
Check out CLMS on facebook! http://www.facebook.com/uwclma

More information about the developers mailing list