[developers] Inter-annotator agreement for Redwoods treebanks

[Emily M. Bender]

Hi all,

Is there an accepted, chance-corrected measure for inter-annotator
agreement with Redwoods treebanks?  It seems to me that measuring
chance agreement over discriminants would make more sense than
measuring over trees, and I'm not quite sure how to conceptualize the
chance agreement for the "reject all trees" option...

Emily

-- 
Emily M. Bender
Associate Professor
Department of Linguistics
Check out CLMS on facebook! http://www.facebook.com/uwclma