<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div class=""><br class=""></div><div class="">I just noticed that I need to load the grammar in the LKB. But LKB could not load the trunk version of ERG. Using the ERG last stable version, I got the same behaviour.</div><div class=""><br class=""></div><div class=""><img apple-inline="no" id="F174C2E8-3D1E-497F-BA36-6C9E3EB37EBC" src="cid:462E4D7C-D4B4-4E2A-8926-AC13EE10934E@br" class=""></div><div class=""><br class=""></div><br class=""><blockquote type="cite" class="">On 21 Aug 2020, at 20:30, Alexandre Rademaker <<a href="mailto:arademaker@gmail.com" class="">arademaker@gmail.com</a>> wrote:<br class=""><br class=""><blockquote type="cite" class="">On 21 Aug 2020, at 12:35, Stephan Oepen <<a href="mailto:oe@ifi.uio.no" class="">oe@ifi.uio.no</a>> wrote:<br class=""><br class="">one used to do this kind of evaluation in [incr tsdb()], initiated<br class="">through the 'Trees | Score' command. i am not sure this will work out<br class="">of the box for comparing an FFTB-based treebank to an ACE-generated<br class="">parsing profile ... although it should, in principle! i expect you<br class="">would want to select 'Result Equivalence' and 'Score All Items' in<br class="">'Trees | Switches', and just give it a shot :-).<br class=""><br class="">if you get the above to work (which should give exact match<br class="">accuracies), the [incr tsdb()] scorer can also compute a range of<br class="">additional metrics, including EDM and ParsEval, but these would have<br class="">to be activated programmatically:<br class=""><br class="">(setf *redwoods-score-counts* '(:ta :parseval :edma :edmp))<br class=""></blockquote><br class="">Hi Stephan,<br class=""><br class="">Thank you for the directions. Trying that first approach, it gave me 100% accuracy?? But the window with the results opened instantaneously, I don’t believe it really did the analysis. How to make sure the tool is doing what we excepted it to do? How can I know if the two profiles are proper selected?<br class=""><br class=""><br class=""><span id="cid:A02796A7-6E7A-4624-AEF1-F6D649DAFDCD@br"><PastedGraphic-2.png></span><br class=""><br class="">Best,<br class="">Alexandre<br class=""><br class=""></blockquote><br class=""></body></html>