[developers] Comparing a profile with a grammar output

[goodman.m.w at gmail.com]

Hi Alexandre and Stephan,

Alexandre, if you only care about exact matches of semantics, you might
look into how the Matrix does regression testing (see rtest.py at
https://github.com/delph-in/matrix/).

And I'd need to refresh my understanding of the specifics, but I think
delphin.edm gives the same final scores as mtool but not Bec's tool. It
*can* replicate the results of both by adjusting weights and things via
command options. It doesn't give as granular a breakdown as mtool, but you
can get per-item results when you increase verbosity twice (-vv).

Finally, if you want EDS with line breaks, try adding `--indent` or
`--indent 1` to the `delphin convert` command.

Stephan, I don't see why line breaks are necessary for EDS native format.
There is no syntactic necessity that I can see. I find it very useful to
have the option for single-line EDS (or any format), e.g., for line-pairing
the exported representations of two profiles. I'll consider how I can make
the identifier prefix (e.g., #4711) map to the internal 'identifier' field
(see
https://pydelphin.readthedocs.io/en/latest/api/delphin.eds.html#delphin.eds.EDS
).

On Sat, Aug 22, 2020 at 3:03 PM Stephan Oepen <oe at ifi.uio.no> wrote:

> hi again, alexandre and mike:
>
> > I added the #XXXX right before the EDS serialization. The only different
> between these files in the
> https://github.com/cfmrp/mtool/blob/master/data/score/eds/wsj.pet.eds is
> that these files are not formatted with one predicate per line, instead,
> the EDS is serialised in a single line without line breaks.
>
> i am tempted to declare those line breaks a necessary part of the
> native EDS syntax (though i see that the current EdsTop wiki page does
> not explicitly state that).  mike, could you change EDS serialization
> in pyDelphin to reflect the multi-line format exemplified on that
> page?  also, when you have an item identifier available i would
> suggest you prefix the EDS with an additional line (assuming the
> identifier is 4711):
>
> #4711
>
> this latter addition should be considered optional, though, and i
> shall check that the mtool EDS reader does not require it (i suspect
> currently it does; mtool has hardly been used in conjunction with
> native EDS serialization, so this is a welcome push toward better
> cross-format and -platform interoperability).
>
> regarding your lack of success when invoking the scorer in [incr
> tsdb()], alexandre: could you make available to me a copy of the two
> profiles involved?
>
> best wishes, oe
>


-- 
-Michael Wayne Goodman
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.delph-in.net/archives/developers/attachments/20200822/86cc67e7/attachment.html>