[developers] PET regression testing

[Stephan Oepen]

hi bernd,

my apologies for the late reply on this thread!  i am currently helping
rebecca in getting her support for native REPP and calling out to a
PoS tagger integrated and tested with PET.  that work prompted me
to brush up (and partially document) the support for semi-automated
regression testing available with [incr tsdb()] and the LOGON batch
scripts.  please see the following page (towards the bottom) for some
suggestions:

  http://wiki.delph-in.net/moin/LogonProcessing/BatchParsing

note that one will need an up-to-date LOGON tree (off the 'trunk') for
this to work.

as for changes to the '-tsdbdump' option, from my point of view, 'all'
that is required is that the result is a valid [incr tsdb()] profile.  every
now and again, i make changes to the [incr tsdb()] database schema
(typically adding new fields).  while [incr tsdb()] will always be able to
read older schema versions (back to around the mid-1990s :-), it will
typically refuse to write to out-of-date versions.  a good way to keep
up-to-date with the current schema is the English master file:

  http://svn.emmtee.net/trunk/lingo/lkb/src/tsdb/skeletons/english/Relations

best, oe


On Fri, Jul 8, 2011 at 12:40, Bernd Kiefer <kiefer at dfki.de> wrote:
> Hi all,
>
> sorry for coming back with the same things again and again, but i'm
> in desperate need for a means of doing regression tests with PET.
>
> In my PET source tree, there are quite a lot of changes lying around
> (among them an updated version of -tdsbdump, which might be interesting
> to Francis) which i don't dare checking in because i'm not sure if
> the old functionality is preserved.
>
> I'd be happy if somebody would give me an *easy* way to do that, or
> would be willing to do the tests, given she/he has already set up
> something, maybe for a different purpose.
>
> I hate to say that, but with the very limited amount of time i can
> invest in the development of PET, not having an automatic test harness
> that does free more human resources than it requires, brings my
> efforts almost to a halt.
>
> Any volunteers to work on that (maybe collaborately)?
>
> Enough whining for today,
>
>        Bernd
>
> --
> ----------------------------------------------------------------------
> Bernd Kiefer     DFKI GmbH,  Stuhlsatzenhausweg,  D-66123 Saarbruecken
> kiefer at dfki.de   +49-681/85775-5301 (phone)   +49-681/85775-5338 (fax)
> ----------------------------------------------------------------------
> Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
> Trippstadter Strasse 122, D-67663 Kaiserslautern, Germany
> Geschaeftsfuehrung: Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vor-
>                    sitzender), Dr. Walter Olthoff
> Vorsitzender des Aufsichtsrats: Prof. Dr. h.c. Hans A. Aukes
> Amtsgericht Kaiserslautern, HRB 2313
>