[pet] preprocessing and fsc

[Rebecca Dridan]

Hi Xuchen,

If you are thinking of the REPP code 
(http://wiki.delph-in.net/moin/ReppTop), it's in Lisp 
($LOGONROOT/lingo/lkb/src/glue/repp.lsp), not C++. The older stuff was 
FSPP, but that was also Lisp code in the LKB source. As far as I know 
(maybe others can correct me), there's never been native pre-processing 
code in PET, it's generally been a pre-processing step, or Lisp code 
compiled into PET with ECL.

I ran into similar issues in the last year or so, wanting to use FSC, 
and I actually have my own C++ version of REPP. I can't guarantee it is 
exactly in sync with the current Lisp code, since I haven't been 
watching the changes in the last year too closely, but it still seems to 
work with the current rpp files in the grammar and can produce FSC 
output. I'm happy to share the code if you'd like to use it, modifying 
it, port it.

The other option I found was to get the REPP output from Lisp, and merge 
it with my own FSC stuff. That can get a little fuzzy if you have 
different tokenisation, but I have merging code that generally works.

Let me know if any of my code will be useful to you.

Rebecca



On 23/06/10 22:39, Xuchen Yao wrote:
> Hi,
>
> I was told that there's a pre-processing module in PET to re-format 
> the input a little bit (such as dealing with punctuations, numbers, 
> etc, e.g. $14,000) so a better job can be done for parsing. But if the 
> input mode is the FSC format (Chart Mapping as in the cm branch), this 
> pre-processing stage is bypassed (correct me if it's not the case).
>
> Currently I'm using FSC input and also want to gain some advantages 
> from this pre-processing stage. I'm writing in Java and thinking if I 
> can have the C++ references from PET, I can easily re-write the 
> preprocessing step in my code (hopefully this isn't too much work) so 
> finally feed some better formatted input to PET. So could someone 
> kindly point me to the C++ code in PET where pre-processing happens? 
> Thanks a lot!
>
> Xuchen
>