[developers] preprocessor implementations

Rebecca Dridan bec.dridan at gmail.com
Thu Nov 27 17:45:50 CET 2008


Hi Richard,

As far as I am aware, my Perl module 
(http://www.dridan.com/research/software.html#FSPP) is the only non-LISP 
implementation of FSPP.  I'm not sure it is efficient enough for your 
needs (it definitely wasn't the bottleneck for me), but I'd be 
interested to hear how it goes if you do use it.

Rebecca

R. Bergmair wrote:
> Hi!
>
> I was wondering if there are any implementations of
> preprocessors out there running the ERG FSR rules,
> other than the standard lisp implementation of FSPP
> that comes with the delph-in distribution.
>
> Or actually, I'd be happy to get any tokenizer that
> produces ERG-compatible tokenizations.
>
> For example, I have a vague recollection, that Rebecca
> reimplemented FSPP in Perl.
>
> The reason I'm asking is because I'm preparing to run
> some ERG-compatible tokenization on a really large
> scale, and I'm wondering if there are implementations
> out there that are more efficient than the lisp
> implementation.
>
> Is there a C implementation? (I understand the PET
> fspp is just an ECL binding for the lisp code? Or
> is there an independent implementation as well?)
>
> Has anyone ever tried doing this with lex in C, or
> tried compiling the rules into finite state automata,
> and ultimately machine executable code?
>
> regards,
>
> Richard
>




More information about the developers mailing list