Difference between revisions of "Hfst-minimise trick"

Revision as of 05:47, 26 March 2017

There's a "trick" using hfst-minimise that will get around some issues in converting hfst-format transducers to lttoolbox-format transducers. That is, if hfst-proc xyz.automorf.hfst and lt-proc xyz.automorf.bin seem to be acting differently, try this trick.

The trick

In your Makefile.am file:

• In the rule for making $(LANG1).automorf.hfst, pipe the output of hfst-invert into hfst-minimise before piping the output of that into hfst-fst2fst. So the relevant part of this line should now look something like this:

  ...| hfst-invert | hfst-minimise | hfst-fst2fst -O -o $

• In the rule for $(LANG1).autogen.att.gz, first run hfst-minimise on the input before piping that into hfst-fst2txt. That rule should now look something like this:

  hfst-minimise $< | hfst-fst2txt | gzip -9 -c -n > $@

• Run make clean, reinitialise your module (./autogen.sh), and run make to recompile.
• Test the output of lt-proc and hfst-proc again.