Misc tools

From LING073
Revision as of 03:43, 29 March 2018 by Jwashin1 (talk | contribs) (→‎lexccounter: apertium-eval-translator)

Jump to: navigation, search

You can install miscellaneous tools from this repo, like morphTests2yaml and lexccounter, as follows:

cd ~/ling073
git clone git@github.swarthmore.edu:Ling073-sp18/tools.git
cd tools
make install

morphTests2yaml

You can scrape {{morphTest}}s from any page on this wiki like this:

morphTests2yaml "Language/Grammar" -l xyz

Put the file in a tests/ directory in your transducer repo and commit the file.

lexccounter

This script counts the number of unique entries in a lexc file.

$ lexccounter apertium-xyz.xyz.lexc 
Unique entries: 127

apertium-eval-translator

You need two files:

  • one test translation, and
  • one reference translation

The reference translation is the parallel text in your corpus, e.g. abc.tests.txt. To get a test translation, run the source text (xyz.tests.txt) through apertium and direct the output into a new file, e.g.

 cat xyz.tests.txt | apertium -d . xyz-abc > xyz-abc.tests.txt


2017 version of this page