Difference between revisions of "Misc tools"
From LING073
(→lexccounter: apertium-eval-translator) |
|||
| Line 19: | Line 19: | ||
$ lexccounter apertium-xyz.xyz.lexc | $ lexccounter apertium-xyz.xyz.lexc | ||
Unique entries: 127 | Unique entries: 127 | ||
| + | |||
| + | == apertium-eval-translator == | ||
| + | |||
| + | You need two files: | ||
| + | * one test translation, and | ||
| + | * one reference translation | ||
| + | |||
| + | The reference translation is the parallel text in your corpus, e.g. <code>abc.tests.txt</code>. To get a test translation, run the source text (<code>xyz.tests.txt</code>) through apertium and direct the output into a new file, e.g. | ||
| + | cat xyz.tests.txt | apertium -d . xyz-abc > xyz-abc.tests.txt | ||
Revision as of 03:43, 29 March 2018
You can install miscellaneous tools from this repo, like morphTests2yaml and lexccounter, as follows:
cd ~/ling073 git clone git@github.swarthmore.edu:Ling073-sp18/tools.git cd tools make install
morphTests2yaml
You can scrape {{morphTest}}s from any page on this wiki like this:
morphTests2yaml "Language/Grammar" -l xyz
Put the file in a tests/ directory in your transducer repo and commit the file.
lexccounter
This script counts the number of unique entries in a lexc file.
$ lexccounter apertium-xyz.xyz.lexc Unique entries: 127
apertium-eval-translator
You need two files:
- one test translation, and
- one reference translation
The reference translation is the parallel text in your corpus, e.g. abc.tests.txt. To get a test translation, run the source text (xyz.tests.txt) through apertium and direct the output into a new file, e.g.
cat xyz.tests.txt | apertium -d . xyz-abc > xyz-abc.tests.txt
