Difference between revisions of "Misc tools"
From LING073
(→Using the script) |
|||
| Line 16: | Line 16: | ||
<pre> | <pre> | ||
| − | $ aq-covtest | + | $ aq-covtest ../ling073-xyz-corpus/xyz.corpus.basic.txt xyz.automorf.bin |
Number of tokenised words in the corpus: 891 | Number of tokenised words in the corpus: 891 | ||
Coverage: 92.14% | Coverage: 92.14% | ||
Revision as of 15:41, 20 February 2018
You can install morphTests2yaml as follows:
cd ~/ling073 git clone git@github.swarthmore.edu:Ling073-sp18/tools.git cd tools make install
You can scrape {{morphTest}}s from any page on this wiki like this:
morphTests2yaml "Language/Grammar" -l xyz
Put the file in a tests/ directory in your transducer repo and commit the file.
Using the script
Here's an example of how to use the script and what sort of output you might get:
$ aq-covtest ../ling073-xyz-corpus/xyz.corpus.basic.txt xyz.automorf.bin Number of tokenised words in the corpus: 891 Coverage: 92.14% Top unknown words in the corpus: 4 PCUS 3 b 3 Passera 2 Sancti 2 varesotto 2 Portuense 1 Q 1 aderisce 1 Sojuza 1 Iohannis 1 of 1 seguitò 1 Kommunističeskaja 1 PCU 1 perestrojka 1 png 1 Brìnzio 1 POSDR 1 Brinš 1 Shetlands Translation time: 0.07985591888427734 seconds