Difference between revisions of "Nivkh and Russian"
From LING073
(→See also) |
|||
| Line 20: | Line 20: | ||
<pre> | <pre> | ||
Number of words in reference: 170 | Number of words in reference: 170 | ||
| − | Number of words in test: | + | Number of words in test: 217 |
| − | Number of unknown words (marked with a star) in test: | + | Number of unknown words (marked with a star) in test: |
Percentage of unknown words: 0.00 % | Percentage of unknown words: 0.00 % | ||
</pre> | </pre> | ||
| Line 27: | Line 27: | ||
Results when unknown-word marks (stars) are not removed | Results when unknown-word marks (stars) are not removed | ||
| − | Edit distance: | + | Edit distance: 217 |
| − | Word error rate (WER): | + | Word error rate (WER): 127.65 % |
Number of position-independent correct words: 0 | Number of position-independent correct words: 0 | ||
| − | Position-independent word error rate (PER): | + | Position-independent word error rate (PER): 127.65 % |
</pre> | </pre> | ||
Revision as of 00:24, 7 May 2019
Initial Evaluation
niv->rus translator
Coverage using monolingual transducer:
Coverage: 73.23%
Coverage using bilingual transducer:
Total number of tokens in the corpus: 170 Number of tokens not in dictionary: 55 Coverage: 71.21% (niv.sentences.txt) Coverage: 25.23% (rus.sentences.txt)
WER and PER
Results from running apertium-eval-translator on niv.sentences.txt and checking with rus.sentences.txt.
Stored in niv-rus-test.0.txt
Number of words in reference: 170 Number of words in test: 217 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %
Results when unknown-word marks (stars) are not removed Edit distance: 217 Word error rate (WER): 127.65 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 127.65 %
