Difference between revisions of "Miskito and English/Structural transfer"
(→Pre-Evaluation) |
|||
Line 1: | Line 1: | ||
=Pre-Evaluation= | =Pre-Evaluation= | ||
+ | [[Category:Sp21_StructuralTransfer]][[Category:Miskito]][[Category:English]] | ||
+ | |||
+ | Test file: 'miq-eng.tests.txt' | ||
+ | Reference file '../ling073-miq-eng-corpus/eng.tests.txt' | ||
+ | |||
+ | Statistics about input files | ||
+ | ------------------------------------------------------- | ||
+ | Number of words in reference: 17 | ||
+ | Number of words in test: 15 | ||
+ | Number of unknown words (marked with a star) in test: 10 | ||
+ | Percentage of unknown words: 66.67 % | ||
+ | |||
+ | Results when removing unknown-word marks (stars) | ||
+ | ------------------------------------------------------- | ||
+ | Edit distance: 16 | ||
+ | Word error rate (WER): 94.12 % | ||
+ | Number of position-independent correct words: 1 | ||
+ | Position-independent word error rate (PER): 94.12 % | ||
− | + | Results when unknown-word marks (stars) are not removed | |
+ | ------------------------------------------------------- | ||
+ | Edit distance: 16 | ||
+ | Word Error Rate (WER): 94.12 % | ||
+ | Number of position-independent correct words: 1 | ||
+ | Position-independent word error rate (PER): 94.12 % | ||
+ | |||
+ | Statistics about the translation of unknown words | ||
+ | ------------------------------------------------------- | ||
+ | Number of unknown words which were free rides: 0 | ||
+ | Percentage of unknown words that were free rides: 0.00 % |
Revision as of 15:16, 29 April 2021
Pre-Evaluation
Test file: 'miq-eng.tests.txt' Reference file '../ling073-miq-eng-corpus/eng.tests.txt'
Statistics about input files
Number of words in reference: 17 Number of words in test: 15 Number of unknown words (marked with a star) in test: 10 Percentage of unknown words: 66.67 %
Results when removing unknown-word marks (stars)
Edit distance: 16 Word error rate (WER): 94.12 % Number of position-independent correct words: 1 Position-independent word error rate (PER): 94.12 %
Results when unknown-word marks (stars) are not removed
Edit distance: 16 Word Error Rate (WER): 94.12 % Number of position-independent correct words: 1 Position-independent word error rate (PER): 94.12 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0.00 %