Revision as of 14:11, 6 May 2021

Pre-Evaluation

Test file: 'miq-eng.tests.txt' Reference file '../ling073-miq-eng-corpus/eng.tests.txt'

Statistics about input files

Number of words in reference: 17

Number of words in test: 15

Number of unknown words (marked with a star) in test: 10

Percentage of unknown words: 66.67 %

Results when removing unknown-word marks (stars)

Edit distance: 16

Word error rate (WER): 94.12 %

Number of position-independent correct words: 1

Position-independent word error rate (PER): 94.12 %

Results when unknown-word marks (stars) are not removed

Edit distance: 16

Word Error Rate (WER): 94.12 %

Number of position-independent correct words: 1

Position-independent word error rate (PER): 94.12 %

Statistics about the translation of unknown words

Number of unknown words which were free rides: 0

Percentage of unknown words that were free rides: 0.00 %