Difference between revisions of "Biak and English/Structural transfer"
From LING073
(→Post-evaluation) |
|||
| Line 9: | Line 9: | ||
[[Category:Sp21_StructuralTransfer]][[Category:Biak]][[Category:English]] | [[Category:Sp21_StructuralTransfer]][[Category:Biak]][[Category:English]] | ||
| + | |||
| + | Statistics about input files | ||
| + | ------------------------------------------------------- | ||
| + | Number of words in reference: 36 | ||
| + | Number of words in test: 39 | ||
| + | Number of unknown words (marked with a star) in test: | ||
| + | Percentage of unknown words: 0.00 % | ||
| + | |||
| + | Results when removing unknown-word marks (stars) | ||
| + | ------------------------------------------------------- | ||
| + | Edit distance: 26 | ||
| + | Word error rate (WER): 72.22 % | ||
| + | Number of position-independent correct words: 16 | ||
| + | Position-independent word error rate (PER): 63.89 % | ||
| + | |||
| + | Results when unknown-word marks (stars) are not removed | ||
| + | ------------------------------------------------------- | ||
| + | Edit distance: 26 | ||
| + | Word Error Rate (WER): 72.22 % | ||
| + | Number of position-independent correct words: 16 | ||
| + | Position-independent word error rate (PER): 63.89 % | ||
| + | |||
| + | Statistics about the translation of unknown words | ||
| + | ------------------------------------------------------- | ||
| + | Number of unknown words which were free rides: 0 | ||
| + | Percentage of unknown words that were free rides: 0% | ||
Revision as of 15:05, 29 April 2021
Pre-evaluation
- WER: 105.56%
- PER: 102.78%
- Percentage of unknown words: 2.56 %
Examples
Post-evaluation
Statistics about input files
Number of words in reference: 36 Number of words in test: 39 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
Edit distance: 26 Word error rate (WER): 72.22 % Number of position-independent correct words: 16 Position-independent word error rate (PER): 63.89 %
Results when unknown-word marks (stars) are not removed
Edit distance: 26 Word Error Rate (WER): 72.22 % Number of position-independent correct words: 16 Position-independent word error rate (PER): 63.89 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%
