Difference between revisions of "Waray and English/Structural transfer"
From LING073
(→Post-evaluation) |
|||
Line 20: | Line 20: | ||
Statistics about input files | Statistics about input files | ||
------------------------------------------------------- | ------------------------------------------------------- | ||
− | Number of words in reference: 1183 | + | * Number of words in reference: 1183 |
− | Number of words in test: 1154 | + | * Number of words in test: 1154 |
− | Number of unknown words (marked with a star) in test: 561 | + | * Number of unknown words (marked with a star) in test: 561 |
− | Percentage of unknown words: 48.61 % | + | * Percentage of unknown words: 48.61 % |
Results when removing unknown-word marks (stars) | Results when removing unknown-word marks (stars) | ||
------------------------------------------------------- | ------------------------------------------------------- | ||
− | Edit distance: 1213 | + | * Edit distance: 1213 |
− | Word error rate (WER): 102.54 % | + | * Word error rate (WER): 102.54 % |
− | Number of position-independent correct words: 68 | + | * Number of position-independent correct words: 68 |
− | Position-independent word error rate (PER): 94.25 % | + | * Position-independent word error rate (PER): 94.25 % |
Revision as of 18:08, 28 May 2021
Pre-evaluation
Coverage: 906 / 1467 (~0.61758691206543967280)
Statistics about input files
- Number of words in reference: 1183
- Number of words in test: 1308
- Number of unknown words (marked with a star) in test: 564
- Percentage of unknown words: 42.89 %
Results when removing unknown-word marks (stars)
- Edit distance: 1330
- Word error rate (WER): 112.34 %
- Number of position-independent correct words: 39
- Position-independent word error rate (PER): 107.27 %
Post-evaluation
Statistics about input files
- Number of words in reference: 1183
- Number of words in test: 1154
- Number of unknown words (marked with a star) in test: 561
- Percentage of unknown words: 48.61 %
Results when removing unknown-word marks (stars)
- Edit distance: 1213
- Word error rate (WER): 102.54 %
- Number of position-independent correct words: 68
- Position-independent word error rate (PER): 94.25 %