Difference between revisions of "Waray and English/Structural transfer"
From LING073
(→Pre-evaluation) |
|||
Line 15: | Line 15: | ||
* Number of position-independent correct words: 39 | * Number of position-independent correct words: 39 | ||
* Position-independent word error rate (PER): 107.27 % | * Position-independent word error rate (PER): 107.27 % | ||
+ | |||
+ | ===Post-evaluation=== | ||
+ | ===Pre-evaluation=== | ||
+ | Coverage: 906 / 1467 (~0.61758691206543967280) | ||
+ | |||
+ | Statistics about input files | ||
+ | ------------------------------------------------------- | ||
+ | * Number of words in reference: 1183 | ||
+ | * Number of words in test: 1308 | ||
+ | * Number of unknown words (marked with a star) in test: 564 | ||
+ | * Percentage of unknown words: 42.89 % | ||
+ | |||
+ | Results when removing unknown-word marks (stars) | ||
+ | ------------------------------------------------------- | ||
+ | * Edit distance: 1330 | ||
+ | * Word error rate (WER): 112.34 % | ||
+ | * Number of position-independent correct words: 39 | ||
+ | * Position-independent word error rate (PER): 107.27 % | ||
+ | |||
+ | ===Post-evaluation=== | ||
+ | |||
+ | Statistics about input files | ||
+ | ------------------------------------------------------- | ||
+ | Number of words in reference: 1183 | ||
+ | Number of words in test: 1154 | ||
+ | Number of unknown words (marked with a star) in test: 561 | ||
+ | Percentage of unknown words: 48.61 % | ||
+ | |||
+ | Results when removing unknown-word marks (stars) | ||
+ | ------------------------------------------------------- | ||
+ | Edit distance: 1213 | ||
+ | Word error rate (WER): 102.54 % | ||
+ | Number of position-independent correct words: 68 | ||
+ | Position-independent word error rate (PER): 94.25 % |
Revision as of 18:01, 28 May 2021
Pre-evaluation
Coverage: 906 / 1467 (~0.61758691206543967280)
Statistics about input files
- Number of words in reference: 1183
- Number of words in test: 1308
- Number of unknown words (marked with a star) in test: 564
- Percentage of unknown words: 42.89 %
Results when removing unknown-word marks (stars)
- Edit distance: 1330
- Word error rate (WER): 112.34 %
- Number of position-independent correct words: 39
- Position-independent word error rate (PER): 107.27 %
Post-evaluation
Pre-evaluation
Coverage: 906 / 1467 (~0.61758691206543967280)
Statistics about input files
- Number of words in reference: 1183
- Number of words in test: 1308
- Number of unknown words (marked with a star) in test: 564
- Percentage of unknown words: 42.89 %
Results when removing unknown-word marks (stars)
- Edit distance: 1330
- Word error rate (WER): 112.34 %
- Number of position-independent correct words: 39
- Position-independent word error rate (PER): 107.27 %
Post-evaluation
Statistics about input files
Number of words in reference: 1183 Number of words in test: 1154 Number of unknown words (marked with a star) in test: 561 Percentage of unknown words: 48.61 %
Results when removing unknown-word marks (stars)
Edit distance: 1213 Word error rate (WER): 102.54 % Number of position-independent correct words: 68 Position-independent word error rate (PER): 94.25 %