Difference between revisions of "Tiwi and English/Structural transfer"
(update modes) |
(→Pre-Evaluation) |
||
| Line 1: | Line 1: | ||
== Pre-Evaluation == | == Pre-Evaluation == | ||
| − | + | Statistics about input files | |
| + | ------------------------------------------------------- | ||
| + | Number of words in reference: 41 | ||
| + | Number of words in test: 28 | ||
| + | Number of unknown words (marked with a star) in test: | ||
| + | Percentage of unknown words: 0.00 % | ||
| + | |||
| + | Results when removing unknown-word marks (stars) | ||
| + | ------------------------------------------------------- | ||
| + | Edit distance: 38 | ||
| + | Word error rate (WER): 92.68 % | ||
| + | Number of position-independent correct words: 3 | ||
| + | Position-independent word error rate (PER): 92.68 % | ||
| + | |||
| + | Results when unknown-word marks (stars) are not removed | ||
| + | ------------------------------------------------------- | ||
| + | Edit distance: 38 | ||
| + | Word Error Rate (WER): 92.68 % | ||
| + | Number of position-independent correct words: 3 | ||
| + | Position-independent word error rate (PER): 92.68 % | ||
| + | |||
| + | Statistics about the translation of unknown words | ||
| + | ------------------------------------------------------- | ||
| + | Number of unknown words which were free rides: 0 | ||
| + | Percentage of unknown words that were free rides: 0% | ||
== Examples == | == Examples == | ||
Revision as of 13:38, 29 April 2021
Pre-Evaluation
Statistics about input files
Number of words in reference: 41 Number of words in test: 28 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
Edit distance: 38 Word error rate (WER): 92.68 % Number of position-independent correct words: 3 Position-independent word error rate (PER): 92.68 %
Results when unknown-word marks (stars) are not removed
Edit distance: 38 Word Error Rate (WER): 92.68 % Number of position-independent correct words: 3 Position-independent word error rate (PER): 92.68 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%
Examples
Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, biltrans, transfer, and the pair itself (abc-xyz).
Post Evaluation
Perform WER, PER, and coverage tests again
