Difference between revisions of "Tiwi and English/Structural transfer"
(→Examples) |
|||
| Line 39: | Line 39: | ||
== Post Evaluation == | == Post Evaluation == | ||
| + | ===Statistics about input files=== | ||
| + | Number of words in reference: | ||
| + | |||
| + | Number of words in test: | ||
| + | |||
| + | Number of unknown words (marked with a star) in test: | ||
| + | |||
| + | Percentage of unknown words: | ||
| + | |||
| + | ===Results when removing unknown-word marks (stars)=== | ||
| + | Edit distance: | ||
| + | |||
| + | Word error rate (WER): | ||
| + | |||
| + | Number of position-independent correct words: | ||
| + | |||
| + | Position-independent word error rate (PER): | ||
| + | |||
| + | ===Results when unknown-word marks (stars) are not removed=== | ||
| + | Edit distance: | ||
| + | |||
| + | Word Error Rate (WER): | ||
| + | |||
| + | Number of position-independent correct words: | ||
| + | |||
| + | Position-independent word error rate (PER): | ||
| + | |||
| + | ===Statistics about the translation of unknown words=== | ||
| + | Number of unknown words which were free rides: | ||
| + | |||
| + | Percentage of unknown words that were free rides: | ||
| + | |||
Perform WER, PER, and coverage tests again | Perform WER, PER, and coverage tests again | ||
[[Category:Sp21_StructuralTransfer]] [[Category:Tiwi]] [[Category:English]] | [[Category:Sp21_StructuralTransfer]] [[Category:Tiwi]] [[Category:English]] | ||
Revision as of 22:25, 3 May 2021
Contents
Pre-Evaluation
Statistics about input files
Number of words in reference: 41
Number of words in test: 28
Number of unknown words (marked with a star) in test:
Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
Edit distance: 38
Word error rate (WER): 92.68 %
Number of position-independent correct words: 3
Position-independent word error rate (PER): 92.68 %
Results when unknown-word marks (stars) are not removed
Edit distance: 38
Word Error Rate (WER): 92.68 %
Number of position-independent correct words: 3
Position-independent word error rate (PER): 92.68 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0
Percentage of unknown words that were free rides: 0%
Examples
Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, biltrans, transfer, and the pair itself (abc-xyz).
Gendered Nouns and Adjectives
Inserting 'Be' Verbs
Post Evaluation
Statistics about input files
Number of words in reference:
Number of words in test:
Number of unknown words (marked with a star) in test:
Percentage of unknown words:
Results when removing unknown-word marks (stars)
Edit distance:
Word error rate (WER):
Number of position-independent correct words:
Position-independent word error rate (PER):
Results when unknown-word marks (stars) are not removed
Edit distance:
Word Error Rate (WER):
Number of position-independent correct words:
Position-independent word error rate (PER):
Statistics about the translation of unknown words
Number of unknown words which were free rides:
Percentage of unknown words that were free rides:
Perform WER, PER, and coverage tests again
