Difference between revisions of "Dzongkha and English/Structural Transfer"
(→Coverage) |
(→Post-Evaluation) |
||
Line 53: | Line 53: | ||
== Post-Evaluation == | == Post-Evaluation == | ||
− | WER | + | Statistics about input files |
+ | ------------------------------------------------------- | ||
+ | Number of words in reference: 31 | ||
+ | Number of words in test: 13 | ||
+ | Number of unknown words (marked with a star) in test: | ||
+ | Percentage of unknown words: 0.00 % | ||
+ | |||
+ | Results when removing unknown-word marks (stars) | ||
+ | ------------------------------------------------------- | ||
+ | Edit distance: 28 | ||
+ | Word error rate (WER): 90.32 % | ||
+ | Number of position-independent correct words: 3 | ||
+ | Position-independent word error rate (PER): 90.32 % | ||
+ | |||
+ | Results when unknown-word marks (stars) are not removed | ||
+ | ------------------------------------------------------- | ||
+ | Edit distance: 28 | ||
+ | Word Error Rate (WER): 90.32 % | ||
+ | Number of position-independent correct words: 3 | ||
+ | Position-independent word error rate (PER): 90.32 % | ||
+ | |||
+ | Statistics about the translation of unknown words | ||
+ | ------------------------------------------------------- | ||
+ | Number of unknown words which were free rides: 0 | ||
+ | Percentage of unknown words that were free rides: 0% | ||
+ | |||
+ | Coverage: 100% | ||
− | |||
− | |||
[[Category:Sp21_StructuralTransfer]] [[Category:Dzongkha]][[Category:English]] | [[Category:Sp21_StructuralTransfer]] [[Category:Dzongkha]][[Category:English]] |
Revision as of 23:02, 14 May 2021
Contents
Pre-Evaluation
Statistics about input file
- Number of words in reference: 31
- Number of words in test: 10
- Number of unknown words (marked with a star) in test: 0
- Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
- Edit distance: 31
- Word error rate (WER): 100.00 %
- Number of position-independent correct words: 0
- Position-independent word error rate (PER): 100.00 %
Results when unknown-word marks (stars) are not removed
- Edit distance: 31
- Word Error Rate (WER): 100.00 %
- Number of position-independent correct words: 0
- Position-independent word error rate (PER): 100.00 %
Statistics about the translation of unknown words
- Number of unknown words which were free rides: 0
- Percentage of unknown words that were free rides: 0%
Coverage
- Bilingual Coverage: 100%
Example
Determiner After Noun
Dzo-Eng
- (dzo) བྱི་ལི་དེ་ → (eng) the cat
Tagger
- (dzo) བྱི་ལི་<n> དེ་<det><def> → (eng) the<det><def> cat<n><sg>
Biltrans
^བྱི་ལི་<n>/cat<n>$^དེ་<det>/the<det><def>$
Transfer
^the<det><def><sg>$ ^cat<n><m><sg>$
Post-Evaluation
Statistics about input files
Number of words in reference: 31 Number of words in test: 13 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
Edit distance: 28 Word error rate (WER): 90.32 % Number of position-independent correct words: 3 Position-independent word error rate (PER): 90.32 %
Results when unknown-word marks (stars) are not removed
Edit distance: 28 Word Error Rate (WER): 90.32 % Number of position-independent correct words: 3 Position-independent word error rate (PER): 90.32 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%
Coverage: 100%