Difference between revisions of "Dzongkha and English/Structural Transfer"
From LING073
(→Post-Evaluation) |
(→Post-Evaluation) |
||
| Line 53: | Line 53: | ||
== Post-Evaluation == | == Post-Evaluation == | ||
| − | Statistics about input files | + | === Statistics about input files === |
| − | + | *Number of words in reference: 31 | |
| − | Number of words in reference: 31 | + | *Number of words in test: 13 |
| − | Number of words in test: 13 | + | *Number of unknown words (marked with a star) in test: |
| − | Number of unknown words (marked with a star) in test: | + | *Percentage of unknown words: 0.00 % |
| − | Percentage of unknown words: 0.00 % | ||
| − | Results when removing unknown-word marks (stars) | + | === Results when removing unknown-word marks (stars) === |
| − | + | *Edit distance: 28 | |
| − | Edit distance: 28 | + | *Word error rate (WER): 90.32 % |
| − | Word error rate (WER): 90.32 % | + | *Number of position-independent correct words: 3 |
| − | Number of position-independent correct words: 3 | + | *Position-independent word error rate (PER): 90.32 % |
| − | Position-independent word error rate (PER): 90.32 % | ||
| − | Results when unknown-word marks (stars) are not removed | + | === Results when unknown-word marks (stars) are not removed === |
| − | + | *Edit distance: 28 | |
| − | Edit distance: 28 | + | *Word Error Rate (WER): 90.32 % |
| − | Word Error Rate (WER): 90.32 % | + | *Number of position-independent correct words: 3 |
| − | Number of position-independent correct words: 3 | + | *Position-independent word error rate (PER): 90.32 % |
| − | Position-independent word error rate (PER): 90.32 % | ||
| − | Statistics about the translation of unknown words | + | === Statistics about the translation of unknown words === |
| − | + | *Number of unknown words which were free rides: 0 | |
| − | Number of unknown words which were free rides: 0 | + | *Percentage of unknown words that were free rides: 0% |
| − | Percentage of unknown words that were free rides: 0% | ||
| − | Coverage: 100% | + | === Coverage === |
| + | *Bilingual Coverage: 100% | ||
[[Category:Sp21_StructuralTransfer]] [[Category:Dzongkha]][[Category:English]] | [[Category:Sp21_StructuralTransfer]] [[Category:Dzongkha]][[Category:English]] | ||
Revision as of 03:03, 15 May 2021
Contents
Pre-Evaluation
Statistics about input file
- Number of words in reference: 31
- Number of words in test: 10
- Number of unknown words (marked with a star) in test: 0
- Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
- Edit distance: 31
- Word error rate (WER): 100.00 %
- Number of position-independent correct words: 0
- Position-independent word error rate (PER): 100.00 %
Results when unknown-word marks (stars) are not removed
- Edit distance: 31
- Word Error Rate (WER): 100.00 %
- Number of position-independent correct words: 0
- Position-independent word error rate (PER): 100.00 %
Statistics about the translation of unknown words
- Number of unknown words which were free rides: 0
- Percentage of unknown words that were free rides: 0%
Coverage
- Bilingual Coverage: 100%
Example
Determiner After Noun
Dzo-Eng
- (dzo) བྱི་ལི་དེ་ → (eng) the cat
Tagger
- (dzo) བྱི་ལི་<n> དེ་<det><def> → (eng) the<det><def> cat<n><sg>
Biltrans
^བྱི་ལི་<n>/cat<n>$^དེ་<det>/the<det><def>$
Transfer
^the<det><def><sg>$ ^cat<n><m><sg>$
Post-Evaluation
Statistics about input files
- Number of words in reference: 31
- Number of words in test: 13
- Number of unknown words (marked with a star) in test:
- Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
- Edit distance: 28
- Word error rate (WER): 90.32 %
- Number of position-independent correct words: 3
- Position-independent word error rate (PER): 90.32 %
Results when unknown-word marks (stars) are not removed
- Edit distance: 28
- Word Error Rate (WER): 90.32 %
- Number of position-independent correct words: 3
- Position-independent word error rate (PER): 90.32 %
Statistics about the translation of unknown words
- Number of unknown words which were free rides: 0
- Percentage of unknown words that were free rides: 0%
Coverage
- Bilingual Coverage: 100%
