Difference between revisions of "Kaingang and Portuguese/Structural Transfer"
From LING073
Line 1: | Line 1: | ||
[[Category:Sp19_StructuralTransfer]] [[Category:Kaingang]] [[Category:Portuguese]] | [[Category:Sp19_StructuralTransfer]] [[Category:Kaingang]] [[Category:Portuguese]] | ||
==Pre-evaluation== | ==Pre-evaluation== | ||
− | *'''WER:''' | + | Statistics about input files |
+ | ------------------------------------------------------- | ||
+ | Number of words in reference: 63 | ||
+ | Number of words in test: 63 | ||
+ | Number of unknown words (marked with a star) in test: 26 | ||
+ | Percentage of unknown words: 41.27 % | ||
+ | |||
+ | Results when removing unknown-word marks (stars) | ||
+ | ------------------------------------------------------- | ||
+ | Edit distance: 38 | ||
+ | Word error rate (WER): 60.32 % | ||
+ | Number of position-independent correct words: 25 | ||
+ | Position-independent word error rate (PER): 60.32 % | ||
+ | |||
+ | Results when unknown-word marks (stars) are not removed | ||
+ | ------------------------------------------------------- | ||
+ | Edit distance: 63 | ||
+ | Word Error Rate (WER): 100.00 % | ||
+ | Number of position-independent correct words: 0 | ||
+ | Position-independent word error rate (PER): 100.00 % | ||
+ | |||
+ | Statistics about the translation of unknown words | ||
+ | ------------------------------------------------------- | ||
+ | Number of unknown words which were free rides: 25 | ||
+ | Percentage of unknown words that were free rides: 96.15 % | ||
+ | |||
+ | *'''WER:'''60.32 % | ||
+ | |||
*'''PER:''' | *'''PER:''' | ||
+ | |||
*'''Coverage:''' | *'''Coverage:''' | ||
+ | |||
==Examples for implementation== | ==Examples for implementation== | ||
'''Sentence:''' | '''Sentence:''' |
Revision as of 19:47, 16 April 2019
Pre-evaluation
Statistics about input files ------------------------------------------------------- Number of words in reference: 63 Number of words in test: 63 Number of unknown words (marked with a star) in test: 26 Percentage of unknown words: 41.27 % Results when removing unknown-word marks (stars) ------------------------------------------------------- Edit distance: 38 Word error rate (WER): 60.32 % Number of position-independent correct words: 25 Position-independent word error rate (PER): 60.32 % Results when unknown-word marks (stars) are not removed ------------------------------------------------------- Edit distance: 63 Word Error Rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Statistics about the translation of unknown words ------------------------------------------------------- Number of unknown words which were free rides: 25 Percentage of unknown words that were free rides: 96.15 %
- WER:60.32 %
- PER:
- Coverage:
Examples for implementation
Sentence:
Tagger output:
Biltrans output:
Chunker output:
Interchunk output:
Postchunk output:
kgp-por output:
Post-evaluation
- WER:
- PER:
- Coverage: