Difference between revisions of "Guarani and Warlpiri"
From LING073
(→gug → wbp Evaluation) |
(→wbp -> gug evaluation) |
||
| Line 12: | Line 12: | ||
==wbp -> gug evaluation== | ==wbp -> gug evaluation== | ||
===Results when running on tests=== | ===Results when running on tests=== | ||
| − | * | + | *Total number of words: 14 |
| + | *Total number of unknown words: 4 | ||
*Percentage of unknown words: 28.57% | *Percentage of unknown words: 28.57% | ||
| + | *Percentage of stems translated correctly: 71.43% | ||
When removing unknown words: | When removing unknown words: | ||
| Line 21: | Line 23: | ||
*WER = 100% | *WER = 100% | ||
*PER = 100% | *PER = 100% | ||
| + | |||
===Results when running on sentences (corpus) === | ===Results when running on sentences (corpus) === | ||
| − | * | + | *Total number of words: 58 |
| + | *Total number of unknown words: 68 | ||
| + | *Percentage of unknown words: 84.45% | ||
| + | *Percentage of stems translate correctly: 15.52% | ||
| + | |||
When removing unknown words: | When removing unknown words: | ||
*WER = 22.41% | *WER = 22.41% | ||
Revision as of 00:57, 26 March 2017
Resources for machine translation between Guarani and Warlpiri
Contents
Corpora
wbp -> gug evaluation
Results when running on tests
- Total number of words: 14
- Total number of unknown words: 4
- Percentage of unknown words: 28.57%
- Percentage of stems translated correctly: 71.43%
When removing unknown words:
- WER = 78.57%
- PER = 78.57%
When unknown words are not removed:
- WER = 100%
- PER = 100%
Results when running on sentences (corpus)
- Total number of words: 58
- Total number of unknown words: 68
- Percentage of unknown words: 84.45%
- Percentage of stems translate correctly: 15.52%
When removing unknown words:
- WER = 22.41%
- PER = 22.41%
When unknown words are not removed:
- WER = 100%
- PER = 100%
Developed Resources
- Corpus Repository
- Contrastive Grammar
- Guarani to Warlpiri analyzer repository
- Warlpiri to Guarani analyzer repository
Lexical Selection
gug → wbp Evaluation
Results when running on tests
- Total number of words: 13
- Total number of unknown words: 0
- Percentage of unknown words: 0%
- Percentage of stems translated correctly: 100%
When removing unknown words:
- WER = 92.86%
- PER = 92.86%
When unknown words are not removed:
- WER = 92.86%
- PER = 92.86%
Results when running on sentences (corpus)
- Total number of words: 66
- Total number of unknown words: 60
- Percentage of unknown words: 90.9%
- Percentage of stems translated correctly: 9.09%
When removing unknown words:
- WER = 0.0%
- PER = 0.0%
When unknown words are not removed:
- WER = 100%
- PER = 100%