Difference between revisions of "Guarani and Warlpiri"

From LING073
Jump to: navigation, search
(→‎wbp -> gug evaluation)
Line 9: Line 9:
  
 
*[http://unicode.org/udhr/d/udhr_gug.txt Universal Declaration of Human Rights in Guarani]
 
*[http://unicode.org/udhr/d/udhr_gug.txt Universal Declaration of Human Rights in Guarani]
 +
 +
==Developed Resources==
 +
*[https://github.swarthmore.edu/tjones5/ling073-gug-wbp-corpus Corpus Repository]
 +
*[https://wikis.swarthmore.edu/ling073/Guarani_and_Warlpiri/Contrastive_Grammar Contrastive Grammar]
 +
*[https://github.swarthmore.edu/tjones5/ling073-gug-wbp Guarani to Warlpiri analyzer repository]
 +
*[https://github.swarthmore.edu/cpillsb1/ling073-wbp-gug Warlpiri to Guarani analyzer repository]
 +
 +
==Lexical Selection==
  
 
==wbp -> gug evaluation==
 
==wbp -> gug evaluation==
Line 37: Line 45:
 
*PER = 100%
 
*PER = 100%
  
−
==Developed Resources==
 
−
*[https://github.swarthmore.edu/tjones5/ling073-gug-wbp-corpus Corpus Repository]
 
−
*[https://wikis.swarthmore.edu/ling073/Guarani_and_Warlpiri/Contrastive_Grammar Contrastive Grammar]
 
−
*[https://github.swarthmore.edu/tjones5/ling073-gug-wbp Guarani to Warlpiri analyzer repository]
 
−
*[https://github.swarthmore.edu/cpillsb1/ling073-wbp-gug Warlpiri to Guarani analyzer repository]
 
−
 
−
==Lexical Selection==
 
  
 
==gug → wbp Evaluation==
 
==gug → wbp Evaluation==

Revision as of 00:57, 26 March 2017

Resources for machine translation between Guarani and Warlpiri

Corpora

Developed Resources

Lexical Selection

wbp -> gug evaluation

Results when running on tests

  • Total number of words: 14
  • Total number of unknown words: 4
  • Percentage of unknown words: 28.57%
  • Percentage of stems translated correctly: 71.43%

When removing unknown words:

  • WER = 78.57%
  • PER = 78.57%

When unknown words are not removed:

  • WER = 100%
  • PER = 100%

Results when running on sentences (corpus)

  • Total number of words: 58
  • Total number of unknown words: 68
  • Percentage of unknown words: 84.45%
  • Percentage of stems translate correctly: 15.52%

When removing unknown words:

  • WER = 22.41%
  • PER = 22.41%

When unknown words are not removed:

  • WER = 100%
  • PER = 100%


gug → wbp Evaluation

Results when running on tests

  • Total number of words: 13
  • Total number of unknown words: 0
  • Percentage of unknown words: 0%
  • Percentage of stems translated correctly: 100%

When removing unknown words:

  • WER = 92.86%
  • PER = 92.86%

When unknown words are not removed:

  • WER = 92.86%
  • PER = 92.86%

Results when running on sentences (corpus)

  • Total number of words: 66
  • Total number of unknown words: 60
  • Percentage of unknown words: 90.9%
  • Percentage of stems translated correctly: 9.09%

When removing unknown words:

  • WER = 0.0%
  • PER = 0.0%

When unknown words are not removed:

  • WER = 100%
  • PER = 100%