Difference between revisions of "Guarani and Warlpiri"

Revision as of 23:29, 19 April 2017

Resources for machine translation between Guarani and Warlpiri

Corpora

• Warlpiri Bible

• Guarani Bible

• English Bible

• Universal Declaration of Human Rights in Guarani

Developed Resources

• Corpus Repository
• Contrastive Grammar
• Guarani to Warlpiri analyzer repository
  • This repo will hold the fully functioning rule-based machine translation system.
• Warlpiri to Guarani analyzer repository
  • This repo will not be developed further.
• Lexical selection Wiki page
• Structural transfer Wiki page

Lexical Selection

• See Lexical Selection page linked above for more detail

• (gug) ahy'o → (wbp) ngukarna "throat"; lirra "voice"
• (gug) ha'anga → (wbp) japirdimi "threaten"; walaparrirni "imitate"
• (gug) ajúra → (wbp) japirdimi "collar"; waninja "neck"
• (wbp) rdaka → (gug) avatisoka "hand"; po "five"
• (wbp) kirdirrpa → (gug) itakua "cave"; ka'irãi "jail"

Initial Evaluation

wbp → gug evaluation

Results when running on tests

• Total number of words: 14
• Total number of unknown words: 4
• Percentage of unknown words: 28.57%
• Percentage of stems translated correctly: 71.43%

When removing unknown words:

• WER = 78.57%
• PER = 78.57%

When unknown words are not removed:

• WER = 100%
• PER = 100%

Results when running on sentences (corpus)

• Total number of words: 58
• Total number of unknown words: 68
• Percentage of unknown words: 84.45%
• Percentage of stems translate correctly: 15.52%

When removing unknown words:

• WER = 22.41%
• PER = 22.41%

When unknown words are not removed:

• WER = 100%
• PER = 100%

gug → wbp evaluation

Results when running on tests

• Total number of words: 13
• Total number of unknown words: 0
• Percentage of unknown words: 0%
• Percentage of stems translated correctly: 100%

When removing unknown words:

• WER = 92.86%
• PER = 92.86%

When unknown words are not removed:

• WER = 92.86%
• PER = 92.86%

Results when running on sentences (corpus)

• Total number of words: 66
• Total number of unknown words: 60
• Percentage of unknown words: 90.9%
• Percentage of stems translated correctly: 9.09%

When removing unknown words:

• WER = 0.0%
• PER = 0.0%

When unknown words are not removed:

• WER = 100%
• PER = 100%

Final Evaluation

gug → wbp and wbp → gug

100 more stems

Added 100 more stems (mostly nouns, verbs, and adjectives) to the bilingual and monolingual dictionaries.

gug → wbp

3 new lexical selection rules

• (gug) akã → (wbp) jurru "head"; payarrpa "hill"
  • Rule: Select "jurru" (Eng: head) as the translation of "akã" when it is preceded by "ha'e" (Eng: his/her). Otherwise, select "payarrpa" as the default.

• (gug) asu → (wbp) jampu "left"; jampu-karra "left-handed"
  • Rule: Select "jampu-karra" (Eng: left-handed) as the translation of "asu" when it is followed by person words such as "ava" (Eng: person) or "kuña" (Eng: woman) or "mitã" (Eng: child). Otherwise, select "jampu" (Eng: left) as the default.

• (gug) henyhẽ → (wbp) jaka-ngalya "full"; ngayarrka "pregnant"
  • Rule: Select "ngayarrka" (Eng: pregnant) as the translation of "henyhẽ" when it is followed/preceded by "kuña" (Eng: woman) or other words describing female people. Otherwise, select "jaka-ngalya" (Eng: full) as the default.

6 additions to the morphology

• Improved pronomial analysis:
  • Before: "<ngaju>"
    • "ngaju" prn pers p3 sg
    • "ngaju" prn pers p3 du
    • "ngaju" prn pers p2 sg
    • "ngaju" prn pers p2 du
    • "ngaju" prn pers p2 pl
    • "ngaju" prn pers p1 sg
    • "ngaju" prn pers p1 du excl
    • "ngaju" prn pers p1 du incl
    • "ngaju" prn pers p1 pl excl
    • "ngaju" prn pers p1 pl incl
• After:
  • "<ngaju>"

• Added numeral analysis:
  • Several number words in Warlpiri also have meanings as nouns (e.g. rdaka can mean "hand" or "five")
  • the -pala ending distinguishes them as number words, but it is not always necessary
  • "rdaka-pala": ^rdaka-pala/rdaka<num>$^./.<sent>$
  • "rdaka": ^rdaka/rdaka<num>/rdaka<n><sg><abs>$^./.<sent>$

• Added adverb analysis:
  • "nyurruwiyi: ^nyurruwiyi/nyurruwiyi<adv>$^./.<sent>$

• Added elative/source case for verb auxiliaries :
  • "kajangka": ^kajangka/ka<vaux><src><subj3sg>$^./.<sent>$

• Added inceptive aspect for verbs:
  • "pakarnunjunu": ^pakarnunjunu/pakarni<v><tv><past><inc>$^./.<sent>$

• Added possessive marker "nyanu" for nouns:
  • "kaja-nyanu-rlu": ^kaja-nyanu-rlu/kaja<n><pl><poss><erg>$^./.<sent>$

• Clitics
  • (wbp) -yijala cl. also, too, likewise.
  • (wbp) -nyayirni Variant: -nyarrirni. cl. very, really -> (gug) adverb: asy

• Conjunction??
  • ngula cj. 1. that, which, who. Syn: kuja. 2.he, she, it, they, them. Referring back to something in previous context.

• Cs?
  • -jangka cs. 1. from. 2. because. Syn: -ngurlu~-ngirli, -warnu.

• Reflexive?
  • nyanungu pn.

• ngana - who

• yangka nm. aforementioned one, same one mentioned before.
• Numbers
• -juku cl. still, yet. Syn: -kirli.
• -pinki ns. such-like, things pertaining to.
• -kari ns. another, other.
• nyurru av. already, short time ago.
• -wiyi (first)
• -wana ns. along, alongside, beside.

4 new disambiguation rules

• Number vs Noun (e.g. rdaka = hand or five), has the number marker -pala
• Manu = cnjcoo vs v tv past?
• Kuja = "ka" vaux rel subj3sg OR kuja = kuja cj. relative pronoun, what, which, that, who.
  • Kuja = "ka" vaux rel subj3sg OR kuja = kuja cj. relative pronoun, what, which, that, who.
  • Ngula = "ka" vaux rel subj3sg OR kuja = kuja cj. relative pronoun, what, which, that, who. Find by searching AUX:COMP in new dictionary

wbp → gug

• (wbp) muru-pinyi → (gug) mboy'u "swallow"; kuapyti "insert"
  • Rule: select "mboy'u" if "muru-pinyi" is followed by food or drink words: "ngapa" (water/grog), "pama" (liquor), "jirnarri" (food), and "mangarri" (vegetable). In other cases, select "kuapyti".
  • Kurdu-ngku muru-pinyi ngapa. (Eng: The child is swallowing water/grog.)
  • muru-pinyi walya (Eng: insert in the ground)

• (wbp) kirdirrpa → (gug) itakua "cave"; ka'irãi "jail"
  • Rule: We couldn't come up with a good way to solve this problem. We decided to select "itakua" as the default, because it appears to be more common.
  • Kurdu-ngku nyanyi kirdirrpa. (Eng: The child is looking for the cave.)
  • Wati-ngku jarda-jarrimi kirdirrpa-rla (Eng: The man sleeps in the jail.)

• (wbp) juka → (gug) asuka "sugar"; aichémemby "cousin"
• (wbp) warlu → (gug) tini "hot"; aku "angry"
  • miparrpa = face or person; yapa = person
• (wbp) yajarni → (gug) henoi "fetch/invite (someone)"; kakuaa "grow (a plant)"
  • watiya = plant