Munsee/Final Project

From LING073
Revision as of 14:39, 14 May 2025 by Preth1 (talk | contribs) (→‎Evaluation)

Jump to: navigation, search

Project Focus

Despite ongoing efforts to revitalize the Munsee language, relatively few pedagogical resources are readily available to the public. Our tool aims to support a crucial step in the learning of this language: the translation of the grammatically complex verbs in Munsee to English, a language likely to be spoken by learners of Munsee.

Approach

  1. We first generated a parallel corpus of verb phrases in Munsee and English.
  2. We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
    1. New twol rules for VTIs that take nouns, ....
  3. We then created syntax trees to model the breakdown of various verb phrases.
    1. Structural transfer rules were developed by tracking tags backwards up the trees
    2. Attributes currently being tracked:
      1. Transitivity
      2. Animacy
      3. Number
      4. Polarity
      5. Gender
      6. Subject
  4. We implemented structural transfer rules for translation from Munsee to English.
    1. Issues resolved after presentation on 5/9/25:
      1. Implemented "it" objects (applicable to transitive verbs)
      2. Implemented subject tracking for transitive verbs
  5. Finally, we evaluated our output (see evaluation section below)

Outstanding Tasks

  • Develop structural transfer rules so that objects of verbs can be tracked and translated
    • This will allow our tool to handle transitive verbs
  • Account for differences between stable and unstable verb stems
    • This will require work on both .lexd and .twol files
  • Implement future 'tense' with modal word 'uch'

Relevant Links

Evaluation

As of May 8, 2025

Line Evaluation Results

  • Number of words in reference: 175
  • Number of words in test: 82
  • Number of unknown words in test: 50
  • Percentage of unknown words: 60.98%
  • Word Error Rate (WER): 97.14%
  • Position-Independent Word Error Rate (PER): 97.14%

As of May 14, 2025

Line Evaluation Results

  • Number of words in reference: 307
  • Number of words in test: 282
  • Number of unknown words in test: 0
  • Percentage of unknown words: 0.00%
  • Word Error Rate (WER): 17.59%
  • Position-Independent Word Error Rate (PER): 17.26%

Note: We have 5 lines in our verb phrases file that contain negatives with "mah," but there is a bug in the structural transfer module right now, which is why our error rate is higher than it is. The author has been contacted and is looking into it.