Difference between revisions of "Munsee/Final Project"

From LING073
Jump to: navigation, search
(→‎Relevant Links)
(→‎Future Directions)
 
(13 intermediate revisions by the same user not shown)
Line 5: Line 5:
 
# We first generated a parallel corpus of verb phrases in Munsee and English.
 
# We first generated a parallel corpus of verb phrases in Munsee and English.
 
# We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
 
# We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
−
## New twol rules for VTIs that take nouns, ....
+
## New twol rules for VTIs that take nouns objects
 +
## ''Many'' more twol rules for specific verbs conjugations (accounting for accent shifts, instances of metathesis, contractions, etc.)
 
# We then created syntax trees to model the breakdown of various verb phrases.
 
# We then created syntax trees to model the breakdown of various verb phrases.
 
## Structural transfer rules were developed by tracking tags backwards up the trees
 
## Structural transfer rules were developed by tracking tags backwards up the trees
 
## Attributes currently being tracked:
 
## Attributes currently being tracked:
 
### Transitivity
 
### Transitivity
 +
#### Subject
 +
#### Object
 
### Animacy
 
### Animacy
 
### Number
 
### Number
 
### Polarity
 
### Polarity
−
### Gender
+
### Gender (for simplicity, we default to 'he' for third person)
−
### Subject
 
 
# We implemented structural transfer rules for translation from Munsee to English.
 
# We implemented structural transfer rules for translation from Munsee to English.
 
## Issues resolved after presentation on 5/9/25:
 
## Issues resolved after presentation on 5/9/25:
Line 21: Line 23:
 
# Finally, we evaluated our output (see evaluation section below)
 
# Finally, we evaluated our output (see evaluation section below)
  
−
== Outstanding Tasks ==
+
== Future Directions ==
−
* Develop  structural transfer rules so that objects of verbs can be tracked and translated
+
* Further investigate structural transfer rules regarding the "do" form in the negative
−
** This will allow our tool to handle transitive verbs
+
* Develop  structural transfer rules so third person subjects (e.g. names) replace third person pronouns
−
* Account for differences between stable and unstable verb stems
+
* Develop  structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock')
 +
* There is currently a bug in the structural transfer module; once this is resolved, the negative with 'mah' can be re-implemented
 +
* Systematize differences between stable and unstable verb stems
 
** This will require work on both .lexd and .twol files
 
** This will require work on both .lexd and .twol files
 
* Implement future 'tense' with modal word 'uch'
 
* Implement future 'tense' with modal word 'uch'
  
 
== Relevant Links ==
 
== Relevant Links ==
−
* [https://github.swarthmore.edu/Ling073-sp25/ling073-umu-corpus Munsee Corpus Repository]
 
 
* [https://github.com/kmbecker40/apertium-umu Munsee Transducer Repository]
 
* [https://github.com/kmbecker40/apertium-umu Munsee Transducer Repository]
 
* [https://github.com/kmbecker40/apertium-eng Repository for English Transducer]
 
* [https://github.com/kmbecker40/apertium-eng Repository for English Transducer]
−
* [https://github.com/kmbecker40/apertium-umu-eng Repository for Munsee-English Language Pair]
+
* [https://github.com/kmbecker40/apertium-umu-eng Repository for Munsee-English Language Pair] (includes test files)
 +
* [https://github.swarthmore.edu/Ling073-sp25/ling073-umu-corpus Munsee Corpus Repository]
  
 
== Evaluation ==
 
== Evaluation ==
−
''As of May 8, 2025''
+
===''As of May 8, 2025''===
  
 
Line Evaluation Results
 
Line Evaluation Results
Line 45: Line 49:
 
* '''Position-Independent Word Error Rate (PER)''': 97.14%
 
* '''Position-Independent Word Error Rate (PER)''': 97.14%
  
−
''As of May 14, 2025''
+
===''As of May 14, 2025 AM''===
  
 
Line Evaluation Results
 
Line Evaluation Results
Line 56: Line 60:
 
* '''Position-Independent Word Error Rate (PER)''': 17.26%
 
* '''Position-Independent Word Error Rate (PER)''': 17.26%
  
−
'''Note''': We have 5 lines in our verb phrases file that contain negatives with "mah," but there is a bug in the structural transfer module right now, which is why our error rate is higher than it is. The author of the module has been contacted and is looking into it.
+
===''As of May 14, 2025 PM (after fixing structural transfer bug with 'mah')''===
 +
 
 +
Line Evaluation Results
 +
* Number of words in reference: 306
 +
* Number of words in test: 297
 +
* Number of unknown words in test: 0
 +
* Percentage of unknown words: 0.00%
 +
* Edit distance: 45
 +
* '''Word Error Rate (WER)''': 14.71%
 +
* '''Position-Independent Word Error Rate (PER)''': 13.07%
  
 
[[Category:Munsee]]
 
[[Category:Munsee]]
 
[[Category:English]]
 
[[Category:English]]
 +
[[Category:sp25_FinalProjects]]

Latest revision as of 17:58, 14 May 2025

Project Focus

Despite ongoing efforts to revitalize the Munsee language, relatively few pedagogical resources are readily available to the public. Our tool aims to support a crucial step in the learning of this language: the translation of the grammatically complex verbs in Munsee to English, a language likely to be spoken by learners of Munsee.

Approach

  1. We first generated a parallel corpus of verb phrases in Munsee and English.
  2. We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
    1. New twol rules for VTIs that take nouns objects
    2. Many more twol rules for specific verbs conjugations (accounting for accent shifts, instances of metathesis, contractions, etc.)
  3. We then created syntax trees to model the breakdown of various verb phrases.
    1. Structural transfer rules were developed by tracking tags backwards up the trees
    2. Attributes currently being tracked:
      1. Transitivity
        1. Subject
        2. Object
      2. Animacy
      3. Number
      4. Polarity
      5. Gender (for simplicity, we default to 'he' for third person)
  4. We implemented structural transfer rules for translation from Munsee to English.
    1. Issues resolved after presentation on 5/9/25:
      1. Implemented "it" objects (applicable to transitive verbs)
      2. Implemented subject tracking for transitive verbs
  5. Finally, we evaluated our output (see evaluation section below)

Future Directions

  • Further investigate structural transfer rules regarding the "do" form in the negative
  • Develop structural transfer rules so third person subjects (e.g. names) replace third person pronouns
  • Develop structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock')
  • There is currently a bug in the structural transfer module; once this is resolved, the negative with 'mah' can be re-implemented
  • Systematize differences between stable and unstable verb stems
    • This will require work on both .lexd and .twol files
  • Implement future 'tense' with modal word 'uch'

Relevant Links

Evaluation

As of May 8, 2025

Line Evaluation Results

  • Number of words in reference: 175
  • Number of words in test: 82
  • Number of unknown words in test: 50
  • Percentage of unknown words: 60.98%
  • Word Error Rate (WER): 97.14%
  • Position-Independent Word Error Rate (PER): 97.14%

As of May 14, 2025 AM

Line Evaluation Results

  • Number of words in reference: 307
  • Number of words in test: 282
  • Number of unknown words in test: 0
  • Percentage of unknown words: 0.00%
  • Edit distance: 52
  • Word Error Rate (WER): 17.59%
  • Position-Independent Word Error Rate (PER): 17.26%

As of May 14, 2025 PM (after fixing structural transfer bug with 'mah')

Line Evaluation Results

  • Number of words in reference: 306
  • Number of words in test: 297
  • Number of unknown words in test: 0
  • Percentage of unknown words: 0.00%
  • Edit distance: 45
  • Word Error Rate (WER): 14.71%
  • Position-Independent Word Error Rate (PER): 13.07%
Retrieved from "http://wikis.swarthmore.edu/ling073/index.php?title=Munsee/Final_Project&oldid=26265"