Difference between revisions of "Munsee/Final Project"
From LING073
(→Future Directions) |
(→Future Directions) |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 24: | Line 24: | ||
== Future Directions == | == Future Directions == | ||
| + | * Further investigate structural transfer rules regarding the "do" form in the negative | ||
* Develop structural transfer rules so third person subjects (e.g. names) replace third person pronouns | * Develop structural transfer rules so third person subjects (e.g. names) replace third person pronouns | ||
* Develop structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock') | * Develop structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock') | ||
| Line 34: | Line 35: | ||
* [https://github.com/kmbecker40/apertium-umu Munsee Transducer Repository] | * [https://github.com/kmbecker40/apertium-umu Munsee Transducer Repository] | ||
* [https://github.com/kmbecker40/apertium-eng Repository for English Transducer] | * [https://github.com/kmbecker40/apertium-eng Repository for English Transducer] | ||
| − | * [https://github.com/kmbecker40/apertium-umu-eng Repository for Munsee-English Language Pair] | + | * [https://github.com/kmbecker40/apertium-umu-eng Repository for Munsee-English Language Pair] (includes test files) |
* [https://github.swarthmore.edu/Ling073-sp25/ling073-umu-corpus Munsee Corpus Repository] | * [https://github.swarthmore.edu/Ling073-sp25/ling073-umu-corpus Munsee Corpus Repository] | ||
| Line 48: | Line 49: | ||
* '''Position-Independent Word Error Rate (PER)''': 97.14% | * '''Position-Independent Word Error Rate (PER)''': 97.14% | ||
| − | ===''As of May 14, 2025''=== | + | ===''As of May 14, 2025 AM''=== |
Line Evaluation Results | Line Evaluation Results | ||
| Line 59: | Line 60: | ||
* '''Position-Independent Word Error Rate (PER)''': 17.26% | * '''Position-Independent Word Error Rate (PER)''': 17.26% | ||
| − | ''' | + | ===''As of May 14, 2025 PM (after fixing structural transfer bug with 'mah')''=== |
| + | |||
| + | Line Evaluation Results | ||
| + | * Number of words in reference: 306 | ||
| + | * Number of words in test: 297 | ||
| + | * Number of unknown words in test: 0 | ||
| + | * Percentage of unknown words: 0.00% | ||
| + | * Edit distance: 45 | ||
| + | * '''Word Error Rate (WER)''': 14.71% | ||
| + | * '''Position-Independent Word Error Rate (PER)''': 13.07% | ||
[[Category:Munsee]] | [[Category:Munsee]] | ||
[[Category:English]] | [[Category:English]] | ||
[[Category:sp25_FinalProjects]] | [[Category:sp25_FinalProjects]] | ||
Latest revision as of 17:58, 14 May 2025
Contents
Project Focus
Despite ongoing efforts to revitalize the Munsee language, relatively few pedagogical resources are readily available to the public. Our tool aims to support a crucial step in the learning of this language: the translation of the grammatically complex verbs in Munsee to English, a language likely to be spoken by learners of Munsee.
Approach
- We first generated a parallel corpus of verb phrases in Munsee and English.
- We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
- New twol rules for VTIs that take nouns objects
- Many more twol rules for specific verbs conjugations (accounting for accent shifts, instances of metathesis, contractions, etc.)
- We then created syntax trees to model the breakdown of various verb phrases.
- Structural transfer rules were developed by tracking tags backwards up the trees
- Attributes currently being tracked:
- Transitivity
- Subject
- Object
- Animacy
- Number
- Polarity
- Gender (for simplicity, we default to 'he' for third person)
- Transitivity
- We implemented structural transfer rules for translation from Munsee to English.
- Issues resolved after presentation on 5/9/25:
- Implemented "it" objects (applicable to transitive verbs)
- Implemented subject tracking for transitive verbs
- Issues resolved after presentation on 5/9/25:
- Finally, we evaluated our output (see evaluation section below)
Future Directions
- Further investigate structural transfer rules regarding the "do" form in the negative
- Develop structural transfer rules so third person subjects (e.g. names) replace third person pronouns
- Develop structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock')
- There is currently a bug in the structural transfer module; once this is resolved, the negative with 'mah' can be re-implemented
- Systematize differences between stable and unstable verb stems
- This will require work on both .lexd and .twol files
- Implement future 'tense' with modal word 'uch'
Relevant Links
- Munsee Transducer Repository
- Repository for English Transducer
- Repository for Munsee-English Language Pair (includes test files)
- Munsee Corpus Repository
Evaluation
As of May 8, 2025
Line Evaluation Results
- Number of words in reference: 175
- Number of words in test: 82
- Number of unknown words in test: 50
- Percentage of unknown words: 60.98%
- Word Error Rate (WER): 97.14%
- Position-Independent Word Error Rate (PER): 97.14%
As of May 14, 2025 AM
Line Evaluation Results
- Number of words in reference: 307
- Number of words in test: 282
- Number of unknown words in test: 0
- Percentage of unknown words: 0.00%
- Edit distance: 52
- Word Error Rate (WER): 17.59%
- Position-Independent Word Error Rate (PER): 17.26%
As of May 14, 2025 PM (after fixing structural transfer bug with 'mah')
Line Evaluation Results
- Number of words in reference: 306
- Number of words in test: 297
- Number of unknown words in test: 0
- Percentage of unknown words: 0.00%
- Edit distance: 45
- Word Error Rate (WER): 14.71%
- Position-Independent Word Error Rate (PER): 13.07%
