Difference between revisions of "Munsee/Final Project"

From LING073
Jump to: navigation, search
(→‎LaTeX tikz code)
(→‎Future Directions)
 
(41 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 +
== Project Focus ==
 +
Despite ongoing efforts to revitalize the Munsee language, relatively few pedagogical resources are readily available to the public. Our tool aims to support a crucial step in the learning of this language: the translation of the grammatically complex verbs in Munsee to English, a language likely to be spoken by learners of Munsee.
  
−
\begin{tikzpicture}
+
== Approach ==
−
\begin{scope}[frontier/.style={distance from root=150pt}]
+
# We first generated a parallel corpus of verb phrases in Munsee and English.
−
\Tree
+
# We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
−
[.S
+
## New twol rules for VTIs that take nouns objects
−
[.DP [.prn \node[align=center](I1){\texttt{prpers<prn><subj><p1><mf><sg>}\\I};] ]
+
## ''Many'' more twol rules for specific verbs conjugations (accounting for accent shifts, instances of metathesis, contractions, etc.)
−
[.VP
+
# We then created syntax trees to model the breakdown of various verb phrases.
−
[.vP
+
## Structural transfer rules were developed by tracking tags backwards up the trees
−
[.AuxP
+
## Attributes currently being tracked:
−
[.vbdo \node[align=center](did1){\texttt{do<vbdo><past>}\\did}; ]
+
### Transitivity
−
[.adv \node[align=center](not1){\texttt{not<adv>}\\not}; ]
+
#### Subject
−
]
+
#### Object
−
[.v \node[align=center](notice){\texttt{notice<v><tv><inf>}\\notice}; ]
+
### Animacy
−
]
+
### Number
−
[.DP
+
### Polarity
−
[.det \node[align=center](the){\texttt{the<det><def><sp>}\\the}; ]
+
### Gender (for simplicity, we default to 'he' for third person)
−
[.NP
+
# We implemented structural transfer rules for translation from Munsee to English.
−
[.n \node[align=center](cacti){\texttt{cactus<n><pl>}\\cacti}; ]
+
## Issues resolved after presentation on 5/9/25:
−
]
+
### Implemented "it" objects (applicable to transitive verbs)
−
]
+
### Implemented subject tracking for transitive verbs
−
]
+
# Finally, we evaluated our output (see evaluation section below)
−
]
 
−
\end{scope}
 
−
\begin{scope}[xshift=-2pt,yshift=-5.5in,grow'=up,
 
−
frontier/.style={distance from root=150pt}]
 
−
\Tree
 
−
[.S
 
−
[.DP [.prn \node[align=center](men1){мен\\\texttt{мен\tag{prn><pers><p1><sg}}};] ]
 
−
[.VP
 
−
[.DP [.NP
 
−
[.n \node[align=center](kaktustardy){кактустарды\\\texttt{кактус<n><pl><acc>}}; ]
 
−
] ]
 
−
[.vP
 
−
[.v \node[align=center](bayqaganemesmin){байкаган эмесмин\\\texttt{байка<v><tv><neg><past><p1><sg>}}; ]
 
−
]
 
−
]
 
−
]
 
−
\end{scope}
 
−
\begin{scope}[dashed]
 
−
\draw (I1)--(men1);
 
−
\draw (did1)--(bayqaganemesmin);
 
−
\draw (not1)--(bayqaganemesmin);
 
−
\draw (notice)--(bayqaganemesmin);
 
−
\draw (the)--(kaktustardy);
 
−
\draw (cacti)--(kaktustardy);
 
−
\end{scope}
 
−
\end{tikzpicture}
 
  
 +
== Future Directions ==
 +
* Further investigate structural transfer rules regarding the "do" form in the negative
 +
* Develop  structural transfer rules so third person subjects (e.g. names) replace third person pronouns
 +
* Develop  structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock')
 +
* There is currently a bug in the structural transfer module; once this is resolved, the negative with 'mah' can be re-implemented
 +
* Systematize differences between stable and unstable verb stems
 +
** This will require work on both .lexd and .twol files
 +
* Implement future 'tense' with modal word 'uch'
  
 +
== Relevant Links ==
 +
* [https://github.com/kmbecker40/apertium-umu Munsee Transducer Repository]
 +
* [https://github.com/kmbecker40/apertium-eng Repository for English Transducer]
 +
* [https://github.com/kmbecker40/apertium-umu-eng Repository for Munsee-English Language Pair] (includes test files)
 +
* [https://github.swarthmore.edu/Ling073-sp25/ling073-umu-corpus Munsee Corpus Repository]
 +
 +
== Evaluation ==
 +
===''As of May 8, 2025''===
 +
 +
Line Evaluation Results
 +
* Number of words in reference: 175
 +
* Number of words in test: 82
 +
* Number of unknown words in test: 50
 +
* Percentage of unknown words: 60.98%
 +
* '''Word Error Rate (WER)''': 97.14%
 +
* '''Position-Independent Word Error Rate (PER)''': 97.14%
 +
 +
===''As of May 14, 2025 AM''===
 +
 +
Line Evaluation Results
 +
* Number of words in reference: 307
 +
* Number of words in test: 282
 +
* Number of unknown words in test: 0
 +
* Percentage of unknown words: 0.00%
 +
* Edit distance: 52
 +
* '''Word Error Rate (WER)''': 17.59%
 +
* '''Position-Independent Word Error Rate (PER)''': 17.26%
 +
 +
===''As of May 14, 2025 PM (after fixing structural transfer bug with 'mah')''===
 +
 +
Line Evaluation Results
 +
* Number of words in reference: 306
 +
* Number of words in test: 297
 +
* Number of unknown words in test: 0
 +
* Percentage of unknown words: 0.00%
 +
* Edit distance: 45
 +
* '''Word Error Rate (WER)''': 14.71%
 +
* '''Position-Independent Word Error Rate (PER)''': 13.07%
  
 
[[Category:Munsee]]
 
[[Category:Munsee]]
 
[[Category:English]]
 
[[Category:English]]
 +
[[Category:sp25_FinalProjects]]

Latest revision as of 17:58, 14 May 2025

Project Focus

Despite ongoing efforts to revitalize the Munsee language, relatively few pedagogical resources are readily available to the public. Our tool aims to support a crucial step in the learning of this language: the translation of the grammatically complex verbs in Munsee to English, a language likely to be spoken by learners of Munsee.

Approach

  1. We first generated a parallel corpus of verb phrases in Munsee and English.
  2. We added verb stems to our bilingual dictionary (.dix) and monolingual transducer (.lexd), creating twol rules as necessary.
    1. New twol rules for VTIs that take nouns objects
    2. Many more twol rules for specific verbs conjugations (accounting for accent shifts, instances of metathesis, contractions, etc.)
  3. We then created syntax trees to model the breakdown of various verb phrases.
    1. Structural transfer rules were developed by tracking tags backwards up the trees
    2. Attributes currently being tracked:
      1. Transitivity
        1. Subject
        2. Object
      2. Animacy
      3. Number
      4. Polarity
      5. Gender (for simplicity, we default to 'he' for third person)
  4. We implemented structural transfer rules for translation from Munsee to English.
    1. Issues resolved after presentation on 5/9/25:
      1. Implemented "it" objects (applicable to transitive verbs)
      2. Implemented subject tracking for transitive verbs
  5. Finally, we evaluated our output (see evaluation section below)

Future Directions

  • Further investigate structural transfer rules regarding the "do" form in the negative
  • Develop structural transfer rules so third person subjects (e.g. names) replace third person pronouns
  • Develop structural transfer rules so that noun objects take the correct article/determiner (e.g. 'a rock' instead of 'rock')
  • There is currently a bug in the structural transfer module; once this is resolved, the negative with 'mah' can be re-implemented
  • Systematize differences between stable and unstable verb stems
    • This will require work on both .lexd and .twol files
  • Implement future 'tense' with modal word 'uch'

Relevant Links

Evaluation

As of May 8, 2025

Line Evaluation Results

  • Number of words in reference: 175
  • Number of words in test: 82
  • Number of unknown words in test: 50
  • Percentage of unknown words: 60.98%
  • Word Error Rate (WER): 97.14%
  • Position-Independent Word Error Rate (PER): 97.14%

As of May 14, 2025 AM

Line Evaluation Results

  • Number of words in reference: 307
  • Number of words in test: 282
  • Number of unknown words in test: 0
  • Percentage of unknown words: 0.00%
  • Edit distance: 52
  • Word Error Rate (WER): 17.59%
  • Position-Independent Word Error Rate (PER): 17.26%

As of May 14, 2025 PM (after fixing structural transfer bug with 'mah')

Line Evaluation Results

  • Number of words in reference: 306
  • Number of words in test: 297
  • Number of unknown words in test: 0
  • Percentage of unknown words: 0.00%
  • Edit distance: 45
  • Word Error Rate (WER): 14.71%
  • Position-Independent Word Error Rate (PER): 13.07%
Retrieved from "http://wikis.swarthmore.edu/ling073/index.php?title=Munsee/Final_Project&oldid=26265"