Difference between revisions of "Walloon and English"
From LING073
(→Sentences) |
|||
| (15 intermediate revisions by the same user not shown) | |||
| Line 7: | Line 7: | ||
* Walloon Transducer: [https://github.swarthmore.edu/Ling073-sp25/ling073-wln] | * Walloon Transducer: [https://github.swarthmore.edu/Ling073-sp25/ling073-wln] | ||
* English Transducer: [https://github.swarthmore.edu/rgoel1/apertium-eng] | * English Transducer: [https://github.swarthmore.edu/rgoel1/apertium-eng] | ||
| + | * Corpus: [https://github.swarthmore.edu/Ling073-sp25/ling073-wln-corpus] | ||
==Walloon (wln) → English (eng) Evaluation== | ==Walloon (wln) → English (eng) Evaluation== | ||
===Coverage=== | ===Coverage=== | ||
| − | * Monolingual Transducer Coverage: | + | * Monolingual Transducer Coverage: 84 / 86 (~0.97674418604651162791) |
| − | * Bilingual Transducer Coverage: | + | * Bilingual Transducer Coverage: 84 / 86 (~0.97674418604651162791) |
===Sentences=== | ===Sentences=== | ||
* (1) wln: "Cwand i l' voeya, Zacariye fourit tot troublé et i hapa sogne." | * (1) wln: "Cwand i l' voeya, Zacariye fourit tot troublé et i hapa sogne." | ||
** eng: "When Zechariah saw him, he was startled and was gripped with fear." | ** eng: "When Zechariah saw him, he was startled and was gripped with fear." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Cwand<cnjsub>/When<cnjsub>$ ^i<prn><pers><p3><sg>/he<prn><pers><p3><sg>$ ^l'<prn><pers><p3>/him<prn><pers><p3>$ ^voeyér<v><past><p3><sg>/see<v><past><p3><sg>$, ^Zacariye<np><ant><m><sg>/Zechariah<np><ant><sg>$ ^fourî<v><past><p3><sg>/be<v><past><p3><sg>$ ^tot<adv>/all<adv>$ ^troublé<adj><m><sg>/startled<adj><sg>$ ^et<cnjcoo>/and<cnjcoo>$ ^i<prn><pers><p3><sg>/he<prn><pers><p3><sg>$ ^hapar<v><pret><p3><sg>/grip<v><pret><p3><sg>$ ^sogne<n><f><n><m><sg>/fear<n><n><m><sg>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>When #he #him #see, Zechariah #be all #startled and #he #grip #fear.</pre> |
* (2) wln: "Vosse feme Elizabet vos dinrè on fi, ki vs lomroz Djhan." | * (2) wln: "Vosse feme Elizabet vos dinrè on fi, ki vs lomroz Djhan." | ||
** eng: "Your wife Elizabeth will bear you a son, and you are to call him John." | ** eng: "Your wife Elizabeth will bear you a son, and you are to call him John." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Vosse<det><poss><p2><pl>/Your<det><pos><p2><pl>$ ^feme<n><f><n><m><sg>/wife<n><n><m><sg>$ ^Elizabet<np><ant><f><sg>/Elizabeth<np><ant><sg>$ ^vos<prn><p2><pl>/you<prn><p2><pl>$ ^dinrer<v><fut><p1><sg>/give<v><fut><p1><sg>$ ^on<det><ind><m><sg>/a<det><ind><sg>$ ^fi<n><m><sg>/son<n><sg>$, ^ki<prn><rel>/whom<prn><rel>$ ^vs<prn><p2><pl>/you<prn><p2><pl>$ ^lomrer<v><fut><p2><pl>/call<v><fut><p2><pl>$ ^Djhan<np><ant><m><sg>/John<np><ant><sg>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>#Your #wife Elizabeth #you #give a son, #whom #you #call John.</pre> |
* (3) wln: "Djezus houke sès prumîs dissipes." | * (3) wln: "Djezus houke sès prumîs dissipes." | ||
** eng: "Jesus calls his first disciples." | ** eng: "Jesus calls his first disciples." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Djezus<np><ant><m><sg>/Jesus<np><ant><sg>$ ^houker<v><pres><p3><sg>/call<v><pres><p3><sg>$ ^sès<det><poss><p3><pl>/his<det><pos><p3><pl>$ ^prumîs<adj><m><sg>/first<adj><sg>$ ^dissipe<n><m><pl>/disciple<n><pl>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>Jesus #call #his #first disciples.</pre> |
* (4) wln: "I ramoennrè bråmint des efants d' Israyel viè l' Diu, leu Signeur." | * (4) wln: "I ramoennrè bråmint des efants d' Israyel viè l' Diu, leu Signeur." | ||
** eng: "He will bring back many of the people of Israel to the Lord their God." | ** eng: "He will bring back many of the people of Israel to the Lord their God." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^I<prn><pers><p3><sg>/He<prn><pers><p3><sg>$ ^ramoenner<v><fut><p1><sg>/bring<v><fut><p1><sg>$ ^bråmint<adv><qnt>/many<adj><qnt>$ ^des<det><ind><pl>/of the<det><ind><pl>$ ^efant<n><m><pl>/people<n><pl>$ ^d'<pr>/of<pr>$ ^Israyel<np><ant><m><sg>/Israel<np><sg>$ ^viè<pr>/to<pr>$ ^l'<prn><pers><p3>/him<prn><pers><p3>$ ^Diu<n><m><sg>/God<np><sg>$, ^leu<det><poss><p3><pl>/their<det><pos><p3><pl>$ ^Signeur<np>/Lord<np>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>#He #bring #many #of the peoples of #Israel to #him #God, #their #Lord.</pre> |
* (5) wln: "Djezus passéve djondant dèl mér du Galilèye." | * (5) wln: "Djezus passéve djondant dèl mér du Galilèye." | ||
** eng: "Jesus was walking beside the sea of Galilee." | ** eng: "Jesus was walking beside the sea of Galilee." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Djezus<np><ant><m><sg>/Jesus<np><ant><sg>$ ^passéver<v><pres><p3><sg>/walk<v><pres><p3><sg>$ ^djondant<pr>/beside<pr>$ ^dèl<pr>/of<pr>$ ^mér<n><m><sg>/sea<n><m><sg>$ ^du<pr>/of<pr>$ ^Galilèye<np>/Galilee<np>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>Jesus #walk beside of #sea of #Galilee.</pre> |
* (6) wln: "Cwand s' tins d' siervice fourit houte, i ndè rala e s' måjhon." | * (6) wln: "Cwand s' tins d' siervice fourit houte, i ndè rala e s' måjhon." | ||
** eng: "When his time of service was completed, he returned home." | ** eng: "When his time of service was completed, he returned home." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Cwand<cnjsub>/When<cnjsub>$ ^*s/*s$' ^tin<n><m><pl>/time<n><pl>$ ^d'<pr>/of<pr>$ ^siervice<n><m><sg>/service<n><sg>$ ^fourî<v><past><p3><sg>/be<v><past><p3><sg>$ ^houter<v><pres><p3><sg>/complete<v><pres><p3><sg>$, ^i<prn><pers><p3><sg>/he<prn><pers><p3><sg>$ ^ndè<adv>/thence<adv>$ ^ralar<v><past><p3><sg>/return<v><past><p3><sg>$ ^e<pr>/to<pr>/home<adv>$ ^*s/*s$' ^måjhon<n><f><n><m><sg>/house<n><n><m><sg>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>When *s' times of service #be #complete, #he thence #return to *s' #house.</pre> |
* (7) wln: "Sol côp, Djezus lès houka." | * (7) wln: "Sol côp, Djezus lès houka." | ||
** eng: "At once, Jesus called them." | ** eng: "At once, Jesus called them." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Sol<pr>/On<pr>$ ^côp<n><m><sg>/once<adv><sg>/moment<n><sg>$, ^Djezus<np><ant><m><sg>/Jesus<np><ant><sg>$ ^lès<prn><pers><p3><pl>/them<prn><pers><p3><pl>$ ^houker<v><past><p3><sg>/call<v><past><p3><sg>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>On #once, Jesus #them #call.</pre> |
* (8) wln: "Po cmincî, l' Univers fourit fait." | * (8) wln: "Po cmincî, l' Univers fourit fait." | ||
** eng: "In the beginning the Universe was created." | ** eng: "In the beginning the Universe was created." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Po<pr>/To<pr>$ ^cmincî<v><inf>/begin<v><inf>$, ^l'<prn><pers><p3>/him<prn><pers><p3>$ ^Univers<np>/Universe<np>$ ^fourî<v><past><p3><sg>/be<v><past><p3><sg>$ ^fait<v><pp>/create<v><pp>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>To #begin, #him #Universe #be #create.</pre> |
* (9) wln: "Dijhans todi kéke feye." | * (9) wln: "Dijhans todi kéke feye." | ||
** eng: "Or so it would seem." | ** eng: "Or so it would seem." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Dijher<v><pres><p1><pl>/Say<v><pres><p1><pl>$ ^todi<adv>/always<adv>$ ^kéke<det><ind><sg>/some<det><ind><sg>$ ^feye<n><f><n><m><sg>/time<n><n><m><sg>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>#Say always #some #time.</pre> |
* (10) wln: "Deus des droles di sakîs ås airs di mårticots ont sorviké." | * (10) wln: "Deus des droles di sakîs ås airs di mårticots ont sorviké." | ||
** eng: "Two of these strange, ape-like creatures survived." | ** eng: "Two of these strange, ape-like creatures survived." | ||
| − | ** lexical transfer output: | + | ** lexical transfer output: <pre>^Deus<num><m><pl><num>/Two<num><pl><num>$ ^des<det><ind><pl>/of the<det><ind><pl>$ ^drole<adj><m><pl>/strange<adj><pl>$ ^di<pr>/of<pr>$ ^sakî<n><m><pl>/creature<n><pl>$ ^ås<pr><def>/with<pr>$ ^air<n><m><pl>/air<n><pl>$ ^di<pr>/of<pr>$ ^mårticot<n><m><pl>/ape<n><pl>$ ^ont<v><pres><p3><pl>/have<v><pres><p3><pl>$ ^sorviké<v><pp>/survive<v><pp>$.</pre> |
| − | ** full translation output: | + | ** full translation output: <pre>#Two #of the #strange of creatures with airs of apes #have #survive.</pre> |
| + | |||
| + | ==Additions== | ||
| + | * Added 2 structural transfer rules | ||
| + | * Added 3 disambiguation rules | ||
| + | ** if a possessive clitic is immediately followed by noun or adjective, delete the pronoun reading so only possessive determiner remains | ||
| + | ** if that clitic is immediately followed by a finite verb, delete determiner reading so it's kept as a personal pronoun | ||
| + | ** when a preposition precedes clitic, again delete the pronoun reading (so it behaves as a determiner inside noun phrase that follows preposition) | ||
| + | * Added 2 lexical selection rules | ||
| + | ** for preposition po, when an infinitive verb follows, choose the English translation "to" rather than other senses | ||
| + | ** for preposition di, when immediately followed by a noun, select the English translation "of" (overriding "from") | ||
| + | |||
| + | ==Final Evaluation== | ||
| + | * Monolingual | ||
| + | ** Precision: 91.42% | ||
| + | ** Recall: 30.6% (missing stems, focused predominantly on rules) | ||
| + | ** Coverage (over wln.corpus.large.txt): 32.38% (5214 / 16103 tokens) | ||
| + | ** Words in wln.corpus.large.txt: 16,115 | ||
| + | ** Stem Count: 131 | ||
| + | * MT (Walloon -> English) | ||
| + | ** WER (*.longer.txt): 45.65% | ||
| + | ** PER (*.longer.txt): 36.96% | ||
| + | ** Correctly Translated Stems (*.longer.txt): 46/46 | ||
| + | ** Trimmed Coverage | ||
| + | *** (*.longer.txt): 100% | ||
| + | *** (*.large.txt): 25.04% | ||
| + | ** Number of Tokens | ||
| + | *** (*.longer.txt): 130 | ||
| + | *** (*.large.txt): 16,115 | ||
| + | |||
[[Category:Walloon]] | [[Category:Walloon]] | ||
| + | [[Category:English]] | ||
[[Category:Sp25_TranslationPairs]] | [[Category:Sp25_TranslationPairs]] | ||
Latest revision as of 22:28, 15 May 2025
Contents
Resources developed for Walloon
- Resourced developed for Walloon
External resources
Walloon (wln) → English (eng) Evaluation
Coverage
- Monolingual Transducer Coverage: 84 / 86 (~0.97674418604651162791)
- Bilingual Transducer Coverage: 84 / 86 (~0.97674418604651162791)
Sentences
- (1) wln: "Cwand i l' voeya, Zacariye fourit tot troublé et i hapa sogne."
- eng: "When Zechariah saw him, he was startled and was gripped with fear."
- lexical transfer output:
^Cwand<cnjsub>/When<cnjsub>$ ^i<prn><pers><p3><sg>/he<prn><pers><p3><sg>$ ^l'<prn><pers><p3>/him<prn><pers><p3>$ ^voeyér<v><past><p3><sg>/see<v><past><p3><sg>$, ^Zacariye<np><ant><m><sg>/Zechariah<np><ant><sg>$ ^fourî<v><past><p3><sg>/be<v><past><p3><sg>$ ^tot<adv>/all<adv>$ ^troublé<adj><m><sg>/startled<adj><sg>$ ^et<cnjcoo>/and<cnjcoo>$ ^i<prn><pers><p3><sg>/he<prn><pers><p3><sg>$ ^hapar<v><pret><p3><sg>/grip<v><pret><p3><sg>$ ^sogne<n><f><n><m><sg>/fear<n><n><m><sg>$.
- full translation output:
When #he #him #see, Zechariah #be all #startled and #he #grip #fear.
- (2) wln: "Vosse feme Elizabet vos dinrè on fi, ki vs lomroz Djhan."
- eng: "Your wife Elizabeth will bear you a son, and you are to call him John."
- lexical transfer output:
^Vosse<det><poss><p2><pl>/Your<det><pos><p2><pl>$ ^feme<n><f><n><m><sg>/wife<n><n><m><sg>$ ^Elizabet<np><ant><f><sg>/Elizabeth<np><ant><sg>$ ^vos<prn><p2><pl>/you<prn><p2><pl>$ ^dinrer<v><fut><p1><sg>/give<v><fut><p1><sg>$ ^on<det><ind><m><sg>/a<det><ind><sg>$ ^fi<n><m><sg>/son<n><sg>$, ^ki<prn><rel>/whom<prn><rel>$ ^vs<prn><p2><pl>/you<prn><p2><pl>$ ^lomrer<v><fut><p2><pl>/call<v><fut><p2><pl>$ ^Djhan<np><ant><m><sg>/John<np><ant><sg>$.
- full translation output:
#Your #wife Elizabeth #you #give a son, #whom #you #call John.
- (3) wln: "Djezus houke sès prumîs dissipes."
- eng: "Jesus calls his first disciples."
- lexical transfer output:
^Djezus<np><ant><m><sg>/Jesus<np><ant><sg>$ ^houker<v><pres><p3><sg>/call<v><pres><p3><sg>$ ^sès<det><poss><p3><pl>/his<det><pos><p3><pl>$ ^prumîs<adj><m><sg>/first<adj><sg>$ ^dissipe<n><m><pl>/disciple<n><pl>$.
- full translation output:
Jesus #call #his #first disciples.
- (4) wln: "I ramoennrè bråmint des efants d' Israyel viè l' Diu, leu Signeur."
- eng: "He will bring back many of the people of Israel to the Lord their God."
- lexical transfer output:
^I<prn><pers><p3><sg>/He<prn><pers><p3><sg>$ ^ramoenner<v><fut><p1><sg>/bring<v><fut><p1><sg>$ ^bråmint<adv><qnt>/many<adj><qnt>$ ^des<det><ind><pl>/of the<det><ind><pl>$ ^efant<n><m><pl>/people<n><pl>$ ^d'<pr>/of<pr>$ ^Israyel<np><ant><m><sg>/Israel<np><sg>$ ^viè<pr>/to<pr>$ ^l'<prn><pers><p3>/him<prn><pers><p3>$ ^Diu<n><m><sg>/God<np><sg>$, ^leu<det><poss><p3><pl>/their<det><pos><p3><pl>$ ^Signeur<np>/Lord<np>$.
- full translation output:
#He #bring #many #of the peoples of #Israel to #him #God, #their #Lord.
- (5) wln: "Djezus passéve djondant dèl mér du Galilèye."
- eng: "Jesus was walking beside the sea of Galilee."
- lexical transfer output:
^Djezus<np><ant><m><sg>/Jesus<np><ant><sg>$ ^passéver<v><pres><p3><sg>/walk<v><pres><p3><sg>$ ^djondant<pr>/beside<pr>$ ^dèl<pr>/of<pr>$ ^mér<n><m><sg>/sea<n><m><sg>$ ^du<pr>/of<pr>$ ^Galilèye<np>/Galilee<np>$.
- full translation output:
Jesus #walk beside of #sea of #Galilee.
- (6) wln: "Cwand s' tins d' siervice fourit houte, i ndè rala e s' måjhon."
- eng: "When his time of service was completed, he returned home."
- lexical transfer output:
^Cwand<cnjsub>/When<cnjsub>$ ^*s/*s$' ^tin<n><m><pl>/time<n><pl>$ ^d'<pr>/of<pr>$ ^siervice<n><m><sg>/service<n><sg>$ ^fourî<v><past><p3><sg>/be<v><past><p3><sg>$ ^houter<v><pres><p3><sg>/complete<v><pres><p3><sg>$, ^i<prn><pers><p3><sg>/he<prn><pers><p3><sg>$ ^ndè<adv>/thence<adv>$ ^ralar<v><past><p3><sg>/return<v><past><p3><sg>$ ^e<pr>/to<pr>/home<adv>$ ^*s/*s$' ^måjhon<n><f><n><m><sg>/house<n><n><m><sg>$.
- full translation output:
When *s' times of service #be #complete, #he thence #return to *s' #house.
- (7) wln: "Sol côp, Djezus lès houka."
- eng: "At once, Jesus called them."
- lexical transfer output:
^Sol<pr>/On<pr>$ ^côp<n><m><sg>/once<adv><sg>/moment<n><sg>$, ^Djezus<np><ant><m><sg>/Jesus<np><ant><sg>$ ^lès<prn><pers><p3><pl>/them<prn><pers><p3><pl>$ ^houker<v><past><p3><sg>/call<v><past><p3><sg>$.
- full translation output:
On #once, Jesus #them #call.
- (8) wln: "Po cmincî, l' Univers fourit fait."
- eng: "In the beginning the Universe was created."
- lexical transfer output:
^Po<pr>/To<pr>$ ^cmincî<v><inf>/begin<v><inf>$, ^l'<prn><pers><p3>/him<prn><pers><p3>$ ^Univers<np>/Universe<np>$ ^fourî<v><past><p3><sg>/be<v><past><p3><sg>$ ^fait<v><pp>/create<v><pp>$.
- full translation output:
To #begin, #him #Universe #be #create.
- (9) wln: "Dijhans todi kéke feye."
- eng: "Or so it would seem."
- lexical transfer output:
^Dijher<v><pres><p1><pl>/Say<v><pres><p1><pl>$ ^todi<adv>/always<adv>$ ^kéke<det><ind><sg>/some<det><ind><sg>$ ^feye<n><f><n><m><sg>/time<n><n><m><sg>$.
- full translation output:
#Say always #some #time.
- (10) wln: "Deus des droles di sakîs ås airs di mårticots ont sorviké."
- eng: "Two of these strange, ape-like creatures survived."
- lexical transfer output:
^Deus<num><m><pl><num>/Two<num><pl><num>$ ^des<det><ind><pl>/of the<det><ind><pl>$ ^drole<adj><m><pl>/strange<adj><pl>$ ^di<pr>/of<pr>$ ^sakî<n><m><pl>/creature<n><pl>$ ^ås<pr><def>/with<pr>$ ^air<n><m><pl>/air<n><pl>$ ^di<pr>/of<pr>$ ^mårticot<n><m><pl>/ape<n><pl>$ ^ont<v><pres><p3><pl>/have<v><pres><p3><pl>$ ^sorviké<v><pp>/survive<v><pp>$.
- full translation output:
#Two #of the #strange of creatures with airs of apes #have #survive.
Additions
- Added 2 structural transfer rules
- Added 3 disambiguation rules
- if a possessive clitic is immediately followed by noun or adjective, delete the pronoun reading so only possessive determiner remains
- if that clitic is immediately followed by a finite verb, delete determiner reading so it's kept as a personal pronoun
- when a preposition precedes clitic, again delete the pronoun reading (so it behaves as a determiner inside noun phrase that follows preposition)
- Added 2 lexical selection rules
- for preposition po, when an infinitive verb follows, choose the English translation "to" rather than other senses
- for preposition di, when immediately followed by a noun, select the English translation "of" (overriding "from")
Final Evaluation
- Monolingual
- Precision: 91.42%
- Recall: 30.6% (missing stems, focused predominantly on rules)
- Coverage (over wln.corpus.large.txt): 32.38% (5214 / 16103 tokens)
- Words in wln.corpus.large.txt: 16,115
- Stem Count: 131
- MT (Walloon -> English)
- WER (*.longer.txt): 45.65%
- PER (*.longer.txt): 36.96%
- Correctly Translated Stems (*.longer.txt): 46/46
- Trimmed Coverage
- (*.longer.txt): 100%
- (*.large.txt): 25.04%
- Number of Tokens
- (*.longer.txt): 130
- (*.large.txt): 16,115
