Japhug and English/Structural Transfer
From LING073
Contents
Pre-Evaluation
Statistics About Input Files
Number of words in reference: 47 Number of words in test: 33 Number of unknown words (marked with a star) in test: 18 Percentage of unknown words: 54.55 %
Results when removing unknown-word marks (stars)
Edit distance: 47 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Coverage Test on jya.tests.txt in Bilingual Transducer
TOP UNKNOWN WORDS:
1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
1 ^ɲɯrganɯ/*ɲɯrganɯ$
1 ^ɲɤmtsɯr/*ɲɤmtsɯr$
1 ^ɯʑo/*ɯʑo$
1 ^ɯtaʁ/*ɯtaʁ$
1 ^ɯjme/*ɯjme$
1 ^ɕɤrɯ/*ɕɤrɯ$
1 ^xuexiao/*xuexiao$
1 ^tʂu/*tʂu$
1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
1 ^mɤpe/*mɤpe$
1 ^kɯkɯra/*kɯkɯra$
1 ^kɤzo/*kɤzo$
1 ^khramba/*khramba$
1 ^aʑo/*aʑo$
1 ^ambro/*ambro$
coverage: 24 / 42 (~0.57142857142857142857)
remaining unknown forms: 18
ambiguity: 54 / 42 (~1.28571428571428571429)
(JYA ‣ ENG) Transfer Evaluation
We implemented Contrastive Grammar #1: "For clauses with transitive verbs, in Japhug the object generally precedes the verb (and follows the subject). In English however the object follows the verb."
Example Sentence 1
lɯlu nɯ kɯ βʑɯ ɯɕa tɕi pjɤrga outputs #that #cat also #like #mouse #meat instead of the direct translation #cat that with #mouse #meat also #like.
Tagger Output
^lɯlu<n><ind>$ ^nɯ<det><dem><dist><sg>$ ^kɯ<post>$ ^βʑɯ<n><ind>$ ^ɕa<n><px3sg>$ ^tɕi<adv>$ ^rga<v><tv>$^.<sent>$
Lex Output
^lɯlu<n><ind>/cat<n><sg><ind>$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$ ^kɯ<post>/with<pr>$ ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$ ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$^.<sent>/.<sent>$
Transfer Output
Applying rule 10 (line 77): ^lɯlu<n><ind>/cat<n><sg><ind>$
Applying rule 12 (line 80): ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$}$
Applying rule 11 (line 79): ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$
Applying rule 13 (line 82): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$ ^kɯ<post>/with<pr>$
Applying output rule 12 (line 82): default<DP><erg> -> ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$ ^kɯ<post>/with<pr>$
Applying output rule 10 (line 79): default<dP><abs> -> ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$
No rule specified: ^that<det>$
Applying output rule 9 (line 77): default<NP> -> ^lɯlu<n><ind>/cat<n><sg><ind>$
No rule specified: ^cat<n><sg><ind>$
Applying rule 10 (line 77): ^βʑɯ<n><ind>/mouse<n><sg><ind>$
Applying rule 12 (line 80): ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$}$
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$}$}$
Applying rule 10 (line 77): ^ɕa<n><px3sg>/meat<n><sg><px3sg>$
Applying rule 12 (line 80): ^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$
Applying rule 3 (line 70): ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$
Applying rule 12 (line 80): ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$
Applying rule 15 (line 88): ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$
Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$
Applying rule 15 (line 88): ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$
Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$
Applying output rule 16 (line 91): default<S> -> ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$
Applying output rule 14 (line 88): default<vP> -> ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$
No rule specified: ^also<adv>$
No rule specified: ^like<vblex>$
Applying output rule 13 (line 83): default<DP><abs> -> ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$
Applying output rule 11 (line 80): default<dP><abs> -> ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$
Applying output rule 2 (line 70): default<NP> -> ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$
No rule specified: ^mouse<n><sg><ind>$
No rule specified: ^meat<n><sg><ind>$
No rule specified: ^.<sent>/.<sent>$
^that<det>$ ^cat<n><sg><ind>$ ^also<adv>$ ^like<vblex>$ ^mouse<n><sg><ind>$ ^meat<n><sg><ind>$^.<sent>$
JYA-ENG Output
#that #cat also #like #mouse #meat
Example Sentence 2
βzaŋsa tonɯpandʑi outputs #agree with #friend instead of the direct translation #friend #agree with.
Tagger Output
^βzaŋsa<n><ind>$ ^nɯpa<v><tv>$^.<sent>$
Lex Output
^βzaŋsa<n><ind>/friend<n><sg><ind>$ ^nɯpa<v><tv>/agree with<vblex>$^.<sent>/.<sent>$
Transfer Output
Applying rule 10 (line 77): ^βzaŋsa<n><ind>/friend<n><sg><ind>$
Applying rule 12 (line 80): ^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$
Applying rule 16 (line 89): ^nɯpa<v><tv>/agree with<vblex>$
Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$}$ ^default<vP>{^nɯpa<v><tv>/agree with<vblex>$}$
Applying output rule 16 (line 91): default<VP> -> ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$}$ ^default<vP>{^nɯpa<v><tv>/agree with<vblex>$}$
Applying output rule 15 (line 89): default<vP> -> ^nɯpa<v><tv>/agree with<vblex>$
No rule specified: ^agree with<vblex>$
Applying output rule 13 (line 83): default<DP><abs> -> ^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$
Applying output rule 11 (line 80): default<dP><abs> -> ^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$
Applying output rule 9 (line 77): default<NP> -> ^βzaŋsa<n><ind>/friend<n><sg><ind>$
No rule specified: ^friend<n><sg><ind>$
No rule specified: ^.<sent>/.<sent>$
^agree with<vblex>$ ^friend<n><sg><ind>$^.<sent>$
JYA-ENG Output
#agree with #friend
Our transfer rule successfully switched the object (friend) with the verb phrase (agree with).
Post-Evaluation
Statistics About Input Files
Number of words in reference: 47 Number of words in test: 33 Number of unknown words (marked with a star) in test: 18 Percentage of unknown words: 54.55 %
Results when removing unknown-word marks (stars)
Edit distance: 47 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Coverage Test on jya.tests.txt in Bilingual Transducer
