Difference between revisions of "Japhug and English/Structural Transfer"

From LING073
Jump to: navigation, search
(→‎Post-Evaluation)
(→‎Post-Evaluation)
 
(21 intermediate revisions by the same user not shown)
Line 6: Line 6:
  
 
<pre>
 
<pre>
−
Initial WER: 100%
 
−
Initial PER: 100%
 
−
-------------------------------------------------------
 
 
Number of words in reference: 47
 
Number of words in reference: 47
 
Number of words in test: 33
 
Number of words in test: 33
 
Number of unknown words (marked with a star) in test: 18
 
Number of unknown words (marked with a star) in test: 18
 
Percentage of unknown words: 54.55 %
 
Percentage of unknown words: 54.55 %
−
-------------------------------------------------------
 
 
</pre>
 
</pre>
 +
 +
'''Results when removing unknown-word marks (stars)'''
 +
 +
<pre>
 +
Edit distance: 47
 +
Word error rate (WER): 100.00 %
 +
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
</pre>
 +
 +
'''Coverage Test on jya.tests.txt in Bilingual Transducer'''
 +
<pre>
 +
TOP UNKNOWN WORDS:
 +
      1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
 +
      1 ^ɲɯrganɯ/*ɲɯrganɯ$
 +
      1 ^ɲɤmtsɯr/*ɲɤmtsɯr$
 +
      1 ^ɯʑo/*ɯʑo$
 +
      1 ^ɯtaʁ/*ɯtaʁ$
 +
      1 ^ɯjme/*ɯjme$
 +
      1 ^ɕɤrɯ/*ɕɤrɯ$
 +
      1 ^xuexiao/*xuexiao$
 +
      1 ^tʂu/*tʂu$
 +
      1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
 +
      1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
 +
      1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
 +
      1 ^mɤpe/*mɤpe$
 +
      1 ^kɯkɯra/*kɯkɯra$
 +
      1 ^kɤzo/*kɤzo$
 +
      1 ^khramba/*khramba$
 +
      1 ^aʑo/*aʑo$
 +
      1 ^ambro/*ambro$
 +
coverage: 24 / 42 (~0.57142857142857142857)
 +
remaining unknown forms: 18
 +
ambiguity: 54 / 42 (~1.28571428571428571429)
 +
</pre>
 +
 +
= (JYA ‣ ENG) Transfer Evaluation =
 +
 +
We implemented [https://wikis.swarthmore.edu/ling073/Japhug_and_English/ContrastiveGrammars Contrastive Grammar] #1: "For clauses with transitive verbs, in Japhug the object generally precedes the verb (and follows the subject). In English however the object follows the verb."
 +
 +
 +
=== Example Sentence 1 ===
 +
 +
'''lɯlu nɯ kɯ βʑɯ ɯɕa tɕi pjɤrga''' outputs '''#that #cat also #like #mouse #meat''' instead of the direct translation #cat that with #mouse #meat also #like.
 +
 +
===== Tagger Output =====
 +
<pre>
 +
^lɯlu<n><ind>$ ^nɯ<det><dem><dist><sg>$ ^kɯ<post>$ ^βʑɯ<n><ind>$ ^ɕa<n><px3sg>$ ^tɕi<adv>$ ^rga<v><tv>$^.<sent>$
 +
</pre>
 +
===== Lex Output =====
 +
<pre>
 +
^lɯlu<n><ind>/cat<n><sg><ind>$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$ ^kɯ<post>/with<pr>$ ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$ ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$^.<sent>/.<sent>$
 +
</pre>
 +
===== Transfer Output =====
 +
<pre>
 +
Applying rule 10 (line 77): ^lɯlu<n><ind>/cat<n><sg><ind>$
 +
 +
Applying rule 12 (line 80): ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$
 +
 +
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$}$
 +
 +
Applying rule 11 (line 79): ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$
 +
 +
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$
 +
 +
Applying rule 13 (line 82): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$ ^kɯ<post>/with<pr>$
 +
 +
Applying output rule 12 (line 82): default<DP><erg> -> ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$ ^kɯ<post>/with<pr>$
 +
 +
Applying output rule 10 (line 79): default<dP><abs> -> ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$
 +
 +
No rule specified: ^that<det>$
 +
 +
Applying output rule 9 (line 77): default<NP> -> ^lɯlu<n><ind>/cat<n><sg><ind>$
 +
 +
No rule specified: ^cat<n><sg><ind>$
 +
 +
Applying rule 10 (line 77): ^βʑɯ<n><ind>/mouse<n><sg><ind>$
 +
 +
Applying rule 12 (line 80): ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$}$
 +
 +
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$}$}$
 +
 +
Applying rule 10 (line 77): ^ɕa<n><px3sg>/meat<n><sg><px3sg>$
 +
 +
Applying rule 12 (line 80): ^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$
 +
 +
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$
 +
 +
Applying rule 3 (line 70): ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$
 +
 +
Applying rule 12 (line 80): ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$
 +
 +
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$
 +
 +
Applying rule 15 (line 88): ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$
 +
 +
Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$
 +
 +
Applying rule 15 (line 88): ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$
 +
 +
Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$
 +
 +
Applying output rule 16 (line 91): default<S> -> ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$
 +
 +
Applying output rule 14 (line 88): default<vP> -> ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$
 +
 +
No rule specified: ^also<adv>$
 +
 +
No rule specified: ^like<vblex>$
 +
 +
Applying output rule 13 (line 83): default<DP><abs> -> ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$
 +
 +
Applying output rule 11 (line 80): default<dP><abs> -> ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$
 +
 +
Applying output rule 2 (line 70): default<NP> -> ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$
 +
 +
No rule specified: ^mouse<n><sg><ind>$
 +
 +
No rule specified: ^meat<n><sg><ind>$
 +
 +
No rule specified: ^.<sent>/.<sent>$
 +
^that<det>$ ^cat<n><sg><ind>$ ^also<adv>$ ^like<vblex>$ ^mouse<n><sg><ind>$ ^meat<n><sg><ind>$^.<sent>$
 +
</pre>
 +
===== JYA-ENG Output =====
 +
<pre>
 +
#that #cat also #like #mouse #meat
 +
</pre>
 +
 +
=== Example Sentence 2 ===
 +
 +
'''βzaŋsa tonɯpandʑi''' outputs '''#agree with #friend''' instead of the direct translation #friend #agree with.
 +
 +
===== Tagger Output =====
 +
<pre>
 +
^βzaŋsa<n><ind>$ ^nɯpa<v><tv>$^.<sent>$
 +
</pre>
 +
===== Lex Output =====
 +
<pre>
 +
^βzaŋsa<n><ind>/friend<n><sg><ind>$ ^nɯpa<v><tv>/agree with<vblex>$^.<sent>/.<sent>$
 +
</pre>
 +
===== Transfer Output =====
 +
<pre>
 +
Applying rule 10 (line 77): ^βzaŋsa<n><ind>/friend<n><sg><ind>$
 +
 +
Applying rule 12 (line 80): ^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$
 +
 +
Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$
 +
 +
Applying rule 16 (line 89): ^nɯpa<v><tv>/agree with<vblex>$
 +
 +
Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$}$ ^default<vP>{^nɯpa<v><tv>/agree with<vblex>$}$
 +
 +
Applying output rule 16 (line 91): default<VP> -> ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$}$ ^default<vP>{^nɯpa<v><tv>/agree with<vblex>$}$
 +
 +
Applying output rule 15 (line 89): default<vP> -> ^nɯpa<v><tv>/agree with<vblex>$
 +
 +
No rule specified: ^agree with<vblex>$
 +
 +
Applying output rule 13 (line 83): default<DP><abs> -> ^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$
 +
 +
Applying output rule 11 (line 80): default<dP><abs> -> ^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$
 +
 +
Applying output rule 9 (line 77): default<NP> -> ^βzaŋsa<n><ind>/friend<n><sg><ind>$
 +
 +
No rule specified: ^friend<n><sg><ind>$
 +
 +
No rule specified: ^.<sent>/.<sent>$
 +
^agree with<vblex>$ ^friend<n><sg><ind>$^.<sent>$
 +
</pre>
 +
===== JYA-ENG Output =====
 +
<pre>
 +
#agree with #friend
 +
</pre>
 +
 +
Our transfer rule successfully switched the object (friend) with the verb phrase (agree with).
  
 
= Post-Evaluation =
 
= Post-Evaluation =
 +
 +
'''Statistics About Input Files'''
 +
 +
<pre>
 +
Number of words in reference: 47
 +
Number of words in test: 33
 +
Number of unknown words (marked with a star) in test: 18
 +
Percentage of unknown words: 54.55 %
 +
</pre>
 +
 +
'''Results when removing unknown-word marks (stars)'''
  
 
<pre>
 
<pre>
−
Current WER: %
+
Edit distance: 47
−
Current PER: %
+
Word error rate (WER): 100.00 %
−
-------------------------------------------------------
+
Number of position-independent correct words: 0
−
Number of words in reference:  
+
Position-independent word error rate (PER): 100.00 %  
−
Number of words in test:
 
−
Number of unknown words (marked with a star) in test:  
 
−
Percentage of unknown words:  %
 
−
-------------------------------------------------------
 
 
</pre>
 
</pre>
 +
 +
'''Coverage Test on jya.tests.txt in Bilingual Transducer'''
 +
<pre>
 +
TOP UNKNOWN WORDS:
 +
      1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
 +
      1 ^ɯtaʁ/*ɯtaʁ$
 +
      1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
 +
      1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
 +
      1 ^kɯkɯra/*kɯkɯra$
 +
      1 ^khramba/*khramba$
 +
      1 ^aʑo/*aʑo$
 +
coverage: 35 / 42 (~0.83333333333333333333)
 +
remaining unknown forms: 7
 +
ambiguity: 56 / 42 (~1.33333333333333333333)
 +
jya.tests.txt Thu May 4 03:47:08 PM EDT 2023    35/42  ~0.83333333333333333333 \|  56/42    ~1.33333333333333333333
 +
</pre>
 +
 +
  
 
[[Category: Japhug]] [[Category: Sp23 StructuralTransfer]]
 
[[Category: Japhug]] [[Category: Sp23 StructuralTransfer]]

Latest revision as of 19:47, 4 May 2023


Pre-Evaluation

Statistics About Input Files 

Number of words in reference: 47
Number of words in test: 33
Number of unknown words (marked with a star) in test: 18
Percentage of unknown words: 54.55 %

Results when removing unknown-word marks (stars) 

Edit distance: 47
Word error rate (WER): 100.00 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 100.00 %

Coverage Test on jya.tests.txt in Bilingual Transducer 

TOP UNKNOWN WORDS:
      1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
      1 ^ɲɯrganɯ/*ɲɯrganɯ$
      1 ^ɲɤmtsɯr/*ɲɤmtsɯr$
      1 ^ɯʑo/*ɯʑo$
      1 ^ɯtaʁ/*ɯtaʁ$
      1 ^ɯjme/*ɯjme$
      1 ^ɕɤrɯ/*ɕɤrɯ$
      1 ^xuexiao/*xuexiao$
      1 ^tʂu/*tʂu$
      1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
      1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
      1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
      1 ^mɤpe/*mɤpe$
      1 ^kɯkɯra/*kɯkɯra$
      1 ^kɤzo/*kɤzo$
      1 ^khramba/*khramba$
      1 ^aʑo/*aʑo$
      1 ^ambro/*ambro$
coverage: 24 / 42 (~0.57142857142857142857)
remaining unknown forms: 18
ambiguity: 54 / 42 (~1.28571428571428571429)

(JYA ‣ ENG) Transfer Evaluation

We implemented Contrastive Grammar #1: "For clauses with transitive verbs, in Japhug the object generally precedes the verb (and follows the subject). In English however the object follows the verb."


Example Sentence 1

lɯlu nɯ kɯ βʑɯ ɯɕa tɕi pjɤrga outputs #that #cat also #like #mouse #meat instead of the direct translation #cat that with #mouse #meat also #like.

Tagger Output
^lɯlu<n><ind>$ ^nɯ<det><dem><dist><sg>$ ^kɯ<post>$ ^βʑɯ<n><ind>$ ^ɕa<n><px3sg>$ ^tɕi<adv>$ ^rga<v><tv>$^.<sent>$
Lex Output
^lɯlu<n><ind>/cat<n><sg><ind>$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$ ^kɯ<post>/with<pr>$ ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$ ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$^.<sent>/.<sent>$
Transfer Output
Applying rule 10 (line 77): ^lɯlu<n><ind>/cat<n><sg><ind>$

Applying rule 12 (line 80): ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$

Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$}$

Applying rule 11 (line 79): ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$

Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$

Applying rule 13 (line 82): ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$ ^kɯ<post>/with<pr>$

Applying output rule 12 (line 82): default<DP><erg> -> ^default<dP><CD>{^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$}$ ^kɯ<post>/with<pr>$

Applying output rule 10 (line 79): default<dP><abs> -> ^default<NP>{^lɯlu<n><ind>/cat<n><sg><ind>$}$ ^nɯ<det><dem><dist><sg>/that<det><dem><sg>$

No rule specified: ^that<det>$

Applying output rule 9 (line 77): default<NP> -> ^lɯlu<n><ind>/cat<n><sg><ind>$

No rule specified: ^cat<n><sg><ind>$

Applying rule 10 (line 77): ^βʑɯ<n><ind>/mouse<n><sg><ind>$

Applying rule 12 (line 80): ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$}$

Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$}$}$

Applying rule 10 (line 77): ^ɕa<n><px3sg>/meat<n><sg><px3sg>$

Applying rule 12 (line 80): ^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$

Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$

Applying rule 3 (line 70): ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$

Applying rule 12 (line 80): ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$

Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$

Applying rule 15 (line 88): ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$

Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$

Applying rule 15 (line 88): ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$

Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$

Applying output rule 16 (line 91): default<S> -> ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$}$ ^default<vP>{^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$}$

Applying output rule 14 (line 88): default<vP> -> ^tɕi<adv>/also<adv>$ ^rga<v><tv>/like<vblex>$

No rule specified: ^also<adv>$

No rule specified: ^like<vblex>$

Applying output rule 13 (line 83): default<DP><abs> -> ^default<dP><CD>{^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$}$

Applying output rule 11 (line 80): default<dP><abs> -> ^default<NP>{^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$}$

Applying output rule 2 (line 70): default<NP> -> ^βʑɯ<n><ind>/mouse<n><sg><ind>$ ^ɕa<n><px3sg>/meat<n><sg><px3sg>$

No rule specified: ^mouse<n><sg><ind>$

No rule specified: ^meat<n><sg><ind>$

No rule specified: ^.<sent>/.<sent>$
^that<det>$ ^cat<n><sg><ind>$ ^also<adv>$ ^like<vblex>$ ^mouse<n><sg><ind>$ ^meat<n><sg><ind>$^.<sent>$
JYA-ENG Output
#that #cat also #like #mouse #meat

Example Sentence 2

βzaŋsa tonɯpandʑi outputs #agree with #friend instead of the direct translation #friend #agree with.

Tagger Output
^βzaŋsa<n><ind>$ ^nɯpa<v><tv>$^.<sent>$
Lex Output
^βzaŋsa<n><ind>/friend<n><sg><ind>$ ^nɯpa<v><tv>/agree with<vblex>$^.<sent>/.<sent>$
Transfer Output
Applying rule 10 (line 77): ^βzaŋsa<n><ind>/friend<n><sg><ind>$

Applying rule 12 (line 80): ^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$

Applying rule 14 (line 83): ^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$

Applying rule 16 (line 89): ^nɯpa<v><tv>/agree with<vblex>$

Applying rule 17 (line 91): ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$}$ ^default<vP>{^nɯpa<v><tv>/agree with<vblex>$}$

Applying output rule 16 (line 91): default<VP> -> ^default<DP><CD>{^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$}$ ^default<vP>{^nɯpa<v><tv>/agree with<vblex>$}$

Applying output rule 15 (line 89): default<vP> -> ^nɯpa<v><tv>/agree with<vblex>$

No rule specified: ^agree with<vblex>$

Applying output rule 13 (line 83): default<DP><abs> -> ^default<dP><CD>{^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$}$

Applying output rule 11 (line 80): default<dP><abs> -> ^default<NP>{^βzaŋsa<n><ind>/friend<n><sg><ind>$}$

Applying output rule 9 (line 77): default<NP> -> ^βzaŋsa<n><ind>/friend<n><sg><ind>$

No rule specified: ^friend<n><sg><ind>$

No rule specified: ^.<sent>/.<sent>$
^agree with<vblex>$ ^friend<n><sg><ind>$^.<sent>$
JYA-ENG Output
#agree with #friend

Our transfer rule successfully switched the object (friend) with the verb phrase (agree with).

Post-Evaluation

Statistics About Input Files 

Number of words in reference: 47
Number of words in test: 33
Number of unknown words (marked with a star) in test: 18
Percentage of unknown words: 54.55 %

Results when removing unknown-word marks (stars) 

Edit distance: 47
Word error rate (WER): 100.00 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 100.00 %

Coverage Test on jya.tests.txt in Bilingual Transducer 

TOP UNKNOWN WORDS:
      1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
      1 ^ɯtaʁ/*ɯtaʁ$
      1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
      1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
      1 ^kɯkɯra/*kɯkɯra$
      1 ^khramba/*khramba$
      1 ^aʑo/*aʑo$
coverage: 35 / 42 (~0.83333333333333333333)
remaining unknown forms: 7
ambiguity: 56 / 42 (~1.33333333333333333333)
jya.tests.txt Thu May 4 03:47:08 PM EDT 2023    35/42   ~0.83333333333333333333 \|   56/42    ~1.33333333333333333333
Retrieved from "http://wikis.swarthmore.edu/ling073/index.php?title=Japhug_and_English/Structural_Transfer&oldid=22144"