Difference between revisions of "Kickapoo and English/Structural transfer"

From LING073
Jump to: navigation, search
 
 
(7 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
WER
+
== Pre-evaluation ==
 +
 
 +
Command used:
 +
<pre>
 +
apertium-eval-translator-line -r /home/kpeng1/ling073/ling073-kic-eng-corpus/eng.tests.txt -t /home/kpeng1/ling073/ling073-kic-eng/kic-eng.tests.txt
 +
</pre>
 +
 
 +
=== Results ===
 +
 
 +
{| class="wikitable"
 +
! Metric
 +
! Value
 +
|-
 +
| Number of words in reference
 +
| 41
 +
|-
 +
| Number of words in test
 +
| 25
 +
|-
 +
| Number of unknown words in test
 +
| 11
 +
|-
 +
| Coverage
 +
| 56.00%
 +
|-
 +
| Word Error Rate (WER)
 +
| 100.00%
 +
|-
 +
| Position-independent Error Rate (PER)
 +
| 100.00%
 +
|}
 +
 
 +
 
 +
== After lexical additions ==
 +
 
 +
{| class="wikitable"
 +
! Metric
 +
! Value
 +
|-
 +
| Number of words in reference
 +
| 41
 +
|-
 +
| Number of words in test
 +
| 27
 +
|-
 +
| Number of unknown words in test
 +
| 0
 +
|-
 +
| Coverage
 +
| 100.00%
 +
|-
 +
| Word Error Rate (WER)
 +
| 97.56%
 +
|-
 +
| Position-independent Error Rate (PER)
 +
| 97.56%
 +
|}
 +
 
 +
 
 +
== After adding structural transfer rule ==
 +
 
 +
{| class="wikitable"
 +
! Metric
 +
! Value
 +
|-
 +
| Number of words in reference
 +
| 41
 +
|-
 +
| Number of words in test
 +
| 33
 +
|-
 +
| Number of unknown words in test
 +
| 0
 +
|-
 +
| Coverage
 +
| 100.00%
 +
|-
 +
| Word Error Rate (WER)
 +
| 87.80%
 +
|-
 +
| Position-independent Error Rate (PER)
 +
| 87.80%
 +
|}
 +
 
 +
=== Implemented Structural Transfer item ===
 +
 
 +
We implemented a structural transfer rule for the Kickapoo conjunct pattern illustrated by the sentence:
 +
 
 +
<pre>
 +
manahi enoweechi
 +
</pre>
 +
 
 +
The corresponding English translation is:
 +
 
 +
<pre>
 +
This is what he said.
 +
</pre>
 +
 
 +
In this pattern, the Kickapoo source structure is more compact than the English target structure. The transfer rule expands the source into a fuller English clause by introducing additional overt material, including ''is'', ''what'', and ''he'', and by setting the verb to past tense.
 +
 
 +
==== Example outputs ====
 +
 
 +
Source sentence:
 +
<pre>
 +
manahi enoweechi
 +
</pre>
 +
 
 +
Tagger output:
 +
<pre>
 +
^manahi<prn><dem><sg>$ ^nowee<v><iv><aor_1><aa><cnj><s_3sg>$^.<sent>$
 +
</pre>
 +
 
 +
Lex output:
 +
<pre>
 +
^manahi<prn><dem><sg>/this<det><sg>$ ^nowee<v><iv><aor_1><aa><cnj><s_3sg>/say<vblex><aor_1><aa><cnj><s_3sg>$^.<sent>/.<sent>$
 +
</pre>
 +
 
 +
Transfer output:
 +
<pre>
 +
^this<det><sg>$ ^be<vblex><pres><p3><sg>$ ^what<prn>$ ^he<prn><p3><sg>$ ^say<vblex><past>$^.<sent>$
 +
</pre>
 +
 
 +
Final translation:
 +
<pre>
 +
this is what he said
 +
</pre>
 +
 
  
  

Latest revision as of 10:37, 5 May 2026

Pre-evaluation

Command used: 

apertium-eval-translator-line -r /home/kpeng1/ling073/ling073-kic-eng-corpus/eng.tests.txt -t /home/kpeng1/ling073/ling073-kic-eng/kic-eng.tests.txt

Results

Metric Value
Number of words in reference 41
Number of words in test 25
Number of unknown words in test 11
Coverage 56.00%
Word Error Rate (WER) 100.00%
Position-independent Error Rate (PER) 100.00%


After lexical additions

Metric Value
Number of words in reference 41
Number of words in test 27
Number of unknown words in test 0
Coverage 100.00%
Word Error Rate (WER) 97.56%
Position-independent Error Rate (PER) 97.56%


After adding structural transfer rule

Metric Value
Number of words in reference 41
Number of words in test 33
Number of unknown words in test 0
Coverage 100.00%
Word Error Rate (WER) 87.80%
Position-independent Error Rate (PER) 87.80%

Implemented Structural Transfer item

We implemented a structural transfer rule for the Kickapoo conjunct pattern illustrated by the sentence: 

manahi enoweechi

The corresponding English translation is: 

This is what he said.

In this pattern, the Kickapoo source structure is more compact than the English target structure. The transfer rule expands the source into a fuller English clause by introducing additional overt material, including is, what, and he, and by setting the verb to past tense.

Example outputs

Source sentence: 

manahi enoweechi

Tagger output: 

^manahi<prn><dem><sg>$ ^nowee<v><iv><aor_1><aa><cnj><s_3sg>$^.<sent>$

Lex output: 

^manahi<prn><dem><sg>/this<det><sg>$ ^nowee<v><iv><aor_1><aa><cnj><s_3sg>/say<vblex><aor_1><aa><cnj><s_3sg>$^.<sent>/.<sent>$

Transfer output: 

^this<det><sg>$ ^be<vblex><pres><p3><sg>$ ^what<prn>$ ^he<prn><p3><sg>$ ^say<vblex><past>$^.<sent>$

Final translation: 

this is what he said
Retrieved from "http://wikis.swarthmore.edu/ling073/index.php?title=Kickapoo_and_English/Structural_transfer&oldid=28433"