Difference between revisions of "Navajo and English/Structural transfer"

From LING073
Jump to: navigation, search
(Transfer)
(Results)
 
(10 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
==Pre-evaluation==
 
==Pre-evaluation==
*WER: 100.00%
+
====Statistics about input files====
*PER: 100.00%
+
Number of words in reference: 55
*Coverage: 28/28
+
Number of words in test: 43
 +
Number of unknown words (marked with a star) in test:
 +
Percentage of unknown words: 0.00 %
 +
 
 +
====Results when removing unknown-word marks (stars)====
 +
Edit distance: 55
 +
Word error rate (WER): 100.00 %
 +
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
 
 +
====Results when unknown-word marks (stars) are not removed====
 +
Edit distance: 55
 +
Word Error Rate (WER): 100.00 %
 +
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
 
 +
====Statistics about the translation of unknown words====
 +
Number of unknown words which were free rides: 0
 +
Percentage of unknown words that were free rides: 0%
  
 
==Post-evaluation==
 
==Post-evaluation==
Line 17: Line 35:
 
=====Biltrans=====
 
=====Biltrans=====
  
^Atooʼ<n>/Stew<n>$ ^łaʼ<det>/some<det>$ ^naa<n>/around<pp>$ ^deeshkááł<v>/give<vblex>$^.<sent>/.<sent>$^.<sent>/.<sent>$
+
>^Atooʼ<n>/Stew<n>$ ^łaʼ<det>/some<det>$ ^naa<n>/around<pp>$ ^deeshkááł<v>/give<vblex>$^.<sent>/.<sent>$^.<sent>/.<sent>$
  
 
=====Transfer=====
 
=====Transfer=====
  
#some #Stew #around #give.
+
>#some #Stew #around #give.
  
 
=====Lex=====
 
=====Lex=====
^Some<DP>{
+
>^Some<DP>{
 
^Stew<NP><ND>{
 
^Stew<NP><ND>{
 
^Atooʼ<n>/Stew<n>$
 
^Atooʼ<n>/Stew<n>$
Line 37: Line 55:
 
^.<sent>/.<sent>$
 
^.<sent>/.<sent>$
  
 +
===Results===
 +
====Overview====
 +
* Despite correctly parsing this rule, as displayed in the outputs above, the WER and PER rates did not change.
 +
 +
====Statistics about input files====
 +
Number of words in reference: 55
 +
Number of words in test: 43
 +
Number of unknown words (marked with a star) in test:
 +
Percentage of unknown words: 0.00 %
  
===Results===
+
====Results when removing unknown-word marks (stars)====
*WER: 100.00%
+
Edit distance: 55
*PER: 100.00%
+
Word error rate (WER): 100.00 %
*Coverage: 28/28
+
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
 
 +
====Results when unknown-word marks (stars) are not removed====
 +
Edit distance: 55
 +
Word Error Rate (WER): 100.00 %
 +
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
 
 +
====Statistics about the translation of unknown words====
 +
Number of unknown words which were free rides: 0
 +
Percentage of unknown words that were free rides: 0%
  
* Despite correctly parsing this rule, as displayed in the outputs above, the WER and PER rates did not change.
 
  
  
  
 
[[category:Navajo]] [[category:Sp22_StructuralTransfer]]
 
[[category:Navajo]] [[category:Sp22_StructuralTransfer]]

Latest revision as of 12:23, 8 May 2022

Pre-evaluation

Statistics about input files

Number of words in reference: 55 Number of words in test: 43 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)

Edit distance: 55 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %

Results when unknown-word marks (stars) are not removed

Edit distance: 55 Word Error Rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %

Statistics about the translation of unknown words

Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%

Post-evaluation

Examples

Determiner Position

  • In Navajo, determiners, when thy appear, come after the noun
  • (nav) Atooʼ łaʼ naa deeshkááł. → (eng) I will give you some stew.
    (nav) Atooʼ<n> łaʼ<det> naa<post> deeshkááł<v><tv><fut><p1><sg> → (eng) Stew<n> some<det> around<pp> give<v><tv><fut><p1><sg>
Tagger
Biltrans

>^Atooʼ<n>/Stew<n>$ ^łaʼ<det>/some<det>$ ^naa<n>/around<pp>$ ^deeshkááł<v>/give<vblex>$^.<sent>/.<sent>$^.<sent>/.<sent>$

Transfer

>#some #Stew #around #give.

Lex

>^Some<DP>{ ^Stew<NP><ND>{ ^Atooʼ<n>/Stew<n>$ }$ ^łaʼ<det>/some<det>$ }$ ^around<NP><ND>{ ^naa<n>/around<pp>$ }$ ^deeshkááł<v>/give<vblex>$ ^.<sent>/.<sent>$ ^.<sent>/.<sent>$

Results

Overview

  • Despite correctly parsing this rule, as displayed in the outputs above, the WER and PER rates did not change.

Statistics about input files

Number of words in reference: 55 Number of words in test: 43 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)

Edit distance: 55 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %

Results when unknown-word marks (stars) are not removed

Edit distance: 55 Word Error Rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %

Statistics about the translation of unknown words

Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%