Difference between revisions of "Navajo and English/Structural transfer"
(→Transfer) |
(→Results) |
||
(10 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
==Pre-evaluation== | ==Pre-evaluation== | ||
− | + | ====Statistics about input files==== | |
− | + | Number of words in reference: 55 | |
− | + | Number of words in test: 43 | |
+ | Number of unknown words (marked with a star) in test: | ||
+ | Percentage of unknown words: 0.00 % | ||
+ | |||
+ | ====Results when removing unknown-word marks (stars)==== | ||
+ | Edit distance: 55 | ||
+ | Word error rate (WER): 100.00 % | ||
+ | Number of position-independent correct words: 0 | ||
+ | Position-independent word error rate (PER): 100.00 % | ||
+ | |||
+ | ====Results when unknown-word marks (stars) are not removed==== | ||
+ | Edit distance: 55 | ||
+ | Word Error Rate (WER): 100.00 % | ||
+ | Number of position-independent correct words: 0 | ||
+ | Position-independent word error rate (PER): 100.00 % | ||
+ | |||
+ | ====Statistics about the translation of unknown words==== | ||
+ | Number of unknown words which were free rides: 0 | ||
+ | Percentage of unknown words that were free rides: 0% | ||
==Post-evaluation== | ==Post-evaluation== | ||
Line 17: | Line 35: | ||
=====Biltrans===== | =====Biltrans===== | ||
− | ^Atooʼ<n>/Stew<n>$ ^łaʼ<det>/some<det>$ ^naa<n>/around<pp>$ ^deeshkááł<v>/give<vblex>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | + | >^Atooʼ<n>/Stew<n>$ ^łaʼ<det>/some<det>$ ^naa<n>/around<pp>$ ^deeshkááł<v>/give<vblex>$^.<sent>/.<sent>$^.<sent>/.<sent>$ |
=====Transfer===== | =====Transfer===== | ||
− | + | >#some #Stew #around #give. | |
=====Lex===== | =====Lex===== | ||
− | ^Some<DP>{ | + | >^Some<DP>{ |
^Stew<NP><ND>{ | ^Stew<NP><ND>{ | ||
^Atooʼ<n>/Stew<n>$ | ^Atooʼ<n>/Stew<n>$ | ||
Line 37: | Line 55: | ||
^.<sent>/.<sent>$ | ^.<sent>/.<sent>$ | ||
+ | ===Results=== | ||
+ | ====Overview==== | ||
+ | * Despite correctly parsing this rule, as displayed in the outputs above, the WER and PER rates did not change. | ||
+ | |||
+ | ====Statistics about input files==== | ||
+ | Number of words in reference: 55 | ||
+ | Number of words in test: 43 | ||
+ | Number of unknown words (marked with a star) in test: | ||
+ | Percentage of unknown words: 0.00 % | ||
− | ===Results=== | + | ====Results when removing unknown-word marks (stars)==== |
− | + | Edit distance: 55 | |
− | + | Word error rate (WER): 100.00 % | |
− | + | Number of position-independent correct words: 0 | |
+ | Position-independent word error rate (PER): 100.00 % | ||
+ | |||
+ | ====Results when unknown-word marks (stars) are not removed==== | ||
+ | Edit distance: 55 | ||
+ | Word Error Rate (WER): 100.00 % | ||
+ | Number of position-independent correct words: 0 | ||
+ | Position-independent word error rate (PER): 100.00 % | ||
+ | |||
+ | ====Statistics about the translation of unknown words==== | ||
+ | Number of unknown words which were free rides: 0 | ||
+ | Percentage of unknown words that were free rides: 0% | ||
− | |||
[[category:Navajo]] [[category:Sp22_StructuralTransfer]] | [[category:Navajo]] [[category:Sp22_StructuralTransfer]] |
Latest revision as of 12:23, 8 May 2022
Pre-evaluation
Statistics about input files
Number of words in reference: 55 Number of words in test: 43 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
Edit distance: 55 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Results when unknown-word marks (stars) are not removed
Edit distance: 55 Word Error Rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%
Post-evaluation
Examples
Determiner Position
- In Navajo, determiners, when thy appear, come after the noun
- (nav) Atooʼ łaʼ naa deeshkááł. → (eng) I will give you some stew.
- (nav) Atooʼ<n> łaʼ<det> naa<post> deeshkááł<v><tv><fut><p1><sg> → (eng) Stew<n> some<det> around<pp> give<v><tv><fut><p1><sg>
Tagger
Biltrans
>^Atooʼ<n>/Stew<n>$ ^łaʼ<det>/some<det>$ ^naa<n>/around<pp>$ ^deeshkááł<v>/give<vblex>$^.<sent>/.<sent>$^.<sent>/.<sent>$
Transfer
>#some #Stew #around #give.
Lex
>^Some<DP>{ ^Stew<NP><ND>{ ^Atooʼ<n>/Stew<n>$ }$ ^łaʼ<det>/some<det>$ }$ ^around<NP><ND>{ ^naa<n>/around<pp>$ }$ ^deeshkááł<v>/give<vblex>$ ^.<sent>/.<sent>$ ^.<sent>/.<sent>$
Results
Overview
- Despite correctly parsing this rule, as displayed in the outputs above, the WER and PER rates did not change.
Statistics about input files
Number of words in reference: 55 Number of words in test: 43 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
Edit distance: 55 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Results when unknown-word marks (stars) are not removed
Edit distance: 55 Word Error Rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Statistics about the translation of unknown words
Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%