Difference between revisions of "Urum and English/Structural Transfer"
From LING073
(→Initial Generator Evaluation) |
(→(UUM ‣ ENG) Transfer Evaluation) |
||
| Line 79: | Line 79: | ||
* {{transferTest|uum|eng|бахчыда|in sky}} | * {{transferTest|uum|eng|бахчыда|in sky}} | ||
*: {{transferMorphTest|uum|eng|бахчы{{tag|n}}{{tag|loc}}|in{{tag|pr}}sky{{tag|n}}{{tag|sg}}}} | *: {{transferMorphTest|uum|eng|бахчы{{tag|n}}{{tag|loc}}|in{{tag|pr}}sky{{tag|n}}{{tag|sg}}}} | ||
| + | |||
| + | = Structural Transfer Post-Evaluation = | ||
| + | |||
| + | '''Statistics About Input Files''' | ||
| + | |||
| + | (ling073-uum-eng-corpus/eng.sentences.txt & ling073-uum-eng/pre-eval_uum-eng.tests.txt) | ||
| + | |||
| + | Number of words in reference: 231 | ||
| + | Number of words in test: 182 | ||
| + | Number of unknown words (marked with a star) in test: 76 | ||
| + | Percentage of unknown words: 41.76 % | ||
| + | |||
| + | |||
| + | '''Results when removing unknown-word marks (stars)''' | ||
| + | |||
| + | Edit distance: 231 | ||
| + | Word error rate (WER): 100.00 % | ||
| + | Number of position-independent correct words: 7 | ||
| + | Position-independent word error rate (PER): 96.97 % | ||
| + | |||
| + | '''Coverage Tests''' | ||
| + | TOP UNKNOWN WORDS: | ||
| + | 3 ^да/*да$ | ||
| + | 2 ^тʼетти/*тʼетти$ | ||
| + | 2 ^тʼетирдилер/*тʼетирдилер$ | ||
| + | 2 ^доғуштан/*доғуштан$ | ||
| + | 1 ^ӧстӱ/*ӧстӱ$ | ||
| + | 1 ^җеннет/*җеннет$ | ||
| + | 1 ^эң/*эң$ | ||
| + | 1 ^эништилер/*эништилер$ | ||
| + | 1 ^энди/*энди$ | ||
| + | 1 ^ышхын/*ышхын$ | ||
| + | 1 ^ышихындан/*ышихындан$ | ||
| + | 1 ^чобанлара/*чобанлара$ | ||
| + | 1 ^чобанлар/*чобанлар$ | ||
| + | 1 ^чобаллара/*чобаллара$ | ||
| + | 1 ^чине/*чине$ | ||
| + | 1 ^хырды/*хырды$ | ||
| + | 1 ^хутхарды/*хутхарды$ | ||
| + | 1 ^хорхундулар/*хорхундулар$ | ||
| + | 1 ^хонуштулар/*хонуштулар$ | ||
| + | 1 ^хонду/*хонду$ | ||
| + | coverage: 130 / 206 (~0.63106796116504854369) | ||
| + | remaining unknown forms: 76 | ||
[[Category:Sp23_StructuralTransfer]][[Category:Urum]][[Category:English]] | [[Category:Sp23_StructuralTransfer]][[Category:Urum]][[Category:English]] | ||
Revision as of 15:17, 27 April 2023
Contents
External resources
Transducer Links
Language Pair Repository
Initial Generator Evaluation
Statistics About Input Files
(ling073-uum-eng-corpus/eng.sentences.txt & ling073-uum-eng/pre-eval_uum-eng.tests.txt)
Number of words in reference: 231 Number of words in test: 182 Number of unknown words (marked with a star) in test: 76 Percentage of unknown words: 41.76 %
Results when removing unknown-word marks (stars)
Edit distance: 231 Word error rate (WER): 100.00 % Number of position-independent correct words: 7 Position-independent word error rate (PER): 96.97 %
Coverage Tests
TOP UNKNOWN WORDS:
3 ^да/*да$
2 ^тʼетти/*тʼетти$
2 ^тʼетирдилер/*тʼетирдилер$
2 ^доғуштан/*доғуштан$
1 ^ӧстӱ/*ӧстӱ$
1 ^җеннет/*җеннет$
1 ^эң/*эң$
1 ^эништилер/*эништилер$
1 ^энди/*энди$
1 ^ышхын/*ышхын$
1 ^ышихындан/*ышихындан$
1 ^чобанлара/*чобанлара$
1 ^чобанлар/*чобанлар$
1 ^чобаллара/*чобаллара$
1 ^чине/*чине$
1 ^хырды/*хырды$
1 ^хутхарды/*хутхарды$
1 ^хорхундулар/*хорхундулар$
1 ^хонуштулар/*хонуштулар$
1 ^хонду/*хонду$
coverage: 130 / 206 (~0.63106796116504854369)
remaining unknown forms: 76
(UUM ‣ ENG) Transfer Evaluation
Example 1 (Verb Pronoun Marking)
- (uum) алйым → (eng) I find
- (uum) ал<v><tv><pres><p1><sg> → (eng) I<prn><subj><p1><m><sg>find<vblex><pres>
Example 2 (Verb Past-Tense)
- (uum) булду → (eng) he found
- (uum) бул<v><tv><past><p3><sg> → (eng) he<prn><p3><m><sg>find<vblex><past>
Example 3 (Verb Negativity)
- (uum) булмады → (eng) he did not find
- (uum) бул<v><tv><neg><past><p3><sg> → (eng) he<prn><p3><m><sg>did<vblex><past>not<adv> find<vblex><pres>
Example 4 (Ablative Case)
- (uum) кӧктэн → (eng) from sky
- (uum) кӧк<n><abl> → (eng) from<pr>sky<n><sg>
Example 5 (Locative Case)
- (uum) бахчыда → (eng) in sky
- (uum) бахчы<n><loc> → (eng) in<pr>sky<n><sg>
Structural Transfer Post-Evaluation
Statistics About Input Files
(ling073-uum-eng-corpus/eng.sentences.txt & ling073-uum-eng/pre-eval_uum-eng.tests.txt)
Number of words in reference: 231 Number of words in test: 182 Number of unknown words (marked with a star) in test: 76 Percentage of unknown words: 41.76 %
Results when removing unknown-word marks (stars)
Edit distance: 231 Word error rate (WER): 100.00 % Number of position-independent correct words: 7 Position-independent word error rate (PER): 96.97 %
Coverage Tests
TOP UNKNOWN WORDS:
3 ^да/*да$
2 ^тʼетти/*тʼетти$
2 ^тʼетирдилер/*тʼетирдилер$
2 ^доғуштан/*доғуштан$
1 ^ӧстӱ/*ӧстӱ$
1 ^җеннет/*җеннет$
1 ^эң/*эң$
1 ^эништилер/*эништилер$
1 ^энди/*энди$
1 ^ышхын/*ышхын$
1 ^ышихындан/*ышихындан$
1 ^чобанлара/*чобанлара$
1 ^чобанлар/*чобанлар$
1 ^чобаллара/*чобаллара$
1 ^чине/*чине$
1 ^хырды/*хырды$
1 ^хутхарды/*хутхарды$
1 ^хорхундулар/*хорхундулар$
1 ^хонуштулар/*хонуштулар$
1 ^хонду/*хонду$
coverage: 130 / 206 (~0.63106796116504854369)
remaining unknown forms: 76
