Difference between revisions of "Urum and English/Structural Transfer"
From LING073
(→Example 5 (Locative Case)) |
(→Initial Generator Evaluation) |
||
| Line 14: | Line 14: | ||
(ling073-uum-eng-corpus/eng.sentences.txt & ling073-uum-eng/pre-eval_uum-eng.tests.txt) | (ling073-uum-eng-corpus/eng.sentences.txt & ling073-uum-eng/pre-eval_uum-eng.tests.txt) | ||
| − | Number of words in reference: | + | Number of words in reference: 231 |
| − | Number of words in test: | + | Number of words in test: 182 |
| − | Number of unknown words (marked with a star) in test: | + | Number of unknown words (marked with a star) in test: 76 |
| − | Percentage of unknown words: | + | Percentage of unknown words: 41.76 % |
| + | |||
'''Results when removing unknown-word marks (stars)''' | '''Results when removing unknown-word marks (stars)''' | ||
| − | Edit distance: | + | Edit distance: 231 |
Word error rate (WER): 100.00 % | Word error rate (WER): 100.00 % | ||
| − | Number of position-independent correct words: | + | Number of position-independent correct words: 7 |
| − | Position-independent word error rate (PER): | + | Position-independent word error rate (PER): 96.97 % |
'''Coverage Tests''' | '''Coverage Tests''' | ||
Revision as of 15:15, 27 April 2023
Contents
External resources
Transducer Links
Language Pair Repository
Initial Generator Evaluation
Statistics About Input Files
(ling073-uum-eng-corpus/eng.sentences.txt & ling073-uum-eng/pre-eval_uum-eng.tests.txt)
Number of words in reference: 231 Number of words in test: 182 Number of unknown words (marked with a star) in test: 76 Percentage of unknown words: 41.76 %
Results when removing unknown-word marks (stars)
Edit distance: 231 Word error rate (WER): 100.00 % Number of position-independent correct words: 7 Position-independent word error rate (PER): 96.97 %
Coverage Tests
TOP UNKNOWN WORDS: - N/A coverage: 21 / 21 (1) remaining unknown forms: 0
(UUM ‣ ENG) Transfer Evaluation
Example 1 (Verb Pronoun Marking)
- (uum) алйым → (eng) I find
- (uum) ал<v><tv><pres><p1><sg> → (eng) I<prn><subj><p1><m><sg>find<vblex><pres>
Example 2 (Verb Past-Tense)
- (uum) булду → (eng) he found
- (uum) бул<v><tv><past><p3><sg> → (eng) he<prn><p3><m><sg>find<vblex><past>
Example 3 (Verb Negativity)
- (uum) булмады → (eng) he did not find
- (uum) бул<v><tv><neg><past><p3><sg> → (eng) he<prn><p3><m><sg>did<vblex><past>not<adv> find<vblex><pres>
Example 4 (Ablative Case)
- (uum) кӧктэн → (eng) from sky
- (uum) кӧк<n><abl> → (eng) from<pr>sky<n><sg>
Example 5 (Locative Case)
- (uum) бахчыда → (eng) in sky
- (uum) бахчы<n><loc> → (eng) in<pr>sky<n><sg>
