Difference between revisions of "Japhug and English/Structural Transfer"
From LING073
(→Pre-Evaluation) |
(→Pre-Evaluation) |
||
| Line 21: | Line 21: | ||
</pre> | </pre> | ||
| − | '''Coverage Test in Bilingual Transducer''' | + | '''Coverage Test on jya.tests.txt in Bilingual Transducer''' |
<pre> | <pre> | ||
TOP UNKNOWN WORDS: | TOP UNKNOWN WORDS: | ||
| − | + | 1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$ | |
| − | + | 1 ^ɲɯrganɯ/*ɲɯrganɯ$ | |
| − | + | 1 ^ɲɤmtsɯr/*ɲɤmtsɯr$ | |
| − | + | 1 ^ɯʑo/*ɯʑo$ | |
| − | + | 1 ^ɯtaʁ/*ɯtaʁ$ | |
| − | + | 1 ^ɯjme/*ɯjme$ | |
| − | + | 1 ^ɕɤrɯ/*ɕɤrɯ$ | |
| − | + | 1 ^xuexiao/*xuexiao$ | |
| − | + | 1 ^tʂu/*tʂu$ | |
| − | + | 1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$ | |
| − | + | 1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$ | |
| − | + | 1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$ | |
| − | + | 1 ^mɤpe/*mɤpe$ | |
| − | + | 1 ^kɯkɯra/*kɯkɯra$ | |
| − | + | 1 ^kɤzo/*kɤzo$ | |
| − | + | 1 ^khramba/*khramba$ | |
| − | + | 1 ^aʑo/*aʑo$ | |
| − | + | 1 ^ambro/*ambro$ | |
| − | + | coverage: 24 / 42 (~0.57142857142857142857) | |
| − | + | remaining unknown forms: 18 | |
| − | coverage: | + | ambiguity: 54 / 42 (~1.28571428571428571429) |
| − | remaining unknown forms: | ||
| − | ambiguity: | ||
</pre> | </pre> | ||
| − | '''Coverage Test in Monolingual Transducer''' | + | '''Coverage Test on jya.tests.txt in Monolingual Transducer''' |
<pre> | <pre> | ||
TOP UNKNOWN WORDS: | TOP UNKNOWN WORDS: | ||
| − | + | 1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$ | |
| − | + | 1 ^ɲɯrganɯ/*ɲɯrganɯ$ | |
| − | + | 1 ^ɯjme/*ɯjme$ | |
| − | + | 1 ^xuexiao/*xuexiao$ | |
| − | + | 1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$ | |
| − | + | 1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$ | |
| − | + | 1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$ | |
| − | + | 1 ^kɯkɯra/*kɯkɯra$ | |
| − | + | coverage: 33 / 41 (~0.80487804878048780488) | |
| − | + | remaining unknown forms: 8 | |
| − | + | ambiguity: 82 / 41 (2) | |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | coverage: | ||
| − | remaining unknown forms: | ||
| − | ambiguity: | ||
</pre> | </pre> | ||
Revision as of 00:31, 3 May 2023
Pre-Evaluation
Statistics About Input Files
Number of words in reference: 47 Number of words in test: 33 Number of unknown words (marked with a star) in test: 18 Percentage of unknown words: 54.55 %
Results when removing unknown-word marks (stars)
Edit distance: 47 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Coverage Test on jya.tests.txt in Bilingual Transducer
TOP UNKNOWN WORDS:
1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
1 ^ɲɯrganɯ/*ɲɯrganɯ$
1 ^ɲɤmtsɯr/*ɲɤmtsɯr$
1 ^ɯʑo/*ɯʑo$
1 ^ɯtaʁ/*ɯtaʁ$
1 ^ɯjme/*ɯjme$
1 ^ɕɤrɯ/*ɕɤrɯ$
1 ^xuexiao/*xuexiao$
1 ^tʂu/*tʂu$
1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
1 ^mɤpe/*mɤpe$
1 ^kɯkɯra/*kɯkɯra$
1 ^kɤzo/*kɤzo$
1 ^khramba/*khramba$
1 ^aʑo/*aʑo$
1 ^ambro/*ambro$
coverage: 24 / 42 (~0.57142857142857142857)
remaining unknown forms: 18
ambiguity: 54 / 42 (~1.28571428571428571429)
Coverage Test on jya.tests.txt in Monolingual Transducer
TOP UNKNOWN WORDS:
1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
1 ^ɲɯrganɯ/*ɲɯrganɯ$
1 ^ɯjme/*ɯjme$
1 ^xuexiao/*xuexiao$
1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
1 ^kɯkɯra/*kɯkɯra$
coverage: 33 / 41 (~0.80487804878048780488)
remaining unknown forms: 8
ambiguity: 82 / 41 (2)
Post-Evaluation
Statistics About Input Files
Results when removing unknown-word marks (stars)
