Difference between revisions of "Japhug and English/Structural Transfer"
From LING073
(→Post-Evaluation) |
|||
| Line 82: | Line 82: | ||
</pre> | </pre> | ||
| − | |||
| − | |||
| − | |||
[[Category: Japhug]] [[Category: Sp23 StructuralTransfer]] | [[Category: Japhug]] [[Category: Sp23 StructuralTransfer]] | ||
Revision as of 17:26, 4 May 2023
Pre-Evaluation
Statistics About Input Files
Number of words in reference: 47 Number of words in test: 33 Number of unknown words (marked with a star) in test: 18 Percentage of unknown words: 54.55 %
Results when removing unknown-word marks (stars)
Edit distance: 47 Word error rate (WER): 100.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 100.00 %
Coverage Test on jya.tests.txt in Bilingual Transducer
TOP UNKNOWN WORDS:
1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
1 ^ɲɯrganɯ/*ɲɯrganɯ$
1 ^ɲɤmtsɯr/*ɲɤmtsɯr$
1 ^ɯʑo/*ɯʑo$
1 ^ɯtaʁ/*ɯtaʁ$
1 ^ɯjme/*ɯjme$
1 ^ɕɤrɯ/*ɕɤrɯ$
1 ^xuexiao/*xuexiao$
1 ^tʂu/*tʂu$
1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
1 ^mɤpe/*mɤpe$
1 ^kɯkɯra/*kɯkɯra$
1 ^kɤzo/*kɤzo$
1 ^khramba/*khramba$
1 ^aʑo/*aʑo$
1 ^ambro/*ambro$
coverage: 24 / 42 (~0.57142857142857142857)
remaining unknown forms: 18
ambiguity: 54 / 42 (~1.28571428571428571429)
Coverage Test on jya.tests.txt in Monolingual Transducer
TOP UNKNOWN WORDS:
1 ^ʁnɯtɤrtsɯɣ/*ʁnɯtɤrtsɯɣ$
1 ^ɲɯrganɯ/*ɲɯrganɯ$
1 ^ɯjme/*ɯjme$
1 ^xuexiao/*xuexiao$
1 ^pɯ́wɣsɯmtoa/*pɯ́wɣsɯmtoa$
1 ^mɯpɯrɤʑia/*mɯpɯrɤʑia$
1 ^mɯpjɤpenɯ/*mɯpjɤpenɯ$
1 ^kɯkɯra/*kɯkɯra$
coverage: 33 / 41 (~0.80487804878048780488)
remaining unknown forms: 8
ambiguity: 82 / 41 (2)
Post-Evaluation
Statistics About Input Files
Results when removing unknown-word marks (stars)
Coverage Test on jya.tests.txt in Bilingual Transducer
