Revision as of 00:24, 3 May 2023

Pre-Evaluation

Statistics About Input Files

Number of words in reference: 47
Number of words in test: 33
Number of unknown words (marked with a star) in test: 18
Percentage of unknown words: 54.55 %

Results when removing unknown-word marks (stars)

Edit distance: 47
Word error rate (WER): 100.00 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 100.00 %

Coverage Test in Bilingual Transducer

TOP UNKNOWN WORDS:
     60 ^ndɤre/*ndɤre$
     43 ^ma/*ma$
     28 ^ti/*ti$
     21 ^toti/*toti$
     19 ^tɕheme/*tɕheme$
     17 ^mbro/*mbro$
     16 ^nɯnɯ/*nɯnɯ$
     13 ^qachɣa/*qachɣa$
     12 ^tʂu/*tʂu$
     12 ^ni/*ni$
     12 ^aʑo/*aʑo$
     11 ^iɕqha/*iɕqha$
     10 ^li/*li$
      9 ^ɯʑo/*ɯʑo$
      9 ^kha/*kha$
      8 ^rɟɤlpu/*rɟɤlpu$
      8 ^rcanɯ/*rcanɯ$
      8 ^kɯwxti/*kɯwxti$
      7 ^ɯŋgɯ/*ɯŋgɯ$
      7 ^ɯrkɯ/*ɯrkɯ$
coverage: 1862 / 3143 (~0.59242761692650334076)
remaining unknown forms: 1281
ambiguity: 3632 / 3143 (~1.15558383709831371301)

Coverage Test in Monolingual Transducer

TOP UNKNOWN WORDS:
      8 ^rɟɤlpu/*rɟɤlpu$
      8 ^rcanɯ/*rcanɯ$
      7 ^ɯrkɯ/*ɯrkɯ$
      7 ^tɤwa/*tɤwa$
      7 ^tɤsno/*tɤsno$
      7 ^tɕɤn/*tɕɤn$
      7 ^ki/*ki$
      6 ^ɯpi/*ɯpi$
      6 ^ɣɯ/*ɣɯ$
      6 ^tɤtɕɯ/*tɤtɕɯ$
      6 ^qhe/*qhe$
      5 ^tɯɣjɤn/*tɯɣjɤn$
      5 ^ndɤ/*ndɤ$
      5 ^kɯsthɯci/*kɯsthɯci$
      5 ^cho/*cho$
      4 ^tuβzea/*tuβzea$
      4 ^tinɯ/*tinɯ$
      4 ^nɯnaj/*nɯnaj$
      4 ^kɯkɯtu/*kɯkɯtu$
      3 ^ɲɯsɯsɤm/*ɲɯsɯsɤm$
coverage: 2863 / 3339 (~0.85744234800838574423)
remaining unknown forms: 476
ambiguity: 6101 / 3339 (~1.82719377058999700509)

Post-Evaluation

Statistics About Input Files

Results when removing unknown-word marks (stars)