Shan/Disambiguation

Initial Evaluation

In the last coverage test of a large file, the ambiguity was 1673470 / 1486937 (~1.12)

So there are some ambiguity in the transducer.

Example:

ၵဝ် ၽုၵ်ႇ ၵုၺ်တူၼ်ႈၼိုင်ႈ

I plant one cotton plant

^ၵဝ်/ၵဝ်<prn><person><p1><sg>$ ^ၽ/ၽ<qst>$ ^ုၵ်ႇ/*ုၵ်ႇ$ ^ၵုၺ်/*ၵုၺ်$ ^တူၼ်ႈ/တူၼ်ႈ<clf>/တူၼ်ႈ<n>$ ^ၼိုင်ႈ/ၼိုင်ႈ<num>$ ^./.<sent>$

ၶုၼ်ၽီတူၼ်ႈမႆႉ

^ၶုၼ်/*ၶုၼ်$ ^ၽ/ၽ<qst>$ ^ီ/*ီ$ ^တူၼ်ႈ/တူၼ်ႈ<clf>/တူၼ်ႈ<n>$ ^မႆႉ/*မႆႉ$ ^./.<sent>$

Gods of trees

temp

TOP UNKNOWN WORDS: │

 11793 ^ဝႆႉ/*ဝႆႉ$                                                           │
 10302 ^ပဵၼ်/*ပဵၼ်$                                                           │
  6750 ^လႄႈ/*လႄႈ$                                                         │
  6681 ^ဢၼ်/*ဢၼ်$                                                           │
  6170 ^ၵူၼ်း/*ၵူၼ်း$                                                         │
  5676 ^ဝၢၼ်ႈ/*ဝၢၼ်ႈ$                                                       │
  5123 ^သဝ်း/*သဝ်း$                                                         │
  4937 ^း/*း$                                                             │
  4859 ^ႁိူၼ်း/*ႁိူၼ်း$                                                         │
  4652 ^ၸၢႆး/*ၸၢႆး$                                                         │
  4645 ^ၵေႃႈ/*ၵေႃႈ$                                                       │
  4632 ^လူၺ်ႈ/*လူၺ်ႈ$                                                         │
  4625 ^သဵၼ်ႈမၢႆ/*သဵၼ်ႈမၢႆ$                                                     │
  4620 ^ႁူမ်ႈ/*ႁူမ်ႈ$                                                         │
  4505 ^တိူင်းတႃႈလိူဝ်ႇ/*တိူင်းတႃႈလိူဝ်ႇ$                                             │
  4466 ^ပီ/*ပီ$                                                             │
  4416 ^ယိင်း/*ယိင်း$                                                         │
  4406 ^ၶူတ်ႉဢွင်ႈ/*ၶူတ်ႉဢွင်ႈ$                                                   │
  4064 ^ႇ/*ႇ$                                                             │
  3919 ^ၾ/*ၾ$                                                             │

coverage: 1078915 / 1743796 (~0.61871629479595090251) │ remaining unknown forms: 664881 │ ambiguity: 2052616 / 1743796 (~1.17709640347838852710) │ shn.wikipediadump Thu Mar 16 10:45:26 AM EDT 2023 1078915/1743796 ~0.│ 61871629479595090251 \| 2052616/1743796 ~1.17709640347838852710