Difference between revisions of "Shan/Disambiguation"
(→Initial Evaluation) |
(→Initial Evaluation) |
||
| Line 17: | Line 17: | ||
Gods of trees | Gods of trees | ||
| + | |||
| + | |||
| + | ==temp== | ||
| + | TOP UNKNOWN WORDS: │ | ||
| + | 11793 ^ဝႆႉ/*ဝႆႉ$ │ | ||
| + | 10302 ^ပဵၼ်/*ပဵၼ်$ │ | ||
| + | 6750 ^လႄႈ/*လႄႈ$ │ | ||
| + | 6681 ^ဢၼ်/*ဢၼ်$ │ | ||
| + | 6170 ^ၵူၼ်း/*ၵူၼ်း$ │ | ||
| + | 5676 ^ဝၢၼ်ႈ/*ဝၢၼ်ႈ$ │ | ||
| + | 5123 ^သဝ်း/*သဝ်း$ │ | ||
| + | 4937 ^း/*း$ │ | ||
| + | 4859 ^ႁိူၼ်း/*ႁိူၼ်း$ │ | ||
| + | 4652 ^ၸၢႆး/*ၸၢႆး$ │ | ||
| + | 4645 ^ၵေႃႈ/*ၵေႃႈ$ │ | ||
| + | 4632 ^လူၺ်ႈ/*လူၺ်ႈ$ │ | ||
| + | 4625 ^သဵၼ်ႈမၢႆ/*သဵၼ်ႈမၢႆ$ │ | ||
| + | 4620 ^ႁူမ်ႈ/*ႁူမ်ႈ$ │ | ||
| + | 4505 ^တိူင်းတႃႈလိူဝ်ႇ/*တိူင်းတႃႈလိူဝ်ႇ$ │ | ||
| + | 4466 ^ပီ/*ပီ$ │ | ||
| + | 4416 ^ယိင်း/*ယိင်း$ │ | ||
| + | 4406 ^ၶူတ်ႉဢွင်ႈ/*ၶူတ်ႉဢွင်ႈ$ │ | ||
| + | 4064 ^ႇ/*ႇ$ │ | ||
| + | 3919 ^ၾ/*ၾ$ │ | ||
| + | coverage: 1078915 / 1743796 (~0.61871629479595090251) │ | ||
| + | remaining unknown forms: 664881 │ | ||
| + | ambiguity: 2052616 / 1743796 (~1.17709640347838852710) │ | ||
| + | shn.wikipediadump Thu Mar 16 10:45:26 AM EDT 2023 1078915/1743796 ~0.│ | ||
| + | 61871629479595090251 \| 2052616/1743796 ~1.17709640347838852710 | ||
Revision as of 14:48, 16 March 2023
Initial Evaluation
In the last coverage test of a large file, the ambiguity was 1673470 / 1486937 (~1.12)
So there are some ambiguity in the transducer.
Example:
ၵဝ် ၽုၵ်ႇ ၵုၺ်တူၼ်ႈၼိုင်ႈ
I plant one cotton plant
^ၵဝ်/ၵဝ်<prn><person><p1><sg>$ ^ၽ/ၽ<qst>$ ^ုၵ်ႇ/*ုၵ်ႇ$ ^ၵုၺ်/*ၵုၺ်$ ^တူၼ်ႈ/တူၼ်ႈ<clf>/တူၼ်ႈ<n>$ ^ၼိုင်ႈ/ၼိုင်ႈ<num>$ ^./.<sent>$
ၶုၼ်ၽီတူၼ်ႈမႆႉ
^ၶုၼ်/*ၶုၼ်$ ^ၽ/ၽ<qst>$ ^ီ/*ီ$ ^တူၼ်ႈ/တူၼ်ႈ<clf>/တူၼ်ႈ<n>$ ^မႆႉ/*မႆႉ$ ^./.<sent>$
Gods of trees
temp
TOP UNKNOWN WORDS: │
11793 ^ဝႆႉ/*ဝႆႉ$ │ 10302 ^ပဵၼ်/*ပဵၼ်$ │ 6750 ^လႄႈ/*လႄႈ$ │ 6681 ^ဢၼ်/*ဢၼ်$ │ 6170 ^ၵူၼ်း/*ၵူၼ်း$ │ 5676 ^ဝၢၼ်ႈ/*ဝၢၼ်ႈ$ │ 5123 ^သဝ်း/*သဝ်း$ │ 4937 ^း/*း$ │ 4859 ^ႁိူၼ်း/*ႁိူၼ်း$ │ 4652 ^ၸၢႆး/*ၸၢႆး$ │ 4645 ^ၵေႃႈ/*ၵေႃႈ$ │ 4632 ^လူၺ်ႈ/*လူၺ်ႈ$ │ 4625 ^သဵၼ်ႈမၢႆ/*သဵၼ်ႈမၢႆ$ │ 4620 ^ႁူမ်ႈ/*ႁူမ်ႈ$ │ 4505 ^တိူင်းတႃႈလိူဝ်ႇ/*တိူင်းတႃႈလိူဝ်ႇ$ │ 4466 ^ပီ/*ပီ$ │ 4416 ^ယိင်း/*ယိင်း$ │ 4406 ^ၶူတ်ႉဢွင်ႈ/*ၶူတ်ႉဢွင်ႈ$ │ 4064 ^ႇ/*ႇ$ │ 3919 ^ၾ/*ၾ$ │
coverage: 1078915 / 1743796 (~0.61871629479595090251) │ remaining unknown forms: 664881 │ ambiguity: 2052616 / 1743796 (~1.17709640347838852710) │ shn.wikipediadump Thu Mar 16 10:45:26 AM EDT 2023 1078915/1743796 ~0.│ 61871629479595090251 \| 2052616/1743796 ~1.17709640347838852710