Difference between revisions of "Shan/Disambiguation"

From LING073
Jump to: navigation, search
(→‎Initial Evaluation)
 
(9 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 
==Initial Evaluation==
 
==Initial Evaluation==
−
In the last coverage test of a large file, the ambiguity was 1673470 / 1486937 (~1.12)
+
In the last coverage test of a large file, the ambiguity was 2052616 / 1743796 (~1.177)
  
 
So there are some ambiguity in the transducer.
 
So there are some ambiguity in the transducer.
  
−
Example:
+
===Example===
  
 
'''ၵဝ် ၽုၵ်ႇ ၵုၺ်တူၼ်ႈၼိုင်ႈ'''
 
'''ၵဝ် ၽုၵ်ႇ ၵုၺ်တူၼ်ႈၼိုင်ႈ'''
Line 18: Line 18:
 
Gods of trees
 
Gods of trees
  
−
==temp==
+
The word တူၼ်ႈ means tree or trunk and can both mean a tree or it can be a classifier used for trees and plants. So to reduce the ambiguity in situations like this, we created a select rule where if there were numerals <num> right before or after a noun/classifier, then it is a classifer and not a noun.
−
TOP UNKNOWN WORDS:                                                        │
+
 
−
  11793 ^ဝႆႉ/*ဝႆႉ$                                                          │
+
==Final Evaluation==
−
  10302 ^ပဵၼ်/*ပဵၼ်$                                                          │
+
The final ambiguity of the large corpus was 1924881 / 1743796 (~1.10384528924254901376)
−
  6750 ^လႄႈ/*လႄႈ$                                                        │
+
 
−
  6681 ^ဢၼ်/*ဢၼ်$                                                          │
+
[[Category:Sp23_Disambiguation]][[Category:Shan]]
−
  6170 ^ၵူၼ်း/*ၵူၼ်း$                                                        │
 
−
  5676 ^ဝၢၼ်ႈ/*ဝၢၼ်ႈ$                                                      │
 
−
  5123 ^သဝ်း/*သဝ်း$                                                        │
 
−
  4937 ^း/*း$                                                            │
 
−
  4859 ^ႁိူၼ်း/*ႁိူၼ်း$                                                        │
 
−
  4652 ^ၸၢႆး/*ၸၢႆး$                                                        │
 
−
  4645 ^ၵေႃႈ/*ၵေႃႈ$                                                      │
 
−
  4632 ^လူၺ်ႈ/*လူၺ်ႈ$                                                        │
 
−
  4625 ^သဵၼ်ႈမၢႆ/*သဵၼ်ႈမၢႆ$                                                    │
 
−
  4620 ^ႁူမ်ႈ/*ႁူမ်ႈ$                                                        │
 
−
  4505 ^တိူင်းတႃႈလိူဝ်ႇ/*တိူင်းတႃႈလိူဝ်ႇ$                                            │
 
−
  4466 ^ပီ/*ပီ$                                                            │
 
−
  4416 ^ယိင်း/*ယိင်း$                                                        │
 
−
  4406 ^ၶူတ်ႉဢွင်ႈ/*ၶူတ်ႉဢွင်ႈ$                                                  │
 
−
  4064 ^ႇ/*ႇ$                                                            │
 
−
  3919 ^ၾ/*ၾ$                                                            │
 
−
coverage: 1078915 / 1743796 (~0.61871629479595090251)                      │
 
−
remaining unknown forms: 664881                                            │
 
−
ambiguity: 2052616 / 1743796 (~1.17709640347838852710)                     │
 
−
shn.wikipediadump Thu Mar 16 10:45:26 AM EDT 2023      1078915/1743796 ~0.│
 
−
61871629479595090251 \|      2052616/1743796 ~1.17709640347838852710
 

Latest revision as of 14:49, 31 March 2023

Initial Evaluation

In the last coverage test of a large file, the ambiguity was 2052616 / 1743796 (~1.177)

So there are some ambiguity in the transducer.

Example

ၵဝ် ၽုၵ်ႇ ၵုၺ်တူၼ်ႈၼိုင်ႈ

I plant one cotton plant

^ၵဝ်/ၵဝ်<prn><person><p1><sg>$ ^ၽ/ၽ<qst>$ ^ုၵ်ႇ/*ုၵ်ႇ$ ^ၵုၺ်/*ၵုၺ်$ ^တူၼ်ႈ/တူၼ်ႈ<clf>/တူၼ်ႈ<n>$ ^ၼိုင်ႈ/ၼိုင်ႈ<num>$ ^./.<sent>$

ၶုၼ်ၽီတူၼ်ႈမႆႉ

^ၶုၼ်/*ၶုၼ်$ ^ၽ/ၽ<qst>$ ^ီ/*ီ$ ^တူၼ်ႈ/တူၼ်ႈ<clf>/တူၼ်ႈ<n>$ ^မႆႉ/*မႆႉ$ ^./.<sent>$

Gods of trees

The word တူၼ်ႈ means tree or trunk and can both mean a tree or it can be a classifier used for trees and plants. So to reduce the ambiguity in situations like this, we created a select rule where if there were numerals <num> right before or after a noun/classifier, then it is a classifer and not a noun.

Final Evaluation

The final ambiguity of the large corpus was 1924881 / 1743796 (~1.10384528924254901376)