Difference between revisions of "Magahi/Disambiguation"

From LING073
Jump to: navigation, search
(Initial Evaluation of Ambiguity)
(Initial Evaluation of Ambiguity)
Line 7: Line 7:
 
  hfst-expand mag.automorf.hfst | cut -f1 -d':' | sort -u | wc -l
 
  hfst-expand mag.automorf.hfst | cut -f1 -d':' | sort -u | wc -l
  
Ambiguity of 0.69 (2985/4293).
+
Ambiguity of 1.43 (4293/2985).
  
 
Multiple Analyses:
 
Multiple Analyses:

Revision as of 18:46, 4 April 2021

Initial Evaluation of Ambiguity

Number of all forms: 4293

hfst-expand mag.automorf.hfst | wc -l

Number of unique forms: 2985

hfst-expand mag.automorf.hfst | cut -f1 -d':' | sort -u | wc -l

Ambiguity of 1.43 (4293/2985).

Multiple Analyses:

hfst-expand mag.automorf.hfst | cut -f1 -d':' | sort > /tmp/totalforms
hfst-expand mag.automorf.hfst | cut -f1 -d':' | sort -u > /tmp/uniqforms
diff /tmp/totalforms /tmp/uniqforms