Difference between revisions of "Amis/Disambiguation"
From LING073
| Line 1: | Line 1: | ||
==initial evaluation of ambiguity== | ==initial evaluation of ambiguity== | ||
| − | to remove weird characters from tests, run with options like this: | + | to remove weird characters from tests, run with options like this: <br> |
cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l | cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l | ||
| Line 6: | Line 6: | ||
The number of unique forms is 6273. | The number of unique forms is 6273. | ||
| − | The comparison: | + | The comparison: <br> |
| − | |||
40,41d39 <br> | 40,41d39 <br> | ||
< ako <br> | < ako <br> | ||
Revision as of 14:47, 16 March 2023
initial evaluation of ambiguity
to remove weird characters from tests, run with options like this:
cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l
The number of all forms is 6283. The number of unique forms is 6273.
The comparison:
40,41d39
< ako
< aku
68d65
< iso
70,71d66
< isu
< ita
4827,4828d4821
< nami
< namo
4831,4832d4823
< namu
< nangra
5020d5010
< ningra
