Difference between revisions of "Amis/Disambiguation"
From LING073
| Line 1: | Line 1: | ||
==initial evaluation of ambiguity== | ==initial evaluation of ambiguity== | ||
| − | to remove weird characters from tests, run like this: | + | to remove weird characters from tests, run with options like this: |
cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l | cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l | ||
| + | The number of all forms is 6283. | ||
| + | The number of unique forms is 6273. | ||
| + | |||
| + | The comparison: | ||
| + | |||
| + | 40,41d39 | ||
| + | < ako | ||
| + | < aku | ||
| + | 68d65 | ||
| + | < iso | ||
| + | 70,71d66 | ||
| + | < isu | ||
| + | < ita | ||
| + | 4827,4828d4821 | ||
| + | < nami | ||
| + | < namo | ||
| + | 4831,4832d4823 | ||
| + | < namu | ||
| + | < nangra | ||
| + | 5020d5010 | ||
| + | < ningra | ||
Revision as of 14:45, 16 March 2023
initial evaluation of ambiguity
to remove weird characters from tests, run with options like this: cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l
The number of all forms is 6283. The number of unique forms is 6273.
The comparison:
40,41d39 < ako < aku 68d65 < iso 70,71d66 < isu < ita 4827,4828d4821 < nami < namo 4831,4832d4823 < namu < nangra 5020d5010 < ningra
