Difference between revisions of "Amis/Disambiguation"
(→Sentences: fixed full) |
(→final evaluation of ambiguity) |
||
| Line 47: | Line 47: | ||
[[Category:Amis]][[Category:Sp23_Disambiguation]] | [[Category:Amis]][[Category:Sp23_Disambiguation]] | ||
| + | |||
| + | TOP UNKNOWN WORDS: | ||
| + | 23 ^takowanan/*takowanan$ | ||
| + | 17 ^ato/*ato$ | ||
| + | 16 ^tatiihay/*tatiihay$ | ||
| + | 14 ^Tisowanan/*Tisowanan$ | ||
| + | 11 ^ma/*ma$ | ||
| + | 10 ^mo/*mo$ | ||
| + | 10 ^ka/*ka$ | ||
| + | 10 ^faloco/*faloco$ | ||
| + | 10 ^dmak/*dmak$ | ||
| + | 10 ^an/*an$ | ||
| + | 9 ^sa/*sa$ | ||
| + | 9 ^nika/*nika$ | ||
| + | 9 ^nanay/*nanay$ | ||
| + | 9 ^caay/*caay$ | ||
| + | 8 ^milongoc/*milongoc$ | ||
| + | 8 ^^celay/*celay$ | ||
| + | 7 ^^min/*min$ | ||
| + | 6 ^awaay/*awaay$ | ||
| + | 6 ^ano/*ano$ | ||
| + | 6 ^Nawhani/*Nawhani$ | ||
| + | coverage: 1286 / 2098 (~0.61296472831267874166) | ||
| + | remaining unknown forms: 812 | ||
| + | ambiguity: 2569 / 2098 (~1.22449952335557673975) | ||
| + | ami.corpus Tue Mar 21 11:47:38 AM EDT 2023 1286/2098 ~0.61296472831267874166 \| 2569/2098 ~1.22449952335557673975 | ||
Revision as of 15:48, 21 March 2023
initial evaluation of ambiguity
to remove weird characters from tests, run command line measurements with options like this:
cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l
ex., to get all of the ambiguous analyses do:
cat ami.corpus.basic.txt | apertium-destxt | hfst-proc ./ami.automorf.hfst | apertium-retxt | sed 's/$\W*\^/$\n^/g' | grep '\/.*\/'
The ambiguity of a corpus is the average number of analyses provided per token. Our initial ambiguity is 2066/1941 = 1.064
The number of all forms is 6283. The number of unique forms is 6273.
The comparison:
40,41d39
< ako
< aku
68d65
< iso
70,71d66
< isu
< ita
4827,4828d4821
< nami
< namo
4831,4832d4823
< namu
< nangra
5020d5010
< ningra
Sentences
For genitive vs. possessive disambiguation. Possessive only appears directly after noun marker (<nm>).
- Ulahen namu ku ina namu. (genitive) https://shs.hal.science/halshs-03483275 (p. 39)
- Ngaʼay ho ku namu? (Posessive) Wu Dissertation p.86.
echo "Ulahen namu ku ina namu" | apertium -d. ami-morph
^Ulahen/ulah<v><uv><futi>$ ^namu/amu<prn><pers><pl><p2><gen>/amu<prn><pers><pl><p2><pos>$ ^ku/u<nm><un><nom>$ ^ina/ina<n>$ ^namu/amu<prn><pers><pl><p2><gen>/amu<prn><pers><pl><p2><pos>$
echo "Ngaʼay ho ku namu" | apertium -d. ami-morph
^Ngaʼay/ngaʼay<adj>$ ^ho/ho<asp><impf>$ ^ku/u<nm><un><nom>$ ^namu/amu<prn><pers><pl><p2><pos>/amu<prn><pers><pl><p2><gen>$
final evaluation of ambiguity
TOP UNKNOWN WORDS:
23 ^takowanan/*takowanan$
17 ^ato/*ato$
16 ^tatiihay/*tatiihay$
14 ^Tisowanan/*Tisowanan$
11 ^ma/*ma$
10 ^mo/*mo$
10 ^ka/*ka$
10 ^faloco/*faloco$
10 ^dmak/*dmak$
10 ^an/*an$
9 ^sa/*sa$
9 ^nika/*nika$
9 ^nanay/*nanay$
9 ^caay/*caay$
8 ^milongoc/*milongoc$
8 ^^celay/*celay$
7 ^^min/*min$
6 ^awaay/*awaay$
6 ^ano/*ano$
6 ^Nawhani/*Nawhani$
coverage: 1286 / 2098 (~0.61296472831267874166) remaining unknown forms: 812 ambiguity: 2569 / 2098 (~1.22449952335557673975) ami.corpus Tue Mar 21 11:47:38 AM EDT 2023 1286/2098 ~0.61296472831267874166 \| 2569/2098 ~1.22449952335557673975
