Difference between revisions of "Wolof/Disambiguator"

Revision as of 02:15, 21 March 2023

link to git repo with transducer

Evaluation of disambiguator

• Number of tokens: 7344

(Obtained by running the script below:)

 cat /home/rorlija1/ling073-wol-corpus/wol.corpus.basic.txt | apertium-destxt | lt-proc /home/rorlija1/ling073-wol/wol.automorf.bin | apertium-retxt | sed 's/$\W*\^/$\n^/g' | wc -l

• Total number of analyses: 7722

(Obtained by running the script below:)

 cat /home/rorlija1/ling073-wol-corpus/wol.corpus.basic.txt | apertium-destxt | lt-proc /home/rorlija1/ling073-wol/wol.automorf.bin | apertium-retxt | sed 's/$\W*\^/$\n^/g' | cut -f2- -d'/' | sed 's/\//\n/g' | wc -l

• Total number of analyses after disambiguation: 7716

(Obtained by running the script below:)

 cat /home/rorlija1/ling073-wol-corpus/wol.corpus.basic.txt | apertium-destxt | lt-proc /home/rorlija1/ling073-wol/wol.automorf.bin | apertium-retxt | cg-proc /home/rorlija1/ling073-wol/wol.rlx.bin | sed 's/$\W*\^/$\n^/g' | cut -f2- -d'/' | sed 's/\//\n/g' | wc -l

• Examples:

(1) "lañu ne ci seen xarit" (they said/say to their friend) -> should be seen<p3>

 ^lañu/lañu<prn><pers><p3><pl><ofc>$ ^ne/ne<prep>$ ^ci/ci<prep>$ ^seen/seen<det><pers><p3><sg>/seen<det><pers><p2><sg>$ ^xarit/xarit<n>$^./.<sent>$

(2) "leen ne ci seen xaj" (you (pl) said/say to your dog) -> should be seen<p2>

 ^leen/lañu<prn><pers><p3><pl><obj>/ngeen<prn><pers><p2><pl><obj>$ ^ne/ne<prep>$ ^ci/ci<prep>$ ^seen/seen<det><pers><p3><sg>/seen<det><pers><p2><sg>$ ^xaj/xaj<n>$^./.<sent>$,]