Difference between revisions of "Eastern Burushaski/Transducer"

From LING073
Jump to: navigation, search
 
(8 intermediate revisions by 2 users not shown)
Line 5: Line 5:
 
===initial evaluation of morphological generation===
 
===initial evaluation of morphological generation===
  
−
== Evaluation==
+
*204/232 (88%) analysis forms passing
 +
*176/844 (21%) coverage of corpus
 +
*102/141 (72%) initial generation
 +
*102/116 (88%) generation forms passing
 +
** one twol rule
 +
** coverage has not changed
 +
 
 +
==Analyzer Evaluation==
  
 
Passes 88 tests
 
Passes 88 tests
Line 14: Line 21:
 
!Word !! Occurrences !! Gloss !! Tags  
 
!Word !! Occurrences !! Gloss !! Tags  
 
|-
 
|-
−
| ke || 47 || "and" || {{morphTest|{{tag|unk}}|ke}}
+
| ke || 47 || "and" || {{morphTest|ke{{tag|conj}}|ke}}
 
|-  
 
|-  
 
| ine || 19 || "that" (human) ||{{morphTest|ine{{tag|prn}}{{tag|dem}}{{tag|dst}}{{tag|sg}}{{tag|mf}}|ine}}
 
| ine || 19 || "that" (human) ||{{morphTest|ine{{tag|prn}}{{tag|dem}}{{tag|dst}}{{tag|sg}}{{tag|mf}}|ine}}
 
|-  
 
|-  
−
| kaa || 17 || "with" || {{morphTest|{{tag|unk}}|kaa}}
+
| kaa || 17 || "with" || {{morphTest|kaa{{tag|conj}}|kaa}}
 
|-  
 
|-  
−
| daa || 16 || "and" || {{morphTest|{{tag|unk}}|daa}}
+
| daa || 16 || "and" || {{morphTest|daa{{tag|conj}}|daa}}
 
|-
 
|-
 
| it̪e || 14 || "that" (class y) || {{morphTest|ine{{tag|prn}}{{tag|dem}}{{tag|dst}}{{tag|sg}}{{tag|cly}}|it̪e}}
 
| it̪e || 14 || "that" (class y) || {{morphTest|ine{{tag|prn}}{{tag|dem}}{{tag|dst}}{{tag|sg}}{{tag|cly}}|it̪e}}
Line 30: Line 37:
 
| nuse || 9 ||  || {{morphTest|{{tag|unk}}|nuse}}
 
| nuse || 9 ||  || {{morphTest|{{tag|unk}}|nuse}}
 
|-
 
|-
−
| in || 8 || || {{morphTest|{{tag|unk}}|in}}
+
| in || 8 || "he/she" || {{morphTest|in{{tag|pron}}{{tag|pers}}{{tag|dst}}{{tag|sg}}{{tag|mf}}|in}}
 
|-
 
|-
 
| u || 8 ||  || {{morphTest|{{tag|unk}}|u}}
 
| u || 8 ||  || {{morphTest|{{tag|unk}}|u}}
Line 63: Line 70:
  
  
−
[[Category:Sp18 Transducers]]
+
[[Category:Sp19 Transducers]]
 +
[[Category:Eastern Burushaski]]

Latest revision as of 15:33, 7 March 2019

Code

Repo on github [1]

Generator Evaluation

initial evaluation of morphological generation

  • 204/232 (88%) analysis forms passing
  • 176/844 (21%) coverage of corpus
  • 102/141 (72%) initial generation
  • 102/116 (88%) generation forms passing
    • one twol rule
    • coverage has not changed

Analyzer Evaluation

Passes 88 tests 13% corpus coverage, with 844 tokenised words.

Top Unknown Words

Word Occurrences Gloss Tags
ke 47 "and" ke<conj> ↔ ke
ine 19 "that" (human) ine<prn><dem><dst><sg><mf> ↔ ine
kaa 17 "with" kaa<conj> ↔ kaa
daa 16 "and" daa<conj> ↔ daa
it̪e 14 "that" (class y) ine<prn><dem><dst><sg><cly> ↔ it̪e
inar 12 <unk> ↔ inar
e 10 "me" (abs) a<prn><p1><sg><abs> ↔ e
nuse 9 <unk> ↔ nuse
in 8 "he/she" in<pron><pers><dst><sg><mf> ↔ in
u 8 <unk> ↔ u
besan 7 <unk> ↔ besan
yuu 7 <unk> ↔ yuu
a 7 <unk> ↔ a
t̪ačume 7 <unk> ↔ t̪ačume
aa 6 "me" (erg/gen) a<prn><p1><sg><erg> ↔ aa
ečam 6 <unk> ↔ ečam
but 6 <unk> ↔ but
senasar 6 <unk> ↔ senasar
bas 6 <unk> ↔ bas
ise 6 "that" (class x) ine<prn><dem><dst><sg><clx> ↔ ise

After addition of 3 words from commonwords.yaml, coverage is 21%

Lexccounter: Our corpus contains # stems.

Notes

Tests that currently do not work have not been implemented yet. Implemented tests work, but may need further refinement (archiphonemes added, etc).