Difference between revisions of "Dhivehi/Transducer"

From LING073
Jump to: navigation, search
(→‎Initial Evaluation of Morphological Generation)
(→‎Top Unknown Words)
Line 9: Line 9:
 
{|class="wikitable"
 
{|class="wikitable"
 
!Word !! Occurrences !! Gloss !! Tags  
 
!Word !! Occurrences !! Gloss !! Tags  
−
|-
 
−
|  ައް || 65 ||  || {{morphTest|{{tag|unk}}| ައް}}
 
 
|-  
 
|-  
 
| އަދި || 50 || "and" || {{morphTest|އަދި{{tag|cnjcoo}}|އަދި}}
 
| އަދި || 50 || "and" || {{morphTest|އަދި{{tag|cnjcoo}}|އަދި}}
Line 16: Line 14:
 
| ނުވަތަ || 47 || "or" || {{morphTest|ނުވަތަ{{tag|cnjcoo}}|ނުވަތަ}}
 
| ނުވަތަ || 47 || "or" || {{morphTest|ނުވަތަ{{tag|cnjcoo}}|ނުވަތަ}}
 
|-  
 
|-  
−
| ު || 39 || || {{morphTest|{{tag|unk}}| ު}}
+
| 39 || ޙައްޤު  ||     || {{morphTest|ޙައްޤު{{tag|unk}}|ޙައްޤު}}
 
|-
 
|-
 
| ކޮންމެ || 32 ||  || {{morphTest|{{tag|unk}}|ކޮންމެ}}
 
| ކޮންމެ || 32 ||  || {{morphTest|{{tag|unk}}|ކޮންމެ}}
Line 23: Line 21:
 
|-
 
|-
 
| ވަނަ || 30 || suffix "-vana" (-th) ordinal || {{morphTest|{{tag|unk}}|ވަނަ}}
 
| ވަނަ || 30 || suffix "-vana" (-th) ordinal || {{morphTest|{{tag|unk}}|ވަނަ}}
 +
|-
 +
| މާތްﷲ || 30 ||  || {{morphTest|މާތްﷲ{{tag|unk}}|މާތްﷲ}}
 
|-
 
|-
 
| މާއްދާ || 29 || "article" || {{morphTest|މާއްދާ{{tag|n}}{{tag|sg}}|މާއްދާ}}
 
| މާއްދާ || 29 || "article" || {{morphTest|މާއްދާ{{tag|n}}{{tag|sg}}|މާއްދާ}}
Line 35: Line 35:
 
|-
 
|-
 
| ހުރިހާ || 16 ||  || {{morphTest|{{tag|unk}}|ހުރިހާ}}
 
| ހުރިހާ || 16 ||  || {{morphTest|{{tag|unk}}|ހުރިހާ}}
−
|-
 
−
| އެ || 16 ||  || {{morphTest|{{tag|unk}}|އެ}}
 
 
|-
 
|-
 
| ލިބިގަތުމުގެ || 14 ||  || {{morphTest|{{tag|unk}}|ލިބިގަތުމުގެ}}
 
| ލިބިގަތުމުގެ || 14 ||  || {{morphTest|{{tag|unk}}|ލިބިގަތުމުގެ}}
Line 45: Line 43:
 
|-
 
|-
 
| އޭނާގެ || 14 ||  || {{morphTest|{{tag|unk}}|އޭނާގެ}}
 
| އޭނާގެ || 14 ||  || {{morphTest|{{tag|unk}}|އޭނާގެ}}
−
|-
 
−
| ތަ || 14 ||  || {{morphTest|{{tag|unk}}|ތަ}}
 
 
|}
 
|}
  

Revision as of 04:57, 6 March 2019

Analyzer Evaluation

  • div.yaml: 155/265 of tests passed
  • Number of Stems: 56

Top Unknown Words

Word Occurrences Gloss Tags
އަދި 50 "and" އަދި<cnjcoo> ↔ އަދި
ނުވަތަ 47 "or" ނުވަތަ<cnjcoo> ↔ ނުވަތަ
39 ޙައްޤު ޙައްޤު<unk> ↔ ޙައްޤު
ކޮންމެ 32 <unk> ↔ ކޮންމެ
ލިބިގެންވެއެވެ 30 <unk> ↔ ލިބިގެންވެއެވެ
ވަނަ 30 suffix "-vana" (-th) ordinal <unk> ↔ ވަނަ
މާތްﷲ 30 މާތްﷲ<unk> ↔ މާތްﷲ
މާއްދާ 29 "article" މާއްދާ<n><sg> ↔ މާއްދާ
މީހަކަށްމެ 28 <unk> ↔ މީހަކަށްމެ
ހަމަ 25 "just" ހަމަ<adj> ↔ ހަމަ
ދެން 24 <unk> ↔ ދެން
އެއްވެސް 20 <unk> ↔ އެއްވެސް
ހުރިހާ 16 <unk> ↔ ހުރިހާ
ލިބިގަތުމުގެ 14 <unk> ↔ ލިބިގަތުމުގެ
ނުވާނެއެވެ 14 <unk> ↔ ނުވާނެއެވެ
އެއީ 14 <unk> ↔ އެއީ
އޭނާގެ 14 <unk> ↔ އޭނާގެ

Notes

The tests that still don't work are:

  1. We're not sure how to deal with the "+".


Adding Unknown Words

By adding unknown words އަދި<cnjcoo> ↔ އަދި, ނުވަތަ<cnjcoo> ↔ ނުވަތަ, and ހަމަ<adj> ↔ ހަމަ, the coverage went from 2.32% to 6.62%.

By adding unknown word މާއްދާ<n><sg> ↔ މާއްދާ, the coverage went from 6.62% to 7.66%.

Genarator Evaluation

Initial Evaluation of Morphological Generation

  • Current number of tests passed (div.yaml): 155/265
  • Current corpus coverage (div.corpus.basic.txt): 7.66%

Final Evaluation of Morphological Generation

Github

Dhivehi Transducer