Difference between revisions of "Dhivehi/Transducer"

From LING073
Jump to: navigation, search
(→‎Notes)
(→‎Adding Unknown Words)
Line 55: Line 55:
 
By adding unknown words {{morphTest|އަދި{{tag|cnjcoo}}|އަދި}}, {{morphTest|ނުވަތަ{{tag|cnjcoo}}|ނުވަތަ}}, and {{morphTest|ހަމަ{{tag|adj}}|ހަމަ}}, the coverage went from 2.32% to 6.62%.
 
By adding unknown words {{morphTest|އަދި{{tag|cnjcoo}}|އަދި}}, {{morphTest|ނުވަތަ{{tag|cnjcoo}}|ނުވަތަ}}, and {{morphTest|ހަމަ{{tag|adj}}|ހަމަ}}, the coverage went from 2.32% to 6.62%.
  
−
By adding unknown word {{morphTest|މާއްދާ{{tag|n}}{{tag|sg}}|މާއްދާ}}, the coverage went from 6.62% to 7.66%.
+
By adding unknown word {{morphTest|މާއްދާ{{tag|n}}{{tag|sg}}|މާއްދާ}}, the coverage went from 6.62% to 7.90%.
  
 
== Genarator Evaluation ==
 
== Genarator Evaluation ==

Revision as of 05:01, 6 March 2019

Analyzer Evaluation

  • div.yaml: 155/265 of tests passed
  • Number of Stems: 56

Top Unknown Words

Word Occurrences Gloss Tags
އަދި 50 "and" އަދި<cnjcoo> ↔ އަދި
ނުވަތަ 47 "or" ނުވަތަ<cnjcoo> ↔ ނުވަތަ
ޙައްޤު 39 ޙައްޤު<unk> ↔ ޙައްޤު
ކޮންމެ 32 <unk> ↔ ކޮންމެ
ލިބިގެންވެއެވެ 30 <unk> ↔ ލިބިގެންވެއެވެ
ވަނަ 30 suffix "-vana" (-th) ordinal <unk> ↔ ވަނަ
މާތްﷲ 30 <unk> ↔ މާތްﷲ
މާއްދާ 29 "article" މާއްދާ<n><nHum><sg><def><dir> ↔ މާއްދާ
މީހަކަށްމެ 28 <unk> ↔ މީހަކަށްމެ
ހަމަ 25 "just" ހަމަ<adj> ↔ ހަމަ
ދެން 24 <unk> ↔ ދެން
އެއްވެސް 20 <unk> ↔ އެއްވެސް
ހުރިހާ 16 <unk> ↔ ހުރިހާ
ލިބިގަތުމުގެ 14 <unk> ↔ ލިބިގަތުމުގެ
ނުވާނެއެވެ 14 <unk> ↔ ނުވާނެއެވެ
އެއީ 14 <unk> ↔ އެއީ
އޭނާގެ 14 <unk> ↔ އޭނާގެ

Notes

The tests that still don't work are:

  1. We're not sure how to deal with the "+".

Adding Unknown Words

By adding unknown words އަދި<cnjcoo> ↔ އަދި, ނުވަތަ<cnjcoo> ↔ ނުވަތަ, and ހަމަ<adj> ↔ ހަމަ, the coverage went from 2.32% to 6.62%.

By adding unknown word މާއްދާ<n><sg> ↔ މާއްދާ, the coverage went from 6.62% to 7.90%.

Genarator Evaluation

Initial Evaluation of Morphological Generation

  • Current number of tests passed (div.yaml): 155/265
  • Current corpus coverage (div.corpus.basic.txt): 7.66%

Final Evaluation of Morphological Generation

Github

Dhivehi Transducer