Dhivehi/Transducer

From LING073
Revision as of 04:57, 6 March 2019 by Xluo1 (talk | contribs) (→‎Top Unknown Words)

Jump to: navigation, search

Analyzer Evaluation

  • div.yaml: 155/265 of tests passed
  • Number of Stems: 56

Top Unknown Words

Word Occurrences Gloss Tags
އަދި 50 "and" އަދި<cnjcoo> ↔ އަދި
ނުވަތަ 47 "or" ނުވަތަ<cnjcoo> ↔ ނުވަތަ
ޙައްޤު 39 ޙައްޤު<unk> ↔ ޙައްޤު
ކޮންމެ 32 <unk> ↔ ކޮންމެ
ލިބިގެންވެއެވެ 30 <unk> ↔ ލިބިގެންވެއެވެ
ވަނަ 30 suffix "-vana" (-th) ordinal <unk> ↔ ވަނަ
މާތްﷲ 30 މާތްﷲ<unk> ↔ މާތްﷲ
މާއްދާ 29 "article" މާއްދާ<n><sg> ↔ މާއްދާ
މީހަކަށްމެ 28 <unk> ↔ މީހަކަށްމެ
ހަމަ 25 "just" ހަމަ<adj> ↔ ހަމަ
ދެން 24 <unk> ↔ ދެން
އެއްވެސް 20 <unk> ↔ އެއްވެސް
ހުރިހާ 16 <unk> ↔ ހުރިހާ
ލިބިގަތުމުގެ 14 <unk> ↔ ލިބިގަތުމުގެ
ނުވާނެއެވެ 14 <unk> ↔ ނުވާނެއެވެ
އެއީ 14 <unk> ↔ އެއީ
އޭނާގެ 14 <unk> ↔ އޭނާގެ

Notes

The tests that still don't work are:

  1. We're not sure how to deal with the "+".


Adding Unknown Words

By adding unknown words އަދި<cnjcoo> ↔ އަދި, ނުވަތަ<cnjcoo> ↔ ނުވަތަ, and ހަމަ<adj> ↔ ހަމަ, the coverage went from 2.32% to 6.62%.

By adding unknown word މާއްދާ<n><sg> ↔ މާއްދާ, the coverage went from 6.62% to 7.66%.

Genarator Evaluation

Initial Evaluation of Morphological Generation

  • Current number of tests passed (div.yaml): 155/265
  • Current corpus coverage (div.corpus.basic.txt): 7.66%

Final Evaluation of Morphological Generation

Github

Dhivehi Transducer