Dhivehi/Transducer

Analyzer Evaluation

• div.yaml: 104/124 of tests passed
• Number of Stems:

Top Unknown Words

Word	Occurrences	Gloss	Tags
ައް	65		<unk> ↔ ައް
އަދި	50	"and"	އަދި<cnjcoo> ↔ އަދި
ނުވަތަ	47	"or"	ނުވަތަ<cnjcoo> ↔ ނުވަތަ
ު	39		<unk> ↔ ު
ކޮންމެ	32		<unk> ↔ ކޮންމެ
ލިބިގެންވެއެވެ	30		<unk> ↔ ލިބިގެންވެއެވެ
ވަނަ	30	suffix "-vana" (-th) ordinal	<unk> ↔ ވަނަ
މާއްދާ	29	"article"	މާއްދާ<n><sg> ↔ މާއްދާ
މީހަކަށްމެ	28		<unk> ↔ މީހަކަށްމެ
ހަމަ	25	"just"	ހަމަ<adj> ↔ ހަމަ
ދެން	24		<unk> ↔ ދެން
އެއްވެސް	20		<unk> ↔ އެއްވެސް
ހުރިހާ	16		<unk> ↔ ހުރިހާ
އެ	16		<unk> ↔ އެ
ލިބިގަތުމުގެ	14		<unk> ↔ ލިބިގަތުމުގެ
ނުވާނެއެވެ	14		<unk> ↔ ނުވާނެއެވެ
އެއީ	14		<unk> ↔ އެއީ
އޭނާގެ	14		<unk> ↔ އޭނާގެ
ތަ	14		<unk> ↔ ތަ

Notes

The tests that still don't work are:

1. We're not sure how to deal with the "+".

Adding Unknown Words

By adding unknown words އަދި<cnjcoo> ↔ އަދި, ނުވަތަ<cnjcoo> ↔ ނުވަތަ, and ހަމަ<adj> ↔ ހަމަ, the coverage went from 2.32% to 6.62%.

By adding unknown word މާއްދާ<n><sg> ↔ މާއްދާ, the coverage went from 6.62% to 7.66%.

Genarator Evaluation

Initial Evaluation of Morphological Generation

• Current number of tests passed (div.yaml): 104/124
• Current corpus coverage (div.corpus.basic.txt): 7.66%

Github

Dhivehi Transducer