Difference between revisions of "Rungus/Transducer"
From LING073
(→Final Evaluation of Morphological Generation) |
(→Generator Evaluation) |
||
| Line 38: | Line 38: | ||
Current Gold Matches for Generation Tests: <code>apertium-regtest test -c .-gen</code> | Current Gold Matches for Generation Tests: <code>apertium-regtest test -c .-gen</code> | ||
*Intransitive Prefixes: 3/6 (50.0%) match gold | *Intransitive Prefixes: 3/6 (50.0%) match gold | ||
| + | *Transitive Prefixes: 0/23 (0.0%) match gold | ||
*Pluralizing Nouns: 0/6 (0.0%) match gold | *Pluralizing Nouns: 0/6 (0.0%) match gold | ||
*Collectivizing Nouns: 0/3 (0.0%) match gold | *Collectivizing Nouns: 0/3 (0.0%) match gold | ||
| Line 46: | Line 47: | ||
*Reduplication: 0/6 (0.0%) match gold | *Reduplication: 0/6 (0.0%) match gold | ||
*Enclitics: 0/9 (0.0%) match gold | *Enclitics: 0/9 (0.0%) match gold | ||
| − | |||
==Final Evaluation of Morphological Generation== | ==Final Evaluation of Morphological Generation== | ||
| Line 55: | Line 55: | ||
Our new coverage is: 439 / 1226 (~35.8075%) | Our new coverage is: 439 / 1226 (~35.8075%) | ||
*Command: <code>coverage-hfst drg.corpus.basic.txt drg.automorf.hfst</code> | *Command: <code>coverage-hfst drg.corpus.basic.txt drg.automorf.hfst</code> | ||
| + | |||
| + | New Gold Matches for Generation Test: <code>apertium-regtest test -c .-gen</code> | ||
| + | *Intransitive Prefixes: 3/6 (50.0%) match gold | ||
| + | *Transitive Prefixes: 22/23 (95.65%) match gold | ||
| + | *Pluralizing Nouns: 6/6 (100.0%) match gold | ||
| + | *Collectivizing Nouns: 3/3 (100.0%) match gold | ||
| + | *Personal Pronouns: 10/16 (62.5%) match gold | ||
| + | *Demonstrative Determiners: 6/6 (100.0%) match gold | ||
| + | *Demonstrative Pronouns: 12/13 (92.31%) match gold | ||
| + | *Contractions: 0/6 (0.0%) match gold | ||
| + | *Reduplication: 0/6 (0.0%) match gold | ||
| + | *Enclitics: 0/9 (0.0%) match gold | ||
[[Category:Rungus]] | [[Category:Rungus]] | ||
[[Category:Sp25 Transducers]] | [[Category:Sp25 Transducers]] | ||
Revision as of 17:02, 18 March 2025
GitHub [1]
Contents
Evaluation
Number of Stems: 100
Coverage: 416/1226 (~33.9314%)
Current List of Unknown Words:
- ong
- no
- di
- tu
- om
- nu
- ogi
- ku
- oku
- an
- amu
- dau
- savo
- po
- ko
- agai
- dikou
- Amu
- vokon
All tests in each of the corpus pass (I think?), but not many match gold. In fact, only 29 of them match gold.
Generator Evaluation
Initial Evaluation of Morphological Generation
I believe all tests passed initially.
Current Coverage: 416 / 1226 (~33.9148%)
- Command:
coverage-hfst drg.corpus.basic.txt drg.automorf.hfst
Current Gold Matches for Generation Tests: apertium-regtest test -c .-gen
- Intransitive Prefixes: 3/6 (50.0%) match gold
- Transitive Prefixes: 0/23 (0.0%) match gold
- Pluralizing Nouns: 0/6 (0.0%) match gold
- Collectivizing Nouns: 0/3 (0.0%) match gold
- Personal Pronouns: 8/16 (50.0%) match gold
- Demonstrative Determiners: 6/6 (100.0%) match gold
- Demonstrative Pronouns: 12/13 (92.31%) match gold
- Contractions: 0/6 (0.0%) match gold
- Reduplication: 0/6 (0.0%) match gold
- Enclitics: 0/9 (0.0%) match gold
Final Evaluation of Morphological Generation
After adding the morphological generator, 85 tests pass and 9 tests fail (90.4% pass, 9.6% fail).
We previously did not have any twol rules. After adding the morphological generator, we have 14 twol rules.
Our new coverage is: 439 / 1226 (~35.8075%)
- Command:
coverage-hfst drg.corpus.basic.txt drg.automorf.hfst
New Gold Matches for Generation Test: apertium-regtest test -c .-gen
- Intransitive Prefixes: 3/6 (50.0%) match gold
- Transitive Prefixes: 22/23 (95.65%) match gold
- Pluralizing Nouns: 6/6 (100.0%) match gold
- Collectivizing Nouns: 3/3 (100.0%) match gold
- Personal Pronouns: 10/16 (62.5%) match gold
- Demonstrative Determiners: 6/6 (100.0%) match gold
- Demonstrative Pronouns: 12/13 (92.31%) match gold
- Contractions: 0/6 (0.0%) match gold
- Reduplication: 0/6 (0.0%) match gold
- Enclitics: 0/9 (0.0%) match gold
