Difference between revisions of "Rungus/Transducer"
From LING073
(→Final Evaluation of Morphological Generation) |
|||
| (2 intermediate revisions by 2 users not shown) | |||
| Line 2: | Line 2: | ||
=Evaluation= | =Evaluation= | ||
| + | {{comment|Looks great! I would just make this heading "Analyser Evaluation" for clarity | ||
| + | |||
| + | --Keira}} | ||
Number of Stems: 100 | Number of Stems: 100 | ||
| Line 38: | Line 41: | ||
Current Gold Matches for Generation Tests: <code>apertium-regtest test -c .-gen</code> | Current Gold Matches for Generation Tests: <code>apertium-regtest test -c .-gen</code> | ||
*Intransitive Prefixes: 3/6 (50.0%) match gold | *Intransitive Prefixes: 3/6 (50.0%) match gold | ||
| + | *Transitive Prefixes: 0/23 (0.0%) match gold | ||
*Pluralizing Nouns: 0/6 (0.0%) match gold | *Pluralizing Nouns: 0/6 (0.0%) match gold | ||
*Collectivizing Nouns: 0/3 (0.0%) match gold | *Collectivizing Nouns: 0/3 (0.0%) match gold | ||
| Line 46: | Line 50: | ||
*Reduplication: 0/6 (0.0%) match gold | *Reduplication: 0/6 (0.0%) match gold | ||
*Enclitics: 0/9 (0.0%) match gold | *Enclitics: 0/9 (0.0%) match gold | ||
| − | |||
==Final Evaluation of Morphological Generation== | ==Final Evaluation of Morphological Generation== | ||
| − | |||
| − | |||
After adding the morphological generator, 85 tests pass and 9 tests fail (90.4% pass, 9.6% fail). | After adding the morphological generator, 85 tests pass and 9 tests fail (90.4% pass, 9.6% fail). | ||
| Line 57: | Line 58: | ||
Our new coverage is: 439 / 1226 (~35.8075%) | Our new coverage is: 439 / 1226 (~35.8075%) | ||
*Command: <code>coverage-hfst drg.corpus.basic.txt drg.automorf.hfst</code> | *Command: <code>coverage-hfst drg.corpus.basic.txt drg.automorf.hfst</code> | ||
| + | |||
| + | New Gold Matches for Generation Test: <code>apertium-regtest test -c .-gen</code> | ||
| + | *Intransitive Prefixes: 3/6 (50.0%) match gold | ||
| + | *Transitive Prefixes: 22/23 (95.65%) match gold | ||
| + | *Pluralizing Nouns: 6/6 (100.0%) match gold | ||
| + | *Collectivizing Nouns: 3/3 (100.0%) match gold | ||
| + | *Personal Pronouns: 10/16 (62.5%) match gold | ||
| + | *Demonstrative Determiners: 6/6 (100.0%) match gold | ||
| + | *Demonstrative Pronouns: 12/13 (92.31%) match gold | ||
| + | *Contractions: 0/6 (0.0%) match gold | ||
| + | *Reduplication: 0/6 (0.0%) match gold | ||
| + | *Enclitics: 0/9 (0.0%) match gold | ||
[[Category:Rungus]] | [[Category:Rungus]] | ||
[[Category:Sp25 Transducers]] | [[Category:Sp25 Transducers]] | ||
Latest revision as of 16:07, 1 May 2025
GitHub [1]
Contents
Evaluation
Looks great! I would just make this heading "Analyser Evaluation" for clarity
--Keira
Number of Stems: 100
Coverage: 416/1226 (~33.9314%)
Current List of Unknown Words:
- ong
- no
- di
- tu
- om
- nu
- ogi
- ku
- oku
- an
- amu
- dau
- savo
- po
- ko
- agai
- dikou
- Amu
- vokon
All tests in each of the corpus pass (I think?), but not many match gold. In fact, only 29 of them match gold.
Generator Evaluation
Initial Evaluation of Morphological Generation
I believe all tests passed initially.
Current Coverage: 416 / 1226 (~33.9148%)
- Command:
coverage-hfst drg.corpus.basic.txt drg.automorf.hfst
Current Gold Matches for Generation Tests: apertium-regtest test -c .-gen
- Intransitive Prefixes: 3/6 (50.0%) match gold
- Transitive Prefixes: 0/23 (0.0%) match gold
- Pluralizing Nouns: 0/6 (0.0%) match gold
- Collectivizing Nouns: 0/3 (0.0%) match gold
- Personal Pronouns: 8/16 (50.0%) match gold
- Demonstrative Determiners: 6/6 (100.0%) match gold
- Demonstrative Pronouns: 12/13 (92.31%) match gold
- Contractions: 0/6 (0.0%) match gold
- Reduplication: 0/6 (0.0%) match gold
- Enclitics: 0/9 (0.0%) match gold
Final Evaluation of Morphological Generation
After adding the morphological generator, 85 tests pass and 9 tests fail (90.4% pass, 9.6% fail).
We previously did not have any twol rules. After adding the morphological generator, we have 14 twol rules.
Our new coverage is: 439 / 1226 (~35.8075%)
- Command:
coverage-hfst drg.corpus.basic.txt drg.automorf.hfst
New Gold Matches for Generation Test: apertium-regtest test -c .-gen
- Intransitive Prefixes: 3/6 (50.0%) match gold
- Transitive Prefixes: 22/23 (95.65%) match gold
- Pluralizing Nouns: 6/6 (100.0%) match gold
- Collectivizing Nouns: 3/3 (100.0%) match gold
- Personal Pronouns: 10/16 (62.5%) match gold
- Demonstrative Determiners: 6/6 (100.0%) match gold
- Demonstrative Pronouns: 12/13 (92.31%) match gold
- Contractions: 0/6 (0.0%) match gold
- Reduplication: 0/6 (0.0%) match gold
- Enclitics: 0/9 (0.0%) match gold
