Difference between revisions of "Rungus/Transducer"
From LING073
(Created page with "Category:Rungus Category:Sp25 Transducers") |
|||
| (29 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
| + | GitHub [https://github.swarthmore.edu/Ling073-sp25/ling073-drg/tree/master] | ||
| + | |||
| + | =Evaluation= | ||
| + | {{comment|Looks great! I would just make this heading "Analyser Evaluation" for clarity | ||
| + | |||
| + | --Keira}} | ||
| + | Number of Stems: 100 | ||
| + | |||
| + | Coverage: 416/1226 (~33.9314%) | ||
| + | |||
| + | Current List of Unknown Words: | ||
| + | *ong | ||
| + | *no | ||
| + | *di | ||
| + | *tu | ||
| + | *om | ||
| + | *nu | ||
| + | *ogi | ||
| + | *ku | ||
| + | *oku | ||
| + | *an | ||
| + | *amu | ||
| + | *dau | ||
| + | *savo | ||
| + | *po | ||
| + | *ko | ||
| + | *agai | ||
| + | *dikou | ||
| + | *Amu | ||
| + | *vokon | ||
| + | |||
| + | All tests in each of the corpus pass (I think?), but not many match gold. In fact, only 29 of them match gold. | ||
| + | |||
| + | =Generator Evaluation= | ||
| + | ==Initial Evaluation of Morphological Generation== | ||
| + | I believe all tests passed initially. | ||
| + | |||
| + | Current Coverage: 416 / 1226 (~33.9148%) | ||
| + | *Command: <code>coverage-hfst drg.corpus.basic.txt drg.automorf.hfst</code> | ||
| + | |||
| + | Current Gold Matches for Generation Tests: <code>apertium-regtest test -c .-gen</code> | ||
| + | *Intransitive Prefixes: 3/6 (50.0%) match gold | ||
| + | *Transitive Prefixes: 0/23 (0.0%) match gold | ||
| + | *Pluralizing Nouns: 0/6 (0.0%) match gold | ||
| + | *Collectivizing Nouns: 0/3 (0.0%) match gold | ||
| + | *Personal Pronouns: 8/16 (50.0%) match gold | ||
| + | *Demonstrative Determiners: 6/6 (100.0%) match gold | ||
| + | *Demonstrative Pronouns: 12/13 (92.31%) match gold | ||
| + | *Contractions: 0/6 (0.0%) match gold | ||
| + | *Reduplication: 0/6 (0.0%) match gold | ||
| + | *Enclitics: 0/9 (0.0%) match gold | ||
| + | |||
| + | ==Final Evaluation of Morphological Generation== | ||
| + | After adding the morphological generator, 85 tests pass and 9 tests fail (90.4% pass, 9.6% fail). | ||
| + | |||
| + | We previously did not have any twol rules. After adding the morphological generator, we have 14 twol rules. | ||
| + | |||
| + | Our new coverage is: 439 / 1226 (~35.8075%) | ||
| + | *Command: <code>coverage-hfst drg.corpus.basic.txt drg.automorf.hfst</code> | ||
| + | |||
| + | New Gold Matches for Generation Test: <code>apertium-regtest test -c .-gen</code> | ||
| + | *Intransitive Prefixes: 3/6 (50.0%) match gold | ||
| + | *Transitive Prefixes: 22/23 (95.65%) match gold | ||
| + | *Pluralizing Nouns: 6/6 (100.0%) match gold | ||
| + | *Collectivizing Nouns: 3/3 (100.0%) match gold | ||
| + | *Personal Pronouns: 10/16 (62.5%) match gold | ||
| + | *Demonstrative Determiners: 6/6 (100.0%) match gold | ||
| + | *Demonstrative Pronouns: 12/13 (92.31%) match gold | ||
| + | *Contractions: 0/6 (0.0%) match gold | ||
| + | *Reduplication: 0/6 (0.0%) match gold | ||
| + | *Enclitics: 0/9 (0.0%) match gold | ||
| + | |||
[[Category:Rungus]] | [[Category:Rungus]] | ||
[[Category:Sp25 Transducers]] | [[Category:Sp25 Transducers]] | ||
Latest revision as of 16:07, 1 May 2025
GitHub [1]
Contents
Evaluation
Looks great! I would just make this heading "Analyser Evaluation" for clarity
--Keira
Number of Stems: 100
Coverage: 416/1226 (~33.9314%)
Current List of Unknown Words:
- ong
- no
- di
- tu
- om
- nu
- ogi
- ku
- oku
- an
- amu
- dau
- savo
- po
- ko
- agai
- dikou
- Amu
- vokon
All tests in each of the corpus pass (I think?), but not many match gold. In fact, only 29 of them match gold.
Generator Evaluation
Initial Evaluation of Morphological Generation
I believe all tests passed initially.
Current Coverage: 416 / 1226 (~33.9148%)
- Command:
coverage-hfst drg.corpus.basic.txt drg.automorf.hfst
Current Gold Matches for Generation Tests: apertium-regtest test -c .-gen
- Intransitive Prefixes: 3/6 (50.0%) match gold
- Transitive Prefixes: 0/23 (0.0%) match gold
- Pluralizing Nouns: 0/6 (0.0%) match gold
- Collectivizing Nouns: 0/3 (0.0%) match gold
- Personal Pronouns: 8/16 (50.0%) match gold
- Demonstrative Determiners: 6/6 (100.0%) match gold
- Demonstrative Pronouns: 12/13 (92.31%) match gold
- Contractions: 0/6 (0.0%) match gold
- Reduplication: 0/6 (0.0%) match gold
- Enclitics: 0/9 (0.0%) match gold
Final Evaluation of Morphological Generation
After adding the morphological generator, 85 tests pass and 9 tests fail (90.4% pass, 9.6% fail).
We previously did not have any twol rules. After adding the morphological generator, we have 14 twol rules.
Our new coverage is: 439 / 1226 (~35.8075%)
- Command:
coverage-hfst drg.corpus.basic.txt drg.automorf.hfst
New Gold Matches for Generation Test: apertium-regtest test -c .-gen
- Intransitive Prefixes: 3/6 (50.0%) match gold
- Transitive Prefixes: 22/23 (95.65%) match gold
- Pluralizing Nouns: 6/6 (100.0%) match gold
- Collectivizing Nouns: 3/3 (100.0%) match gold
- Personal Pronouns: 10/16 (62.5%) match gold
- Demonstrative Determiners: 6/6 (100.0%) match gold
- Demonstrative Pronouns: 12/13 (92.31%) match gold
- Contractions: 0/6 (0.0%) match gold
- Reduplication: 0/6 (0.0%) match gold
- Enclitics: 0/9 (0.0%) match gold
