Difference between revisions of "Guarani/Transducer"
| Line 1: | Line 1: | ||
Transducer for Guarani (Work in progress). | Transducer for Guarani (Work in progress). | ||
| − | = | + | =Analyzer= |
==Evaluation== | ==Evaluation== | ||
The current corpus coverage is 2.85% (out of 1016 tokenized words in the corpus). | The current corpus coverage is 2.85% (out of 1016 tokenized words in the corpus). | ||
| Line 81: | Line 81: | ||
The total number of stems in the transducer so far is 30. | The total number of stems in the transducer so far is 30. | ||
| − | + | ==Tests== | |
For the main yaml file, 43/82 tests are passing. | For the main yaml file, 43/82 tests are passing. | ||
For the common words yaml file, 2/20 are passing. | For the common words yaml file, 2/20 are passing. | ||
| + | |||
| + | |||
| + | =Generator= | ||
| + | ==Initial Evaluation== | ||
| + | For the analyzer there are 43 tests passing and 39 tests failing (82 total). The current corpus coverage is 8.46%. | ||
| + | For the generator there are 43 tests passing and 73 tests failing (116 total). | ||
=Notes= | =Notes= | ||
Revision as of 16:50, 21 February 2017
Transducer for Guarani (Work in progress).
Analyzer
Evaluation
The current corpus coverage is 2.85% (out of 1016 tokenized words in the corpus).
The most missed words were:
| Word | Occurences |
|---|---|
| ha | 44 |
| a | 43 |
| va | 41 |
| pe | 27 |
| i | 25 |
| e | 20 |
| m | 18 |
| ra | 17 |
| ta | 10 |
| o | 10 |
| guarani | 9 |
| up | 9 |
| ñe | 9 |
| yvy | 9 |
| y | 9 |
| icha | 9 |
| me | 8 |
| rã | 7 |
| Tupã | 7 |
| t | 7 |
I added tags and analysis for Tupã (God) and for ha (and) so the test passes for all of them. With doing this, coverage went up to 8.46%.
- Tupã<n><sg> ↔ Tupã
- ha<conj> ↔ ha
I also added tags for guarani (Guarani), but did not add it to the lexc file.
The total number of stems in the transducer so far is 30.
Tests
For the main yaml file, 43/82 tests are passing.
For the common words yaml file, 2/20 are passing.
Generator
Initial Evaluation
For the analyzer there are 43 tests passing and 39 tests failing (82 total). The current corpus coverage is 8.46%. For the generator there are 43 tests passing and 73 tests failing (116 total).
Notes
Links
The transducer is available on Github.
