Difference between revisions of "Kikuyu/Transducer"
(Created page with "The Kikuyu Transducer, in its work-in-progress state, can be found online at [https://github.swarthmore.edu/jmundo1/ling073-kik Swarthmore's Github]. =Evaluation= =Notes=...") |
|||
| Line 2: | Line 2: | ||
=Evaluation= | =Evaluation= | ||
| + | |||
| + | The transducer is currently able to analyze 49.72% of the corpus. | ||
| + | |||
| + | It is very important to note that this numbers may be misleading, since it is possible the transducer is analyzing forms in the corpus incorrectly; given the massive overgeneration of the transducer in its current state it is likely it generates forms for many things, and it is possible some of those are coincidentally actually words. However, the transducer produces accurate analyses for the words in the test files. | ||
| + | |||
| + | Furthermore, it is important to note that the transducer was built from words in this corpus, so it is unsurprising it is capable of analyzing a large chunk of it. (In particular, many of the roots which are prevalent in the corpus can be analyzed by the transducer.) | ||
| + | |||
| + | At the time of this writing, 4 words in commonwords.yaml can be analyzed correctly, and 123 words in kik.yaml can be analyzed correctly. The top unanalyzed words in the corpus are now: | ||
| + | |||
| + | 29 nĩ | ||
| + | 16 thiomi | ||
| + | 10 kana | ||
| + | 8 nako | ||
| + | 6 no | ||
| + | 6 Abĩrika | ||
| + | 5 mũtego | ||
| + | 5 ũndũ | ||
| + | 4 harĩa | ||
| + | 4 Mũtiiri | ||
| + | 4 ũyũ | ||
| + | 4 ta | ||
| + | 4 mũtiiri | ||
| + | 4 rũũi | ||
| + | 3 kuona | ||
| + | 3 ciothe | ||
| + | 3 njamba | ||
| + | 3 maingĩ | ||
| + | 3 ng | ||
| + | 3 thĩ | ||
| + | |||
| + | Of these, nĩ is known to be a form of the copula, a very complicated piece of morphology. Abĩrika means Africa, and Mũtiiri and mũtiiri are both the name of the website from which some of the corpus was taken. | ||
| + | |||
| + | Currently, the transducer can analyze 82 noun stems, 54 verb stems, and 15 adjective stems, for a total of 151 stems. | ||
=Notes= | =Notes= | ||
| − | At the moment, there are seven test failures: | + | At the moment, there are seven test failures in kik.yaml: |
| + | |||
*ndigũthiĩ: It is unclear why this fails; in general, there seems to be a problem with negatives beginning with nd-, although it is not obvious why. | *ndigũthiĩ: It is unclear why this fails; in general, there seems to be a problem with negatives beginning with nd-, although it is not obvious why. | ||
*wagui: This is an irregular plural, and has not been implemented. | *wagui: This is an irregular plural, and has not been implemented. | ||
| Line 13: | Line 47: | ||
*ndaroka: See above. | *ndaroka: See above. | ||
*rũigi: The singular prefix rũ- does not appear when the root already begins with rũ-, as in rũigi. The .lexc file is not yet able to account for this. | *rũigi: The singular prefix rũ- does not appear when the root already begins with rũ-, as in rũigi. The .lexc file is not yet able to account for this. | ||
| + | |||
| + | At first, the transducer was able to analyze 37.04% of the corpus. After adding the ability to analyze several common words (na "with", kagui "boy", maĩ "water", and o "all"), the transducer was able to analyze 49.72% of the corpus. | ||
[[Category:Sp17_Transducers]] | [[Category:Sp17_Transducers]] | ||
Revision as of 06:06, 17 February 2017
The Kikuyu Transducer, in its work-in-progress state, can be found online at Swarthmore's Github.
Evaluation
The transducer is currently able to analyze 49.72% of the corpus.
It is very important to note that this numbers may be misleading, since it is possible the transducer is analyzing forms in the corpus incorrectly; given the massive overgeneration of the transducer in its current state it is likely it generates forms for many things, and it is possible some of those are coincidentally actually words. However, the transducer produces accurate analyses for the words in the test files.
Furthermore, it is important to note that the transducer was built from words in this corpus, so it is unsurprising it is capable of analyzing a large chunk of it. (In particular, many of the roots which are prevalent in the corpus can be analyzed by the transducer.)
At the time of this writing, 4 words in commonwords.yaml can be analyzed correctly, and 123 words in kik.yaml can be analyzed correctly. The top unanalyzed words in the corpus are now:
29 nĩ 16 thiomi 10 kana 8 nako 6 no 6 Abĩrika 5 mũtego 5 ũndũ 4 harĩa 4 Mũtiiri 4 ũyũ 4 ta 4 mũtiiri 4 rũũi 3 kuona 3 ciothe 3 njamba 3 maingĩ 3 ng 3 thĩ
Of these, nĩ is known to be a form of the copula, a very complicated piece of morphology. Abĩrika means Africa, and Mũtiiri and mũtiiri are both the name of the website from which some of the corpus was taken.
Currently, the transducer can analyze 82 noun stems, 54 verb stems, and 15 adjective stems, for a total of 151 stems.
Notes
At the moment, there are seven test failures in kik.yaml:
- ndigũthiĩ: It is unclear why this fails; in general, there seems to be a problem with negatives beginning with nd-, although it is not obvious why.
- wagui: This is an irregular plural, and has not been implemented.
- guoko: This is a plural word with a slightly abnormal plural morpheme, gu- instead of gũ; the .lexc file is not yet able to deal with it.
- ndĩagũire: Again, this is a negative word beginning with nd-, and it is failing for an unknown reason.
- ndũthiaga: See above.
- ndaroka: See above.
- rũigi: The singular prefix rũ- does not appear when the root already begins with rũ-, as in rũigi. The .lexc file is not yet able to account for this.
At first, the transducer was able to analyze 37.04% of the corpus. After adding the ability to analyze several common words (na "with", kagui "boy", maĩ "water", and o "all"), the transducer was able to analyze 49.72% of the corpus.
