Difference between revisions of "Ainu/Transducer"
(→Notes) |
(→Notes) |
||
| Line 147: | Line 147: | ||
It looks like the superlative イヨッタ will not be parsed properly as a prefix due to the 'small-tsu' character ッ. When I change the prefix to remove that character (i.e. イヨタ), the analysis of, for example, イヨタピリカ works (ピリカ<adj><sup>). Otherwise, with the prefix as it should be, the analysis of イヨッタピリカ is "^イ/*イ$ヨ^ッタピリカ/*ッタピリカ$". | It looks like the superlative イヨッタ will not be parsed properly as a prefix due to the 'small-tsu' character ッ. When I change the prefix to remove that character (i.e. イヨタ), the analysis of, for example, イヨタピリカ works (ピリカ<adj><sup>). Otherwise, with the prefix as it should be, the analysis of イヨッタピリカ is "^イ/*イ$ヨ^ッタピリカ/*ッタピリカ$". | ||
| + | |||
| + | |||
| + | The diminutive tests are also slightly wonky, where ト゚カラポ will properly analyze as "^ト゚カラ<n><dim>$" but will fail the test claiming that analysis was not generated. It may have something to do with the diacritic? The test for オッカイポ fails because of the 'small-tsu' character which stops even オッカイ from being analyzed correctly. | ||
== Transducer == | == Transducer == | ||
Revision as of 20:34, 18 February 2017
Evaluation
The most common unknown words originally were
| Word | Times Encountered |
|---|---|
| ネ | 60 |
| カ | 50 |
| アン | 44 |
| タ | 30 |
| ワ | 29 |
| コ | 25 |
| イ | 20 |
| ヒ | 18 |
| ピ | 16 |
| ルウェ | 16 |
| パ | 16 |
| ㇺ | 14 |
| ㇷ | 14 |
| ウタ | 14 |
| セコ | 13 |
| ハウェアン | 13 |
| キ | 12 |
| クニ | 10 |
| ニ | 9 |
| ヤㇰ | 9 |
Original coverage of these words is 11.19%. Now the coverage is 21.21%.
There are 79 stems in the transducer. 58/115 ain.yaml tests pass (57 fail). 2/20 commonwords.yaml tests pass (18 fail).
Now the most common words are
| Word | Times Encountered |
|---|---|
| カ | 50 |
| アン | 44 |
| タ | 30 |
| ワ | 29 |
| イ | 20 |
| ヒ | 18 |
| ピ | 16 |
| ルウェ | 16 |
| パ | 16 |
| ㇺ | 14 |
| ㇷ | 14 |
| ウタ | 14 |
| セコ | 13 |
| ハウェアン | 13 |
| キ | 12 |
| クニ | 10 |
| ニ | 9 |
| ヤㇰ | 9 |
| チュㇷ | 8 |
| カノ | 8 |
Notes
After adding "ネ<vbser> ↔ ネ" and "コ<cnjsub> ↔ コ" to the transducer, coverage went from 11.19% to 21.21%.
The tests I am struggling with are for adjectivity-- I need a new grammar book to confirm that there are really so many differing adjective endings because the current book I am using as a reference was written over 100 years ago. I have not yet had time to add pronoun or noun affinity tests. The remaining failing tests are irregular cases at which I will have to look more closely.
It looks like the superlative イヨッタ will not be parsed properly as a prefix due to the 'small-tsu' character ッ. When I change the prefix to remove that character (i.e. イヨタ), the analysis of, for example, イヨタピリカ works (ピリカ<adj>). Otherwise, with the prefix as it should be, the analysis of イヨッタピリカ is "^イ/*イ$ヨ^ッタピリカ/*ッタピリカ$".
The diminutive tests are also slightly wonky, where ト゚カラポ will properly analyze as "^ト゚カラ<n><dim>$" but will fail the test claiming that analysis was not generated. It may have something to do with the diacritic? The test for オッカイポ fails because of the 'small-tsu' character which stops even オッカイ from being analyzed correctly.
Transducer
Ainu transducer available on my GitHub.
