Difference between revisions of "Eastern Burushaski/Final Project"
| Line 23: | Line 23: | ||
! Test # !! pass !! fail !! total | ! Test # !! pass !! fail !! total | ||
|- | |- | ||
| − | !0. | + | !0. |
| + | |46 | ||
| + | |8 | ||
| + | |54 | ||
|- | |- | ||
| − | !1. | + | !1. |
| + | |46 | ||
| + | |16 | ||
| + | |62 | ||
|- | |- | ||
| − | !2. | + | !2. |
| + | | 0 | ||
| + | |12 | ||
| + | |12 | ||
|- | |- | ||
| − | !3. | + | !3. |
| + | | 0 | ||
| + | |12 | ||
| + | |12 | ||
|- | |- | ||
| − | !4. | + | !4. |
| + | | 0 | ||
| + | |24 | ||
| + | |24 | ||
|- | |- | ||
| − | !5. | + | !5. |
| + | | 0 | ||
| + | |24 | ||
| + | |24 | ||
|- | |- | ||
| − | !6. | + | !6. |
| + | | 17 | ||
| + | |26 | ||
| + | |43 | ||
|- | |- | ||
| − | !7. | + | !7. |
| + | | 17 | ||
| + | |25 | ||
| + | |42 | ||
|- | |- | ||
| − | !8. | + | !8. |
| + | | 12 | ||
| + | |17 | ||
| + | |29 | ||
|- | |- | ||
| − | !9. | + | !9. |
| + | | 12 | ||
| + | |14 | ||
| + | |26 | ||
|- | |- | ||
| − | !10. | + | !10. |
| + | | 5 | ||
| + | |0 | ||
| + | |5 | ||
|- | |- | ||
| − | !11. | + | !11. |
| + | | 5 | ||
| + | |32 | ||
| + | |37 | ||
|- | |- | ||
| − | ! total | + | ! total |
| + | | 160 | ||
| + | |210 | ||
| + | |370 | ||
|} | |} | ||
Revision as of 21:30, 9 May 2019
outlines what you did, links to your code, and provides the results of your evaluation.
Contents
Arabic-Latin Orthographic Transducer of Hunza Burushaski
The Burushaski language has no consensus orthography, and literacy is low. We aim to create a transducer between two proposed orthographies which are good candidates for uptake by the Burushaski speaker community. The Latin orthography was proposed by Dr. Sadaf Munshi, curator of the North Texas University Burushaski Language Corpus. [1] This orthography is used in all of her transcriptions. The Arabic orthography was proposed by Rehmat Aziz Chitrali, a linguist and researcher at Khowar Academy Chitral in Pakistan. He released a keyboard layout for PC and Mac on GitHub, [2] which we have implemented for Linux. [3]
Methodology
Both orthographies are somewhat inconsistent or are not completely documented. We have therefore done our best to reconstruct the intentions of Dr. Munshi and Dr. Chitrali, but the orthographies we implement may differ slightly from either original. Small orthographic adjustments can easily be made to the completed transducer. To build our transducer, we used the Apertium framework.[4] We encoded the correspondence between the Latin and Arabic characters in our .lexc file, and wrote a number of rules to correct for inconsistencies and edge cases.
Code
The github repository for this project overall can be found at https://github.swarthmore.edu/cwillia7/ling073-bsk.
Evaluation
Despite the existence of an Arabic orthography, no corpus utilizing it could be found. To evaluate the effectiveness of our transducer, we hand-generated a small corpus of Arabic Burushaski and ran the aq-morftest script[] on the corpus to test for effectiveness and accuracy.
Test Results:
| Test # | pass | fail | total |
|---|---|---|---|
| 0. | 46 | 8 | 54 |
| 1. | 46 | 16 | 62 |
| 2. | 0 | 12 | 12 |
| 3. | 0 | 12 | 12 |
| 4. | 0 | 24 | 24 |
| 5. | 0 | 24 | 24 |
| 6. | 17 | 26 | 43 |
| 7. | 17 | 25 | 42 |
| 8. | 12 | 17 | 29 |
| 9. | 12 | 14 | 26 |
| 10. | 5 | 0 | 5 |
| 11. | 5 | 32 | 37 |
| total | 160 | 210 | 370 |
Coverage: 0.43243 or 43.24%
