Difference between revisions of "User:Eortici1/Final project"
From LING073
| Line 69: | Line 69: | ||
== UD Annotation Guidelines == | == UD Annotation Guidelines == | ||
| + | |||
| + | == Appendix == | ||
| + | |||
| + | === Evaluation === | ||
| + | |||
| + | {| class="wikitable" | ||
| + | |+ UD Parser Evaluation | ||
| + | |- | ||
| + | ! | ||
| + | ! UAS with morphology | ||
| + | ! LAS with morphology | ||
| + | ! UAS without morphology | ||
| + | ! LAS without morphology | ||
| + | |- | ||
| + | ! Test 1 | ||
| + | | 55.37 | ||
| + | | 45.45 | ||
| + | | 48.76 | ||
| + | | 31.40 | ||
| + | |- | ||
| + | ! Test 2 | ||
| + | | 56.34 | ||
| + | | 46.48 | ||
| + | | 50.70 | ||
| + | | 38.03 | ||
| + | |- | ||
| + | ! Test 3 | ||
| + | | 64.29 | ||
| + | | 54.46 | ||
| + | | 57.14 | ||
| + | | 43.75 | ||
| + | |- | ||
| + | ! Test 4 | ||
| + | | 65.00 | ||
| + | | 49.17 | ||
| + | | 53.33 | ||
| + | | 36.67 | ||
| + | |- | ||
| + | ! Test 5 | ||
| + | | 56.44 | ||
| + | | 47.52 | ||
| + | | 40.59 | ||
| + | | 23.76 | ||
| + | |- | ||
| + | ! Test 6 | ||
| + | | 65.52 | ||
| + | | 52.41 | ||
| + | | 56.55 | ||
| + | | 38.62 | ||
| + | |- | ||
| + | ! Test 7 | ||
| + | | 52.89 | ||
| + | | 44.63 | ||
| + | | 46.28 | ||
| + | | 31.40 | ||
| + | |- | ||
| + | ! Test 8 | ||
| + | | 57.45 | ||
| + | | 48.94 | ||
| + | | 45.74 | ||
| + | | 34.04 | ||
| + | |- | ||
| + | ! Test 9 | ||
| + | | 67.65 | ||
| + | | 53.92 | ||
| + | | 49.02 | ||
| + | | 35.29 | ||
| + | |- | ||
| + | ! Test 10 | ||
| + | | 67.77 | ||
| + | | 57.02 | ||
| + | | 57.02 | ||
| + | | 47.11 | ||
| + | |} | ||
[[Category:sp17_FinalProjects]] [[Category:Bikol]] | [[Category:sp17_FinalProjects]] [[Category:Bikol]] | ||
Revision as of 03:36, 10 May 2017
This page documents my final project, a larger UD corpus and annotation guidelines for Bikol.
Issues
- links
- mga
Change sarong to a determiner instead of an nmod?
Check notes on phone for some changes to be made.
Re-evaluate NA !!!
- aux:amod, aux:nmod, aux:advmod, aux:nummod
- check @dep and anything labeled !*
tr -cd @ < bcl.annotated.large.ud.txt | wc -c
- counts number of @ in the file
Corpus Information
| Sentences | Forms |
| 103 | 1163 |
This corpus contains extracts from the following sources:
- Universal Declaration of Human Rights (used English translation for glosses)
- Various Bikol Wikipedia articles, accessed from 01/05/2017 to 10/05/2017
Evaluation
| LAS | UAS | |
| Corpus 1 | C1 LAS | C1 UAS |
| Corpus 2 | C2 LAS | C2 UAS |
| LAS | UAS | |
| Corpus 1 | C1 LAS | C1 UAS |
| Corpus 2 | C2 LAS | C2 UAS |
UD Annotation Guidelines
Appendix
Evaluation
| UAS with morphology | LAS with morphology | UAS without morphology | LAS without morphology | |
|---|---|---|---|---|
| Test 1 | 55.37 | 45.45 | 48.76 | 31.40 |
| Test 2 | 56.34 | 46.48 | 50.70 | 38.03 |
| Test 3 | 64.29 | 54.46 | 57.14 | 43.75 |
| Test 4 | 65.00 | 49.17 | 53.33 | 36.67 |
| Test 5 | 56.44 | 47.52 | 40.59 | 23.76 |
| Test 6 | 65.52 | 52.41 | 56.55 | 38.62 |
| Test 7 | 52.89 | 44.63 | 46.28 | 31.40 |
| Test 8 | 57.45 | 48.94 | 45.74 | 34.04 |
| Test 9 | 67.65 | 53.92 | 49.02 | 35.29 |
| Test 10 | 67.77 | 57.02 | 57.02 | 47.11 |