Difference between revisions of "User:Eortici1/Final project"
From LING073
(→Evaluation) |
(→Evaluation) |
||
| Line 63: | Line 63: | ||
{| class="wikitable" | {| class="wikitable" | ||
| − | |+ UD Parser Evaluation | + | |+ UD Parser Evaluation: Tests on 10 Subsets of Corpus |
|- | |- | ||
! | ! | ||
Revision as of 03:45, 10 May 2017
This page documents my final project, a larger UD corpus and annotation guidelines for Bikol.
Issues
- links
- mga
Change sarong to a determiner instead of an nmod?
Check notes on phone for some changes to be made.
Re-evaluate NA !!!
- aux:amod, aux:nmod, aux:advmod, aux:nummod
- check @dep and anything labeled !*
tr -cd @ < bcl.annotated.large.ud.txt | wc -c
- counts number of @ in the file
Corpus Information
| Sentences | Forms |
| 103 | 1163 |
This corpus contains extracts from the following sources:
- Universal Declaration of Human Rights (used English translation for glosses)
- Various Bikol Wikipedia articles, accessed from 01/05/2017 to 10/05/2017
Evaluation
| UAS | LAS |
| 60.87 ± 5.67 | 50.00 ± 4.22 |
| UAS | LAS |
| 50.51 ± 5.53 | 36.01 ± 6.59 |
UD Annotation Guidelines
Appendix
Evaluation
| UAS with morphology | LAS with morphology | UAS without morphology | LAS without morphology | |
|---|---|---|---|---|
| Test 1 | 55.37 | 45.45 | 48.76 | 31.40 |
| Test 2 | 56.34 | 46.48 | 50.70 | 38.03 |
| Test 3 | 64.29 | 54.46 | 57.14 | 43.75 |
| Test 4 | 65.00 | 49.17 | 53.33 | 36.67 |
| Test 5 | 56.44 | 47.52 | 40.59 | 23.76 |
| Test 6 | 65.52 | 52.41 | 56.55 | 38.62 |
| Test 7 | 52.89 | 44.63 | 46.28 | 31.40 |
| Test 8 | 57.45 | 48.94 | 45.74 | 34.04 |
| Test 9 | 67.65 | 53.92 | 49.02 | 35.29 |
| Test 10 | 67.77 | 57.02 | 57.02 | 47.11 |
