Difference between revisions of "User:Eortici1/Final project"

From LING073
Jump to: navigation, search
(→‎Evaluation)
Line 49: Line 49:
 
|+Evaluation of bcl.large.nomorph.udpipe
 
|+Evaluation of bcl.large.nomorph.udpipe
 
|-
 
|-
−
|
+
|UAS
 
|LAS
 
|LAS
−
|UAS
 
−
|-
 
−
|Corpus 1
 
−
|C1 LAS
 
−
|C1 UAS
 
 
|-
 
|-
−
|Corpus 2
+
|50.51 ± 5.53
−
|C2 LAS
+
| ±
−
|C2 UAS
 
 
|}
 
|}
  

Revision as of 03:43, 10 May 2017

This page documents my final project, a larger UD corpus and annotation guidelines for Bikol.

Issues

  • links
  • mga

Change sarong to a determiner instead of an nmod?

Check notes on phone for some changes to be made.

Re-evaluate NA !!!

  • aux:amod, aux:nmod, aux:advmod, aux:nummod
  • check @dep and anything labeled !*

tr -cd @ < bcl.annotated.large.ud.txt | wc -c

  • counts number of @ in the file

Corpus Information

Corpus Size
Sentences Forms
103 1163

This corpus contains extracts from the following sources:

Evaluation

Evaluation of bcl.large.withmorph.udpipe
UAS LAS
60.87 ± 5.67 50.00 ± 4.22
Evaluation of bcl.large.nomorph.udpipe
UAS LAS
50.51 ± 5.53 ±

UD Annotation Guidelines

Appendix

Evaluation

UD Parser Evaluation
UAS with morphology LAS with morphology UAS without morphology LAS without morphology
Test 1 55.37 45.45 48.76 31.40
Test 2 56.34 46.48 50.70 38.03
Test 3 64.29 54.46 57.14 43.75
Test 4 65.00 49.17 53.33 36.67
Test 5 56.44 47.52 40.59 23.76
Test 6 65.52 52.41 56.55 38.62
Test 7 52.89 44.63 46.28 31.40
Test 8 57.45 48.94 45.74 34.04
Test 9 67.65 53.92 49.02 35.29
Test 10 67.77 57.02 57.02 47.11