Difference between revisions of "User:Eortici1/Final project"

From LING073
Jump to: navigation, search
(→‎Evaluation)
(→‎Evaluation)
Line 37: Line 37:
  
 
{| class="wikitable"
 
{| class="wikitable"
−
|+Evaluation of bcl.large.withmorph.udpipe
+
|+Evaluation of bcl-withmorph.udpipe
 
|-
 
|-
 
|UAS
 
|UAS
Line 47: Line 47:
  
 
{| class="wikitable"
 
{| class="wikitable"
−
|+Evaluation of bcl.large.nomorph.udpipe
+
|+Evaluation of bcl-nomorph.udpipe
 
|-
 
|-
 
|UAS
 
|UAS
Line 53: Line 53:
 
|-
 
|-
 
|50.51 ± 5.53
 
|50.51 ± 5.53
−
| ±
+
|36.01 ± 6.59
 
|}
 
|}
  

Revision as of 03:44, 10 May 2017

This page documents my final project, a larger UD corpus and annotation guidelines for Bikol.

Issues

  • links
  • mga

Change sarong to a determiner instead of an nmod?

Check notes on phone for some changes to be made.

Re-evaluate NA !!!

  • aux:amod, aux:nmod, aux:advmod, aux:nummod
  • check @dep and anything labeled !*

tr -cd @ < bcl.annotated.large.ud.txt | wc -c

  • counts number of @ in the file

Corpus Information

Corpus Size
Sentences Forms
103 1163

This corpus contains extracts from the following sources:

Evaluation

Evaluation of bcl-withmorph.udpipe
UAS LAS
60.87 ± 5.67 50.00 ± 4.22
Evaluation of bcl-nomorph.udpipe
UAS LAS
50.51 ± 5.53 36.01 ± 6.59

UD Annotation Guidelines

Appendix

Evaluation

UD Parser Evaluation
UAS with morphology LAS with morphology UAS without morphology LAS without morphology
Test 1 55.37 45.45 48.76 31.40
Test 2 56.34 46.48 50.70 38.03
Test 3 64.29 54.46 57.14 43.75
Test 4 65.00 49.17 53.33 36.67
Test 5 56.44 47.52 40.59 23.76
Test 6 65.52 52.41 56.55 38.62
Test 7 52.89 44.63 46.28 31.40
Test 8 57.45 48.94 45.74 34.04
Test 9 67.65 53.92 49.02 35.29
Test 10 67.77 57.02 57.02 47.11