Difference between revisions of "Urum/Transducer"

From LING073
Jump to: navigation, search
(→‎Evaluation)
(→‎Evaluation)
Line 53: Line 53:
  
  
−
'''Number of tests that pass in each yaml file'''
+
'''Number of tests that pass from regtests in test/'''
 +
 
 +
Corpus 1 of 10: Plurality-morph
 +
  8/8 (100.0%) tests pass (6/8 (75.0%) match gold)
 +
 
 +
Corpus 2 of 10: Verbs Present Tense-morph
 +
  11/11 (100.0%) tests pass (5/11 (45.45%) match gold)
 +
 
 +
Corpus 3 of 10: Possessiveness-morph
 +
  7/7 (100.0%) tests pass (3/7 (42.86%) match gold)
 +
 
 +
Corpus 4 of 10: Accusative Case-morph
 +
  3/3 (100.0%) tests pass (1/3 (33.33%) match gold)
 +
 
 +
Corpus 5 of 10: Dative Case-morph
 +
  4/4 (100.0%) tests pass (2/4 (50.0%) match gold)
 +
 
 +
Corpus 6 of 10: Locative Case-morph
 +
  4/4 (100.0%) tests pass (2/4 (50.0%) match gold)
 +
 
 +
Corpus 7 of 10: Genitive Case-morph
 +
  3/3 (100.0%) tests pass (3/3 (100.0%) match gold)
 +
 
 +
Corpus 8 of 10: Ablative Case-morph
 +
  4/4 (100.0%) tests pass (4/4 (100.0%) match gold)
 +
 
 +
Corpus 9 of 10: Past Tense-morph
 +
  6/6 (100.0%) tests pass (6/6 (100.0%) match gold)
 +
 
 +
Corpus 10 of 10: Verb Negation-morph
 +
  4/4 (100.0%) tests pass (4/4 (100.0%) match gold)
 +
 
 +
All tests pass.
  
 
== Notes ==
 
== Notes ==

Revision as of 05:03, 25 February 2023

This is the page for our Urum transducer.

Evaluation

Total number of stems in the transducer

    • Lexicons: 17
    • Lexicon entries: 107
    • Patterns: 7
    • Pattern entries: 14
  • Counts for individual lexicons:
    • Punctuation: 22
    • V-Root: 10
    • TransitivityTag: 2
    • VPres: 6
    • VPresNeg: 6
    • VPast: 6
    • N-Root: 27
    • Plurality: 1
    • Possession: 6
    • Cases: 6
    • Numeral: 10
    • All anonymous lexicons: 5

Current coverage over your combined corpus

The current list of top unknown words returned by aq-covtest

TOP UNKNOWN WORDS:

    13 *
    11 ^д/*д$
    11 ^ве/*ве$
    10 ^дэ/*дэ$
    10 ^да/*да$
     8 ^эй/*эй$
     7 ^бен/*бен$
     6 ^олсун/*олсун$
     6 ^махлуклар/*махлуклар$
     6 ^йар/*йар$
     6 ^и/*и$
     6 ^бир/*бир$
     5 ^эм/*эм$
     5 ^т`и/*т`и$
     5 ^илен/*илен$
     5 ^доғду/*доғду$
     5 ^бу/*бу$
     5 ^Христос/*Христос$
     4 ^эт/*эт$
     4 ^эди/*эди$

coverage: 333 / 1178 (~0.28268251273344651952) remaining unknown forms: 845 ambiguity: 1341 / 1178 (~1.13837011884550084890)


Number of tests that pass from regtests in test/

Corpus 1 of 10: Plurality-morph

 8/8 (100.0%) tests pass (6/8 (75.0%) match gold)

Corpus 2 of 10: Verbs Present Tense-morph

 11/11 (100.0%) tests pass (5/11 (45.45%) match gold)

Corpus 3 of 10: Possessiveness-morph

 7/7 (100.0%) tests pass (3/7 (42.86%) match gold)

Corpus 4 of 10: Accusative Case-morph

 3/3 (100.0%) tests pass (1/3 (33.33%) match gold)

Corpus 5 of 10: Dative Case-morph

 4/4 (100.0%) tests pass (2/4 (50.0%) match gold)

Corpus 6 of 10: Locative Case-morph

 4/4 (100.0%) tests pass (2/4 (50.0%) match gold)

Corpus 7 of 10: Genitive Case-morph

 3/3 (100.0%) tests pass (3/3 (100.0%) match gold)

Corpus 8 of 10: Ablative Case-morph

 4/4 (100.0%) tests pass (4/4 (100.0%) match gold)

Corpus 9 of 10: Past Tense-morph

 6/6 (100.0%) tests pass (6/6 (100.0%) match gold)

Corpus 10 of 10: Verb Negation-morph

 4/4 (100.0%) tests pass (4/4 (100.0%) match gold)

All tests pass.

Notes

What tests still don't work and why

  • Accusative Case, we still have no idea why they are not working correctly. When we tried to check for as to why the error might be occuring, we checked each of the individual generations per the hfst-expand greping for the correct output, and it was able to be found for ever single instance. As for why this does not register as "gold" by the apertium-regtest, is still unclear. Perhaps there could be an issue with the unicode of the tests on the wiki (will check later).
  • Locative Case