Difference between revisions of "Purépecha/Transducer"

From LING073
Jump to: navigation, search
(corpus coverage update)
m (finished)
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
== Code ==
+
== Analyser Evaluation ==
 +
 
 +
=== Code ===
  
 
Github Repo[https://github.swarthmore.edu/Ling073-sp21/ling073-tsz]
 
Github Repo[https://github.swarthmore.edu/Ling073-sp21/ling073-tsz]
  
== Tests ==
+
=== Tests ===
  
 
* As of now, our Transducer passes 110/197 tests generated from our Wikipedia page
 
* As of now, our Transducer passes 110/197 tests generated from our Wikipedia page
  
== Lexical Info ==
+
=== Lexical Info ===
  
 
*Lexicons: 10
 
*Lexicons: 10
Line 39: Line 41:
 
*All anonymous lexicons: 1
 
*All anonymous lexicons: 1
  
== Coverage ==
+
=== Coverage ===
  
 
* Initial coverage: 14.9% (16590/111120), this was initially run on an incorrect corpus, but the current coverage reflects coverage on the new and correct corpus
 
* Initial coverage: 14.9% (16590/111120), this was initially run on an incorrect corpus, but the current coverage reflects coverage on the new and correct corpus
Line 47: Line 49:
 
«by adding "{{morphTest|ka{{tag|det}}|and}}", "{{morphTest|Jose{{tag|n}}{{tag|sg}}|Joseph}}", "{{morphTest|ma{{tag|num}}|one}}", "{{morphTest|Mariani{{tag|n}}{{tag|sg}}|Maria}}", "{{morphTest|Babilonia{{tag|n}}{{tag|sg}}|Babylon}}", "{{morphTest|jimbo{{tag|det}}|for}}" to the transducer, coverage went from 14.9% to 29%»
 
«by adding "{{morphTest|ka{{tag|det}}|and}}", "{{morphTest|Jose{{tag|n}}{{tag|sg}}|Joseph}}", "{{morphTest|ma{{tag|num}}|one}}", "{{morphTest|Mariani{{tag|n}}{{tag|sg}}|Maria}}", "{{morphTest|Babilonia{{tag|n}}{{tag|sg}}|Babylon}}", "{{morphTest|jimbo{{tag|det}}|for}}" to the transducer, coverage went from 14.9% to 29%»
  
== Notes ==
+
=== Notes ===
  
 
* There are some more complex grammar forms that we aren't sure how to code yet.
 
* There are some more complex grammar forms that we aren't sure how to code yet.
Line 54: Line 56:
  
 
* We incorrectly scraped the Bible for our corpus, so originally, it was repeating the same chapter over and over again. We fixed this in the most updated version.
 
* We incorrectly scraped the Bible for our corpus, so originally, it was repeating the same chapter over and over again. We fixed this in the most updated version.
 +
 +
== Generator Evaluation ==
 +
 +
=== Initial evaluation of morphological generation ===
 +
 +
* Our Transducer passes 110/197 tests generated from our Wikipedia page
 +
 +
* Current corpus coverage: 29% (49371/168970)
 +
 +
* Our morphological generation test passes 55/102
 +
 +
=== final evaluation of morphological generation ===
 +
 +
* Our Transducer passes 142/216 tests generated from our Wikipedia page
 +
 +
* Current corpus coverage: 29.3% (49473/168985)
 +
 +
* Our morphological generation test passes 71/111
 +
 +
=== Notes ===
 +
 +
Added transitive, took out extra transitive, changed <p3> to <p3><sg>
  
 
[[Category:Purépecha]] [[Category:Sp21 Transducers]]
 
[[Category:Purépecha]] [[Category:Sp21 Transducers]]

Latest revision as of 15:14, 20 April 2021

Analyser Evaluation

Code

Github Repo[1]

Tests

  • As of now, our Transducer passes 110/197 tests generated from our Wikipedia page

Lexical Info

  • Lexicons: 10
  • Lexicon entries: 80
  • Patterns: 2
  • Pattern entries: 5


Counts for individual lexicons:

  • NounRoot: 3
  • RegNounInfl: 2
  • ObjectRoot: 19
  • Object: 1
  • Punctuation: 22
  • V-Stem: 13
  • AspectTime: 10
  • ModeInterrogative: 9
  • All anonymous lexicons: 1

Coverage

  • Initial coverage: 14.9% (16590/111120), this was initially run on an incorrect corpus, but the current coverage reflects coverage on the new and correct corpus
  • Current coverage: 29% (49371/168970)

«by adding "ka<det> ↔ and", "Jose<n><sg> ↔ Joseph", "ma<num> ↔ one", "Mariani<n><sg> ↔ Maria", "Babilonia<n><sg> ↔ Babylon", "jimbo<det> ↔ for" to the transducer, coverage went from 14.9% to 29%»

Notes

  • There are some more complex grammar forms that we aren't sure how to code yet.
  • Originally, our corpus was primarily taken from tweets by a native Purepechan, but we were able to find a Bible in Purepechan that we added to our corpus.
  • We incorrectly scraped the Bible for our corpus, so originally, it was repeating the same chapter over and over again. We fixed this in the most updated version.

Generator Evaluation

Initial evaluation of morphological generation

  • Our Transducer passes 110/197 tests generated from our Wikipedia page
  • Current corpus coverage: 29% (49371/168970)
  • Our morphological generation test passes 55/102

final evaluation of morphological generation

  • Our Transducer passes 142/216 tests generated from our Wikipedia page
  • Current corpus coverage: 29.3% (49473/168985)
  • Our morphological generation test passes 71/111

Notes

Added transitive, took out extra transitive, changed <p3> to <p3><sg>