Difference between revisions of "Nivkh/Transducer"
From LING073
(→Evaluation) |
|||
| (10 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
== Evaluation == | == Evaluation == | ||
*Total number of stems: 31 | *Total number of stems: 31 | ||
| − | + | ||
| + | Current coverage: 8.93% | ||
| + | |||
| + | ===Top Unknown Words=== | ||
{|class="wikitable" | {|class="wikitable" | ||
| Line 23: | Line 26: | ||
|- | |- | ||
| ес || 6 || || {{morphTest|{{tag|unk}}|ес}} | | ес || 6 || || {{morphTest|{{tag|unk}}|ес}} | ||
| + | |- | ||
| + | | р̌ыпрк || 6 || || {{morphTest|{{tag|unk}}|р̌ыпрк}} | ||
|- | |- | ||
| сык || 5 || || {{morphTest|{{tag|unk}}|сык}} | | сык || 5 || || {{morphTest|{{tag|unk}}|сык}} | ||
| Line 28: | Line 33: | ||
| − | [[Category: | + | niv.yaml file: 45/80 tests pass. |
| + | |||
| + | |||
| + | ==Generator Evaluation== | ||
| + | |||
| + | |||
| + | ===Initial Evaluation of Morphological Generation=== | ||
| + | |||
| + | <code>morph-test.py -csi niv.yaml</code>: 45/80 tests passed | ||
| + | |||
| + | <code>morph-test.py -cs niv.yaml</code>: 45/91 tests passed | ||
| + | |||
| + | <code>morph-test.py -cl niv.yaml</code>: 45/104 tests passed | ||
| + | |||
| + | Total number of stems: 31 | ||
| + | |||
| + | Current coverage from using automorf: 10.27% | ||
| + | |||
| + | Current coverage from using autogen: 0.11% | ||
| + | |||
| + | ===Final Evaluation of Morphological Generation=== | ||
| + | |||
| + | <code>morph-test.py -cl niv.yaml</code>: 57/83 tests passed. (26 fails) | ||
| + | |||
| + | Number of Twol rules added: 31 | ||
| + | |||
| + | Current coverage from using automorf: 6.25% | ||
| + | |||
| + | === Notes === | ||
| + | |||
| + | Before adding the top 3 words, our coverage was 7.48%. The top three unknown words were ''ойдам'' "baby", ''имғу'' "they", and ''курӈ'' "universe". | ||
| + | |||
| + | [[Category:Sp19_Transducers]] | ||
| + | [[Category:Nivkh]] | ||
Latest revision as of 15:45, 7 March 2019
Contents
Evaluation
- Total number of stems: 31
Current coverage: 8.93%
Top Unknown Words
| Word | Occurrences | Gloss | Tags |
|---|---|---|---|
| ойдам | 12 | "baby" | ойдам<n><nom> ↔ ойдам |
| имғу | 12 | "they" | имғу<prn><pers><p3><pl> ↔ имғу ? |
| курӈ | 12 | "universe" | курӈ<n><nom> ↔ курӈ |
| ызык | 11 | <unk> ↔ ызык | |
| маӈӷла | 10 | <unk> ↔ маӈӷла | |
| ирод | 7 | <unk> ↔ ирод | |
| оӻла | 6 | <unk> ↔ оӻла | |
| ӿур | 6 | <unk> ↔ ӿур | |
| ес | 6 | <unk> ↔ ес | |
| р̌ыпрк | 6 | <unk> ↔ р̌ыпрк | |
| сык | 5 | <unk> ↔ сык |
niv.yaml file: 45/80 tests pass.
Generator Evaluation
Initial Evaluation of Morphological Generation
morph-test.py -csi niv.yaml: 45/80 tests passed
morph-test.py -cs niv.yaml: 45/91 tests passed
morph-test.py -cl niv.yaml: 45/104 tests passed
Total number of stems: 31
Current coverage from using automorf: 10.27%
Current coverage from using autogen: 0.11%
Final Evaluation of Morphological Generation
morph-test.py -cl niv.yaml: 57/83 tests passed. (26 fails)
Number of Twol rules added: 31
Current coverage from using automorf: 6.25%
Notes
Before adding the top 3 words, our coverage was 7.48%. The top three unknown words were ойдам "baby", имғу "they", and курӈ "universe".
