Difference between revisions of "Nivkh/Transducer"
From LING073
(Created page with "== Evaluation == Category:Sp18_Transducers") |
|||
| (13 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
== Evaluation == | == Evaluation == | ||
| + | *Total number of stems: 31 | ||
| + | Current coverage: 8.93% | ||
| − | [[Category: | + | ===Top Unknown Words=== |
| + | |||
| + | {|class="wikitable" | ||
| + | !Word !! Occurrences !! Gloss !! Tags | ||
| + | |- | ||
| + | | ойдам || 12 || "baby" || {{morphTest|ойдам{{tag|n}}{{tag|nom}}|ойдам}} | ||
| + | |- | ||
| + | | имғу || 12 || "they" ||{{morphTest|имғу{{tag|prn}}{{tag|pers}}{{tag|p3}}{{tag|pl}}|имғу}} ? | ||
| + | |- | ||
| + | | курӈ || 12 || "universe" || {{morphTest|курӈ{{tag|n}}{{tag|nom}}|курӈ}} | ||
| + | |- | ||
| + | | ызык || 11 || || {{morphTest|{{tag|unk}}|ызык}} | ||
| + | |- | ||
| + | | маӈӷла || 10 || || {{morphTest|{{tag|unk}}|маӈӷла}} | ||
| + | |- | ||
| + | | ирод || 7 || || {{morphTest|{{tag|unk}}|ирод}} | ||
| + | |- | ||
| + | | оӻла || 6 || || {{morphTest|{{tag|unk}}|оӻла}} | ||
| + | |- | ||
| + | | ӿур || 6 || || {{morphTest|{{tag|unk}}|ӿур}} | ||
| + | |- | ||
| + | | ес || 6 || || {{morphTest|{{tag|unk}}|ес}} | ||
| + | |- | ||
| + | | р̌ыпрк || 6 || || {{morphTest|{{tag|unk}}|р̌ыпрк}} | ||
| + | |- | ||
| + | | сык || 5 || || {{morphTest|{{tag|unk}}|сык}} | ||
| + | |} | ||
| + | |||
| + | |||
| + | niv.yaml file: 45/80 tests pass. | ||
| + | |||
| + | |||
| + | ==Generator Evaluation== | ||
| + | |||
| + | |||
| + | ===Initial Evaluation of Morphological Generation=== | ||
| + | |||
| + | <code>morph-test.py -csi niv.yaml</code>: 45/80 tests passed | ||
| + | |||
| + | <code>morph-test.py -cs niv.yaml</code>: 45/91 tests passed | ||
| + | |||
| + | <code>morph-test.py -cl niv.yaml</code>: 45/104 tests passed | ||
| + | |||
| + | Total number of stems: 31 | ||
| + | |||
| + | Current coverage from using automorf: 10.27% | ||
| + | |||
| + | Current coverage from using autogen: 0.11% | ||
| + | |||
| + | ===Final Evaluation of Morphological Generation=== | ||
| + | |||
| + | <code>morph-test.py -cl niv.yaml</code>: 57/83 tests passed. (26 fails) | ||
| + | |||
| + | Number of Twol rules added: 31 | ||
| + | |||
| + | Current coverage from using automorf: 6.25% | ||
| + | |||
| + | === Notes === | ||
| + | |||
| + | Before adding the top 3 words, our coverage was 7.48%. The top three unknown words were ''ойдам'' "baby", ''имғу'' "they", and ''курӈ'' "universe". | ||
| + | |||
| + | [[Category:Sp19_Transducers]] | ||
| + | [[Category:Nivkh]] | ||
Latest revision as of 15:45, 7 March 2019
Contents
Evaluation
- Total number of stems: 31
Current coverage: 8.93%
Top Unknown Words
| Word | Occurrences | Gloss | Tags |
|---|---|---|---|
| ойдам | 12 | "baby" | ойдам<n><nom> ↔ ойдам |
| имғу | 12 | "they" | имғу<prn><pers><p3><pl> ↔ имғу ? |
| курӈ | 12 | "universe" | курӈ<n><nom> ↔ курӈ |
| ызык | 11 | <unk> ↔ ызык | |
| маӈӷла | 10 | <unk> ↔ маӈӷла | |
| ирод | 7 | <unk> ↔ ирод | |
| оӻла | 6 | <unk> ↔ оӻла | |
| ӿур | 6 | <unk> ↔ ӿур | |
| ес | 6 | <unk> ↔ ес | |
| р̌ыпрк | 6 | <unk> ↔ р̌ыпрк | |
| сык | 5 | <unk> ↔ сык |
niv.yaml file: 45/80 tests pass.
Generator Evaluation
Initial Evaluation of Morphological Generation
morph-test.py -csi niv.yaml: 45/80 tests passed
morph-test.py -cs niv.yaml: 45/91 tests passed
morph-test.py -cl niv.yaml: 45/104 tests passed
Total number of stems: 31
Current coverage from using automorf: 10.27%
Current coverage from using autogen: 0.11%
Final Evaluation of Morphological Generation
morph-test.py -cl niv.yaml: 57/83 tests passed. (26 fails)
Number of Twol rules added: 31
Current coverage from using automorf: 6.25%
Notes
Before adding the top 3 words, our coverage was 7.48%. The top three unknown words were ойдам "baby", имғу "they", and курӈ "universe".
