Difference between revisions of "Rungus and English/Structural Transfer"
From LING073
(→Structural Transfer) |
(→Post-Evaluation) |
||
| Line 19: | Line 19: | ||
==Post-Evaluation== | ==Post-Evaluation== | ||
| − | * WER: | + | ===Statistics about input files=== |
| − | * PER: | + | * Number of words in reference: 44 |
| + | * Number of words in test: 33 | ||
| + | * Number of unknown words (marked with a star) in test: 0 | ||
| + | * Percentage of unknown words: 0.00 % | ||
| + | |||
| + | ===Results when removing unknown-word marks (stars)=== | ||
| + | * Edit distance: 44 | ||
| + | * Word error rate (WER): 100.00 % | ||
| + | * Number of position-independent correct words: 2 | ||
| + | * Position-independent word error rate (PER): 95.45 % | ||
[[Category:Sp25_StructuralTransfer]] | [[Category:Sp25_StructuralTransfer]] | ||
[[Category:Rungus]] | [[Category:Rungus]] | ||
[[Category:English]] | [[Category:English]] | ||
Revision as of 19:01, 29 April 2025
Contents
Pre-Evaluation
- WER: 82.35%
- PER: 82.35%
Structural Transfer
Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, lex, transfer, and the pair itself (abc-xyz). Perform WER, PER, and coverage tests again, and add into a post-evaluation section on the wiki page.
Word Order
- (drg) Momobog ko dialo → (eng) You hit him
- Tagger: ^Bobog<v><impf><af>$ ^ko<prn><pers><p2><sg><nom>$ ^dialo<prn><pers><p3><sg><acc>$^.<sent>$
- Lex: ^Bobog<v><impf><af>/Hit<v><impf><af>$ ^ko<prn><pers><p2><sg><nom>/you<prn><pers><p2><sg><nom>$ ^dialo<prn><pers><p3><sg><acc>/him<prn><pers><p3><sg><acc>/her<prn><pers><p3><sg><acc>$^.<sent>/.<sent>$
- Transfer: ^you<prn><pers><p2><sg><nom>$ ^Hit<v><impf><af>$ ^him<prn><pers><p3><sg><acc>$^.<sent>$
- drg-eng: #you #Hit #him
Post-Evaluation
Statistics about input files
- Number of words in reference: 44
- Number of words in test: 33
- Number of unknown words (marked with a star) in test: 0
- Percentage of unknown words: 0.00 %
Results when removing unknown-word marks (stars)
- Edit distance: 44
- Word error rate (WER): 100.00 %
- Number of position-independent correct words: 2
- Position-independent word error rate (PER): 95.45 %