Difference between revisions of "Evenki and English/Structural transfer"
From LING073
(→Pre-Evaluation) |
(→Pre-Evaluation) |
||
| Line 3: | Line 3: | ||
Note: Due to the previously mentioned orthography issues with the Evenki transducer, our test results are artificially low. Since the transducer is imported from apertium and we did not created, this currently not a problem we can fix. However, our work could be applied in future work on Evenki if this issue were to be fixed. | Note: Due to the previously mentioned orthography issues with the Evenki transducer, our test results are artificially low. Since the transducer is imported from apertium and we did not created, this currently not a problem we can fix. However, our work could be applied in future work on Evenki if this issue were to be fixed. | ||
| − | + | ------------------------------------------------------- | |
| − | + | Number of words in reference: 20 | |
| − | + | Number of words in test: 22 | |
| − | + | Number of unknown words (marked with a star) in test: 20 | |
| − | + | Percentage of unknown words: 90.91 % | |
| − | + | ||
| − | + | Results when removing unknown-word marks (stars) | |
| + | ------------------------------------------------------- | ||
| + | Edit distance: 22 | ||
| + | Word error rate (WER): 110.00 % | ||
| + | Number of position-independent correct words: 0 | ||
| + | Position-independent word error rate (PER): 110.00 % | ||
=== Adding stems === | === Adding stems === | ||
Revision as of 13:24, 11 May 2023
Contents
Pre-Evaluation
Note: Due to the previously mentioned orthography issues with the Evenki transducer, our test results are artificially low. Since the transducer is imported from apertium and we did not created, this currently not a problem we can fix. However, our work could be applied in future work on Evenki if this issue were to be fixed.
------------------------------------------------------- Number of words in reference: 20 Number of words in test: 22 Number of unknown words (marked with a star) in test: 20 Percentage of unknown words: 90.91 %
Results when removing unknown-word marks (stars) ------------------------------------------------------- Edit distance: 22 Word error rate (WER): 110.00 % Number of position-independent correct words: 0 Position-independent word error rate (PER): 110.00 %
Adding stems
Add all the words needed for the transfer tests (from the last assignment) to analyse to the bilingual dictionary.
And make sure both analysers can analyse all sentences correctly, which includes adding the words to the relevant monolingual dictionaries as necessary.
Structural Transfer Rules
Implement one item from your contrastive grammar.
Add to your structural transfer wiki page:
Mode Outputs For Each Sentence
Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, lex, transfer, and the pair itself (abc-xyz).
| sentence | tagger | lex | transfer | evn-eng |
|---|---|---|---|---|
| sentence | Output | Output | Output | Output |
| sentence | Output | Output | Output | Output |
| sentence | Output | Output | Output | Output |
Post-Evaluation
| WER Test | PER Test | Coverage Test |
|---|---|---|
| Output | Output | Output |
