Difference between revisions of "Tiwi and English/Structural transfer"

From LING073
Jump to: navigation, search
(Pre-Evaluation)
(Pre-Evaluation)
Line 4: Line 4:
 
-------------------------------------------------------
 
-------------------------------------------------------
 
Number of words in reference: 41
 
Number of words in reference: 41
 +
 
Number of words in test: 28
 
Number of words in test: 28
 +
 
Number of unknown words (marked with a star) in test:  
 
Number of unknown words (marked with a star) in test:  
 +
 
Percentage of unknown words: 0.00 %
 
Percentage of unknown words: 0.00 %
 +
  
 
Results when removing unknown-word marks (stars)
 
Results when removing unknown-word marks (stars)
 
-------------------------------------------------------
 
-------------------------------------------------------
 
Edit distance: 38
 
Edit distance: 38
 +
 
Word error rate (WER): 92.68 %
 
Word error rate (WER): 92.68 %
 +
 
Number of position-independent correct words: 3
 
Number of position-independent correct words: 3
 +
 
Position-independent word error rate (PER): 92.68 %
 
Position-independent word error rate (PER): 92.68 %
 +
  
 
Results when unknown-word marks (stars) are not removed
 
Results when unknown-word marks (stars) are not removed
 
-------------------------------------------------------
 
-------------------------------------------------------
 
Edit distance: 38
 
Edit distance: 38
 +
 
Word Error Rate (WER): 92.68 %
 
Word Error Rate (WER): 92.68 %
 +
 
Number of position-independent correct words: 3
 
Number of position-independent correct words: 3
 +
 
Position-independent word error rate (PER): 92.68 %
 
Position-independent word error rate (PER): 92.68 %
 +
  
 
Statistics about the translation of unknown words
 
Statistics about the translation of unknown words
 
-------------------------------------------------------
 
-------------------------------------------------------
 
Number of unknown words which were free rides: 0
 
Number of unknown words which were free rides: 0
 +
 
Percentage of unknown words that were free rides: 0%
 
Percentage of unknown words that were free rides: 0%
  

Revision as of 14:39, 29 April 2021

Pre-Evaluation

Statistics about input files


Number of words in reference: 41

Number of words in test: 28

Number of unknown words (marked with a star) in test:

Percentage of unknown words: 0.00 %


Results when removing unknown-word marks (stars)


Edit distance: 38

Word error rate (WER): 92.68 %

Number of position-independent correct words: 3

Position-independent word error rate (PER): 92.68 %


Results when unknown-word marks (stars) are not removed


Edit distance: 38

Word Error Rate (WER): 92.68 %

Number of position-independent correct words: 3

Position-independent word error rate (PER): 92.68 %


Statistics about the translation of unknown words


Number of unknown words which were free rides: 0

Percentage of unknown words that were free rides: 0%

Examples

Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, biltrans, transfer, and the pair itself (abc-xyz).

Post Evaluation

Perform WER, PER, and coverage tests again