Difference between revisions of "Tiwi and English/Structural transfer"

From LING073
Jump to: navigation, search
(update modes)
(Pre-Evaluation)
Line 1: Line 1:
  
 
== Pre-Evaluation ==
 
== Pre-Evaluation ==
Perform WER, PER, and coverage tests on your short sentences corpus
+
Statistics about input files
 +
-------------------------------------------------------
 +
Number of words in reference: 41
 +
Number of words in test: 28
 +
Number of unknown words (marked with a star) in test:
 +
Percentage of unknown words: 0.00 %
 +
 
 +
Results when removing unknown-word marks (stars)
 +
-------------------------------------------------------
 +
Edit distance: 38
 +
Word error rate (WER): 92.68 %
 +
Number of position-independent correct words: 3
 +
Position-independent word error rate (PER): 92.68 %
 +
 
 +
Results when unknown-word marks (stars) are not removed
 +
-------------------------------------------------------
 +
Edit distance: 38
 +
Word Error Rate (WER): 92.68 %
 +
Number of position-independent correct words: 3
 +
Position-independent word error rate (PER): 92.68 %
 +
 
 +
Statistics about the translation of unknown words
 +
-------------------------------------------------------
 +
Number of unknown words which were free rides: 0
 +
Percentage of unknown words that were free rides: 0%
  
 
== Examples ==
 
== Examples ==

Revision as of 14:38, 29 April 2021

Pre-Evaluation

Statistics about input files


Number of words in reference: 41 Number of words in test: 28 Number of unknown words (marked with a star) in test: Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)


Edit distance: 38 Word error rate (WER): 92.68 % Number of position-independent correct words: 3 Position-independent word error rate (PER): 92.68 %

Results when unknown-word marks (stars) are not removed


Edit distance: 38 Word Error Rate (WER): 92.68 % Number of position-independent correct words: 3 Position-independent word error rate (PER): 92.68 %

Statistics about the translation of unknown words


Number of unknown words which were free rides: 0 Percentage of unknown words that were free rides: 0%

Examples

Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, biltrans, transfer, and the pair itself (abc-xyz).

Post Evaluation

Perform WER, PER, and coverage tests again