Fijian and English/Structural transfer

From LING073
Revision as of 09:05, 12 April 2018 by Hwang11 (talk | contribs) (Created page with "==Initial Evaluation== *eng → fij :-WER:75.81% :-PER:70.97% <pre> Test file: 'eng-fij.tests.txt' Reference file 'fij.tests.txt' Statistics about input files ---------------...")

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Initial Evaluation

  • eng → fij
-WER:75.81%
-PER:70.97%
Test file: 'eng-fij.tests.txt'
Reference file 'fij.tests.txt'

Statistics about input files
-------------------------------------------------------
Number of words in reference: 62
Number of words in test: 57
Number of unknown words (marked with a star) in test: 
Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)
-------------------------------------------------------
Edit distance: 47
Word error rate (WER): 75.81 %
Number of position-independent correct words: 18
Position-independent word error rate (PER): 70.97 %

Results when unknown-word marks (stars) are not removed
-------------------------------------------------------
Edit distance: 47
Word Error Rate (WER): 75.81 %
Number of position-independent correct words: 18
Position-independent word error rate (PER): 70.97 %

Statistics about the translation of unknown words
-------------------------------------------------------
Number of unknown words which were free rides: 0
Percentage of unknown words that were free rides: 0%
  • fij → eng
-WER:82.14%
-PER:76.79%
Test file: 'fij-eng.tests.txt'
Reference file 'eng.tests.txt'

Statistics about input files
-------------------------------------------------------
Number of words in reference: 56
Number of words in test: 57
Number of unknown words (marked with a star) in test: 
Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)
-------------------------------------------------------
Edit distance: 46
Word error rate (WER): 82.14 %
Number of position-independent correct words: 14
Position-independent word error rate (PER): 76.79 %

Results when unknown-word marks (stars) are not removed
-------------------------------------------------------
Edit distance: 46
Word Error Rate (WER): 82.14 %
Number of position-independent correct words: 14
Position-independent word error rate (PER): 76.79 %

Statistics about the translation of unknown words
-------------------------------------------------------
Number of unknown words which were free rides: 0
Percentage of unknown words that were free rides: 0%

eng → fij

fij → eng

Post-evaluation