Difference between revisions of "Waray and English/Structural transfer"

From LING073
Jump to: navigation, search
(Post-evaluation)
(Post-evaluation)
Line 22: Line 22:
 
-------------------------------------------------------
 
-------------------------------------------------------
 
* Number of words in reference: 1183
 
* Number of words in reference: 1183
* Number of words in test: 1241
+
* Number of words in test: 1242
* Number of unknown words (marked with a star) in test: 510
+
* Number of unknown words (marked with a star) in test: 508
* Percentage of unknown words: 41.10%
+
* Percentage of unknown words: 40.90%
  
 
Results when removing unknown-word marks (stars)
 
Results when removing unknown-word marks (stars)
 
-------------------------------------------------------
 
-------------------------------------------------------
* Edit distance: 1231
+
* Edit distance: 1229
* Word error rate (WER): 104.06 %
+
* Word error rate (WER): 103.89 %
* Number of position-independent correct words: 101
+
* Number of position-independent correct words: 103
* Position-independent word error rate (PER): 96.37 %
+
* Position-independent word error rate (PER): 96.28 %

Revision as of 02:43, 29 May 2021

Pre-evaluation

Coverage: 906 / 1467 (~0.61758691206543967280)

Statistics about input files


  • Number of words in reference: 1183
  • Number of words in test: 1308
  • Number of unknown words (marked with a star) in test: 564
  • Percentage of unknown words: 42.89 %

Results when removing unknown-word marks (stars)


  • Edit distance: 1330
  • Word error rate (WER): 112.34 %
  • Number of position-independent correct words: 39
  • Position-independent word error rate (PER): 107.27 %

Post-evaluation

Coverage: 953 / 1463 (~0.65140123034859876965)

Statistics about input files


  • Number of words in reference: 1183
  • Number of words in test: 1242
  • Number of unknown words (marked with a star) in test: 508
  • Percentage of unknown words: 40.90%

Results when removing unknown-word marks (stars)


  • Edit distance: 1229
  • Word error rate (WER): 103.89 %
  • Number of position-independent correct words: 103
  • Position-independent word error rate (PER): 96.28 %