Difference between revisions of "Tiwi and English/Structural transfer"

From LING073
Jump to: navigation, search
(→‎Post Evaluation)
Line 70: Line 70:
  
 
Percentage of unknown words that were free rides:
 
Percentage of unknown words that were free rides:
−
 
−
 
−
Perform WER, PER, and coverage tests again
 
  
 
[[Category:Sp21_StructuralTransfer]] [[Category:Tiwi]] [[Category:English]]
 
[[Category:Sp21_StructuralTransfer]] [[Category:Tiwi]] [[Category:English]]

Revision as of 22:26, 3 May 2021

Pre-Evaluation

Statistics about input files

Number of words in reference: 41

Number of words in test: 28

Number of unknown words (marked with a star) in test:

Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)

Edit distance: 38

Word error rate (WER): 92.68 %

Number of position-independent correct words: 3

Position-independent word error rate (PER): 92.68 %

Results when unknown-word marks (stars) are not removed

Edit distance: 38

Word Error Rate (WER): 92.68 %

Number of position-independent correct words: 3

Position-independent word error rate (PER): 92.68 %

Statistics about the translation of unknown words

Number of unknown words which were free rides: 0

Percentage of unknown words that were free rides: 0%

Examples

Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, biltrans, transfer, and the pair itself (abc-xyz).

Gendered Nouns and Adjectives

Inserting 'Be' Verbs

Post Evaluation

Statistics about input files

Number of words in reference:

Number of words in test:

Number of unknown words (marked with a star) in test:

Percentage of unknown words:

Results when removing unknown-word marks (stars)

Edit distance:

Word error rate (WER):

Number of position-independent correct words:

Position-independent word error rate (PER):

Results when unknown-word marks (stars) are not removed

Edit distance:

Word Error Rate (WER):

Number of position-independent correct words:

Position-independent word error rate (PER):

Statistics about the translation of unknown words

Number of unknown words which were free rides:

Percentage of unknown words that were free rides: