Difference between revisions of "Rungus and English/Structural Transfer"

From LING073
Jump to: navigation, search
(→‎Post-Evaluation)
 
(6 intermediate revisions by one other user not shown)
Line 5: Line 5:
  
 
==Structural Transfer==
 
==Structural Transfer==
−
 
−
Add at least one example sentence for each item you implement. Show the outputs of the following modes for your translation system: tagger, lex, transfer, and the pair itself (abc-xyz).
 
−
Perform WER, PER, and coverage tests again, and add into a post-evaluation section on the wiki page.
 
  
 
===Word Order===
 
===Word Order===
Line 18: Line 15:
  
 
==Post-Evaluation==
 
==Post-Evaluation==
 +
 +
* Coverage: 48/48 (1)
  
 
===Statistics about input files===
 
===Statistics about input files===
 
* Number of words in reference: 44
 
* Number of words in reference: 44
−
* Number of words in test: 33
+
* Number of words in test: 38
 
* Number of unknown words (marked with a star) in test: 0
 
* Number of unknown words (marked with a star) in test: 0
 
* Percentage of unknown words: 0.00 %
 
* Percentage of unknown words: 0.00 %
  
 
===Results when removing unknown-word marks (stars)===
 
===Results when removing unknown-word marks (stars)===
−
* Edit distance: 44
+
* Edit distance: 37
−
* Word error rate (WER): 100.00 %
+
* Word error rate (WER): 84.09 %
−
* Number of position-independent correct words: 2
+
* Number of position-independent correct words: 9
−
* Position-independent word error rate (PER): 95.45 %
+
* Position-independent word error rate (PER): 79.55 %
  
 
[[Category:Sp25_StructuralTransfer]]
 
[[Category:Sp25_StructuralTransfer]]
 
[[Category:Rungus]]
 
[[Category:Rungus]]
 
[[Category:English]]
 
[[Category:English]]

Latest revision as of 01:06, 7 May 2025

Pre-Evaluation

  • WER: 82.35%
  • PER: 82.35%

Structural Transfer

Word Order

  • (drg) Momobog ko dialo → (eng) You hit him
    • Tagger: ^Bobog<v><impf><af>$ ^ko<prn><pers><p2><sg><nom>$ ^dialo<prn><pers><p3><sg><acc>$^.<sent>$
    • Lex: ^Bobog<v><impf><af>/Hit<v><impf><af>$ ^ko<prn><pers><p2><sg><nom>/you<prn><pers><p2><sg><nom>$ ^dialo<prn><pers><p3><sg><acc>/him<prn><pers><p3><sg><acc>/her<prn><pers><p3><sg><acc>$^.<sent>/.<sent>$
    • Transfer: ^you<prn><pers><p2><sg><nom>$ ^Hit<v><impf><af>$ ^him<prn><pers><p3><sg><acc>$^.<sent>$
    • drg-eng: #you #Hit #him

Post-Evaluation

  • Coverage: 48/48 (1)

Statistics about input files

  • Number of words in reference: 44
  • Number of words in test: 38
  • Number of unknown words (marked with a star) in test: 0
  • Percentage of unknown words: 0.00 %

Results when removing unknown-word marks (stars)

  • Edit distance: 37
  • Word error rate (WER): 84.09 %
  • Number of position-independent correct words: 9
  • Position-independent word error rate (PER): 79.55 %