Difference between revisions of "Chechen and English/Structural transfer"

From LING073
Jump to: navigation, search
(Outputs For Example Sentence)
(Outputs For Example Sentence)
Line 41: Line 41:
 
** <code>^prpers<det><p1><mf><sg><pos>$ ^name<n><sg>$ ^be<vbser><pres><p3><sg>$ ^Ivan<np><ant><m><sg>$^.<sent>$</code>
 
** <code>^prpers<det><p1><mf><sg><pos>$ ^name<n><sg>$ ^be<vbser><pres><p3><sg>$ ^Ivan<np><ant><m><sg>$^.<sent>$</code>
 
*'''Translation:''' My name is Ivan.  
 
*'''Translation:''' My name is Ivan.  
 +
==Post-evaluation==
 +
<pre>
 +
Statistics about input files
 +
-------------------------------------------------------
 +
Number of words in reference: 43
 +
Number of words in test: 43
 +
Number of unknown words (marked with a star) in test: 13
 +
Percentage of unknown words: 30.23 %
 +
 +
Results when removing unknown-word marks (stars)
 +
-------------------------------------------------------
 +
Edit distance: 43
 +
Word error rate (WER): 100.00 %
 +
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
 +
Results when unknown-word marks (stars) are not removed
 +
-------------------------------------------------------
 +
Edit distance: 43
 +
Word Error Rate (WER): 100.00 %
 +
Number of position-independent correct words: 0
 +
Position-independent word error rate (PER): 100.00 %
 +
 +
Statistics about the translation of unknown words
 +
-------------------------------------------------------
 +
Number of unknown words which were free rides: 0
 +
Percentage of unknown words that were free rides: 0.00 %
 +
</pre>
 
[[Category:Sp19_StructuralTransfer]]
 
[[Category:Sp19_StructuralTransfer]]
 
[[Category:Chechen]]
 
[[Category:Chechen]]
 
[[Category:English]]
 
[[Category:English]]

Revision as of 10:45, 16 April 2019

Pre-Evaluation

Statistics about input files
-------------------------------------------------------
Number of words in reference: 38
Number of words in test: 43
Number of unknown words (marked with a star) in test: 13
Percentage of unknown words: 30.23 %

Results when removing unknown-word marks (stars)
-------------------------------------------------------
Edit distance: 43
Word error rate (WER): 113.16 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 113.16 %

Results when unknown-word marks (stars) are not removed
-------------------------------------------------------
Edit distance: 43
Word Error Rate (WER): 113.16 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 113.16 %

Statistics about the translation of unknown words
-------------------------------------------------------
Number of unknown words which were free rides: 0
Percentage of unknown words that were free rides: 0.00 %

Outputs For Example Sentence

  • Input text: сан цӀе Иван ю
  • Tagger:
    • ^сан/сан<prn><pers><p1><sg><gen>$ ^цӀе/цӀе<n><cl_j><abs><sg>$ ^Иван/Иван<np><ant><abs><sg>$ ^ю/у<v><cpl><pres><cl_j>$^./.<sent>$
  • biltrans:
    • ^сан<prn><pers><p1><sg><gen>/prpers<det><pers><p1><sg><gen>$ ^цӀе<n><cl_j><abs><sg>/name<n><abs><sg>$ ^Иван<np><ant><abs><sg>/Ivan<np><ant><m><abs><sg>$ ^у<v><cpl><pres><cl_j>/be<vbser><pres><cl_j>$^.<sent>/.<sent>$
  • chunker:
    • ^prn<DET>{^prpers<det><p1><mf><sg><pos>$}$ ^propnom<SN><abs>{^name<n><sg>$}$ ^nom<SN>{^Ivan<np><ant><m><sg>$}$ ^v<SV><p3><sg>{^be<vbser><pres><2><3>$}$^sent<SENT>{^.<sent>$}$
  • interchunk:
    • ^prn<DET>{^prpers<det><p1><mf><sg><pos>$}$ ^propnom<SN><abs>{^name<n><sg>$}$ ^v<SV><p3><sg>{^be<vbser><pres><2><3>$}$ ^nom<SN>{^Ivan<np><ant><m><sg>$}$^sent<SENT>{^.<sent>$}$
  • postchunk:
    • ^prpers<det><p1><mf><sg><pos>$ ^name<n><sg>$ ^be<vbser><pres><p3><sg>$ ^Ivan<np><ant><m><sg>$^.<sent>$
  • Translation: My name is Ivan.

Post-evaluation

Statistics about input files
-------------------------------------------------------
Number of words in reference: 43
Number of words in test: 43
Number of unknown words (marked with a star) in test: 13
Percentage of unknown words: 30.23 %

Results when removing unknown-word marks (stars)
-------------------------------------------------------
Edit distance: 43
Word error rate (WER): 100.00 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 100.00 %

Results when unknown-word marks (stars) are not removed
-------------------------------------------------------
Edit distance: 43
Word Error Rate (WER): 100.00 %
Number of position-independent correct words: 0
Position-independent word error rate (PER): 100.00 %

Statistics about the translation of unknown words
-------------------------------------------------------
Number of unknown words which were free rides: 0
Percentage of unknown words that were free rides: 0.00 %