Difference between revisions of "Shanghainese and Mandarin Chinese/Structural Transfer"
(→Pre-evaluation) |
(→Pre-evaluation) |
||
| (8 intermediate revisions by 2 users not shown) | |||
| Line 20: | Line 20: | ||
Position-independent word error rate (PER): 629.41 % | Position-independent word error rate (PER): 629.41 % | ||
| + | |||
| + | '''The evaluator didn't work properly without manual tokenisation, as such, the WER is way too big. We didn't realise this until we had finished the evaluation.''' | ||
=Structural Transfer Rules= | =Structural Transfer Rules= | ||
| + | |||
| + | ===Direct/Indirect Object Ordering=== | ||
| + | |||
| + | Shanghainese places the direct object before the indirect object while Mandarin places the indirect object before the direct object. | ||
| + | |||
| + | * {{transferTest|wuu|zho|拔一把刀其。|给他一把刀。}} | ||
| + | *: {{transferMorphTest|wuu|zho|拔{{tag|vblex}} 一{{tag|num}} 把{{tag|cls}} 刀{{tag|n}} 其{{tag|prn}}{{tag|pers}}{{tag|p3}}{{tag|sg}}|给{{tag|vblex}} 他{{tag|prn}}{{tag|pers}}{{tag|p3}}{{tag|sg}}{{tag|m}} 一{{tag|num}} 把{{tag|num}} 刀{{tag|n}} }} | ||
| + | |||
| + | * {{transferTest|wuu|zho|拔粥吾拉吃。|给我们粥吃。}} | ||
| + | *: {{transferMorphTest|wuu|zho|拔{{tag|vblex}} 粥{{tag|n}} 吾拉{{tag|prn}}{{tag|pers}}{{tag|p1}}{{tag|pl}} 吃{{tag|vblex}}|给{{tag|vblex}} 我们{{tag|prn}}{{tag|pers}}{{tag|p1}}{{tag|pl}} 粥{{tag|n}} 吃{{tag|vblex}} }} | ||
=Post-evaluation= | =Post-evaluation= | ||
| Line 27: | Line 39: | ||
==Statistics about input files== | ==Statistics about input files== | ||
| − | Number of words in reference: | + | Number of words in reference: 80 |
| − | Number of words in test: | + | Number of words in test: 91 |
| − | Number of unknown words (marked with a star) in test: | + | Number of unknown words (marked with a star) in test: 31 |
| − | Percentage of unknown words: 34. | + | Percentage of unknown words: 34.07 % |
==Results when removing unknown-word marks (stars)== | ==Results when removing unknown-word marks (stars)== | ||
| − | Edit distance: | + | Edit distance: 57 |
| + | |||
| + | Word error rate (WER): 71.25 % | ||
| + | |||
| + | Number of position-independent correct words: 33 | ||
| + | |||
| + | Position-independent word error rate (PER): 72.50 % | ||
| − | |||
| − | |||
| − | |||
Latest revision as of 16:49, 17 April 2025
Contents
Pre-evaluation
Statistics about input files
Number of words in reference: 17
Number of words in test: 109
Number of unknown words (marked with a star) in test: 38
Percentage of unknown words: 34.86 %
Results when removing unknown-word marks (stars)
Edit distance: 107
Word error rate (WER): 629.41 %
Number of position-independent correct words: 2
Position-independent word error rate (PER): 629.41 %
The evaluator didn't work properly without manual tokenisation, as such, the WER is way too big. We didn't realise this until we had finished the evaluation.
Structural Transfer Rules
Direct/Indirect Object Ordering
Shanghainese places the direct object before the indirect object while Mandarin places the indirect object before the direct object.
- (wuu) 拔一把刀其。 → (zho) 给他一把刀。
- (wuu) 拔<vblex> 一<num> 把<cls> 刀<n> 其<prn><pers><p3><sg> → (zho) 给<vblex> 他<prn><pers><p3><sg><m> 一<num> 把<num> 刀<n>
- (wuu) 拔粥吾拉吃。 → (zho) 给我们粥吃。
- (wuu) 拔<vblex> 粥<n> 吾拉<prn><pers><p1><pl> 吃<vblex> → (zho) 给<vblex> 我们<prn><pers><p1><pl> 粥<n> 吃<vblex>
Post-evaluation
Statistics about input files
Number of words in reference: 80
Number of words in test: 91
Number of unknown words (marked with a star) in test: 31
Percentage of unknown words: 34.07 %
Results when removing unknown-word marks (stars)
Edit distance: 57
Word error rate (WER): 71.25 %
Number of position-independent correct words: 33
Position-independent word error rate (PER): 72.50 %
