Difference between revisions of "Kperalt1/Final Project"
From LING073
(→Shanghainese wuu → English eng Sentence Evaluation) |
(→Statistics about input files) |
||
| Line 238: | Line 238: | ||
==Statistics about input files== | ==Statistics about input files== | ||
| − | *Number of words in reference: | + | *Number of words in reference: 8105 |
| − | *Number of words in test: | + | *Number of words in test: 9263 |
| − | *Number of unknown words (marked with a star) in test: | + | *Number of unknown words (marked with a star) in test: 4696 |
| − | *Percentage of unknown words: | + | *Percentage of unknown words: 50.70 % |
Results when removing unknown-word marks (stars) | Results when removing unknown-word marks (stars) | ||
------------------------------------------------------- | ------------------------------------------------------- | ||
| − | *Edit distance: | + | *Edit distance: 9777 |
| − | *Word error rate (WER): | + | *Word error rate (WER): 120.63 % |
| − | *Number of position-independent correct words: | + | *Number of position-independent correct words: 156 |
| − | *Position-independent word error rate (PER): | + | *Position-independent word error rate (PER): 112.36 % |
[[Category:Shanghainese]] | [[Category:Shanghainese]] | ||
Revision as of 01:09, 16 May 2025
Contents
Resources for machine translation between Shanghainese and English
- Resources developed for Shanghainese:
- Link to resources developed for Shanghainese: [1]
- Resources developed for English:
External Resources
- Link to repository language pair:[2]
- Link to Shanghainese repository transducer:[3]
- Link to English repository transducer:[4]
- Link to Shanghainese to English Text: [5]
Shanghainese wuu → English eng Sentence Evaluation
Sentences
- (1)
wuu: 我爱侬。-
eng: I love you. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^爱<vblex>/love<vblex>$ ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^.<sent>/.<sent>
- full translation output: I #love you .
-
- (2)
wuu: 我有很多朋友。-
eng: I have many friends. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^有<vblex>/have<vblex>$ ^很多<adj>/many<det><qnt><pl>$ ^朋友<n>/friend<n><pl>$ ^.<sent>/.<sent>
- full translation output: I #have many friends .
-
- (3)
wuu: 侬欢喜唱歌伐？-
eng: Do you like singing? - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^欢喜<vblex>/like<vblex>$ ^唱歌<n>/singing<n><sg>$ ^伐<qst>/$ ^.<sent>/.<sent>
- full translation output: you #like singing ?
-
- (4)
wuu: 早上好。-
eng: Good morning. - lexical transfer output: ^早上好<ij>/good morning<ij>$ ^.<sent>/.<sent>
- full translation output: good morning .
-
- (5)
wuu: 侬要吃茶还是吃咖啡啊？-
eng: Do you want to drink tea or coffee? - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^要<vaux>/want<vblex>/will<vblex>/want to<vbmod>$ ^吃<vblex>/eat<vblex>/drink<vblex>$ ^茶<n>/tea<n><sg>$ ^还是<cnjcoo>/or<cnjcoo>$ ^吃<vblex>/eat<vblex>/drink<vblex>$ ^咖啡<n>/coffee<n><sg>$ ^啊<part>/$ ^.<sent>/.<sent>
- full translation output: you #want to #drink tea or #drink coffee ?
-
- (6)
wuu: 是我个，勿是伊个。-
eng: It's mine, not his. - lexical transfer output: ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^我<prn><pers><p1><sg><pos>/I<prn><subj><p1><mf><sg><pos>$ ^，<cm>/,<cm>$ ^勿是<vaux>/not<adv>$ ^伊<prn><pers><p3><sg><pos>/he<prn><subj><p3><m><sg><pos>/it<prn><subj><p3><nt><sg><pos>/her<prn><obj><p3><f><sg><pos>/him<prn><obj><p3><m><sg><pos>/his<prn><pos><p3><m><sg><pos>/she<prn><subj><p3><f><sg><pos>/hers<prn><pos><p3><f><sg><pos>$ ^.<sent>/.<sent>
- full translation output: #is my , not his .
-
- (7)
wuu: 搿是我个行李。-
eng: Here is my baggage. - lexical transfer output: ^搿<adv>/here<adv>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^我<prn><pers><p1><sg><pos>/I<prn><subj><p1><mf><sg><pos>$ ^行李<n>/baggage<n><sg>$ ^.<sent>/.<sent>
- full translation output: here #is my baggage .
-
- (8)
wuu: 伊是法国人。-
eng: She is French. or He is French. - lexical transfer output: ^伊<prn><pers><p3><sg>/he<prn><subj><p3><m><sg>/it<prn><subj><p3><nt><sg>/her<prn><obj><p3><f><sg>/him<prn><obj><p3><m><sg>/his<prn><pos><p3><m><sg>/she<prn><subj><p3><f><sg>/hers<prn><pos><p3><f><sg>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^法国人<n>/French<n><pl>$ ^.<sent>/.<sent>
- full translation output: he #is French .
-
- (9)
wuu: 我每天六点钟起床。-
eng: I get up at six every day. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^每天<adv>/every day<adv>$ ^六点钟<n>/six<num><pl>$ ^起床<vblex>/wake up<vblex>$ ^.<sent>/.<sent>
- full translation output: I every day six #wake up .
-
- (10)
wuu: 一、二、三、四、五、六、七、八、九、十。-
eng: One, two, three, four, five, six, seven, right, nine, ten. - lexical transfer output: ^一<num>/one<num><sg>$ ^、<cm>/,<cm>$ ^二<num>/two<num><pl>$ ^、<cm>/,<cm>$ ^三<num>/three<num><pl>$ ^、<cm>/,<cm>$ ^四<num>/four<num><pl>$ ^、<cm>/,<cm>$ ^五<num>/five<num><pl>$ ^、<cm>/,<cm>$ ^六<num>/six<num><pl>$ ^、<cm>/,<cm>$ ^七<num>/seven<num><pl>$ ^、<cm>/,<cm>$ ^八<num>/eight<num><pl>$ ^、<cm>/,<cm>$ ^九<num>/nine<num><pl>$ ^、<cm>/,<cm>$ ^十<num>/ten<num><pl>$ ^.<sent>/.<sent>
- full translation output: one , two , three , four , five , six , seven , eight , nine , ten .
-
- (11)
wuu: 侬要走啦？-
eng: Do you want to go? - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^要<vaux>/want<vblex>/will<vblex>/want to<vbmod>$ ^走<vblex>/go<vblex>$ ^啦<part>/$ ^.<sent>/.<sent>
- full translation output: you #want to #go ?
-
- (12)
wuu: 麻烦侬了。-
eng: Sorry to trouble you. - lexical transfer output: ^麻烦<vblex>/trouble<vblex>$ ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^了<part>/$ ^.<sent>/.<sent>
- full translation output: #trouble you .
-
- (13)
wuu: 我老勿好意思个。-
eng: I'm too ashamed. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^老<adv>/too<adv>$ ^勿好意思<adj>/ashamed<adj>$ ^个<part>/$ ^.<sent>/.<sent>
- full translation output: I too ashamed .
-
- (14)
wuu: 谢谢侬噢！-
eng: Thank you! - lexical transfer output: ^谢谢<vblex>/thank<vblex>$ ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^噢<part>/$ ^.<sent>/.<sent>
- full translation output: #thank you .
-
- (15)
wuu: 昨日是啥个天气？-
eng: What was the weather yesterday? - lexical transfer output: ^昨日<n>/yesterday<n><sg>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^啥<prn><itg>/what<prn><itg><mf><sp>$ ^个<part>/$ ^天气<n>/weather<n><sg>$ ^.<sent>/.<sent>
- full translation output: yesterday #is what weather ?
-
- (16)
wuu: 明朝要落雪。-
eng: It will snow tomorrow. - lexical transfer output: ^明朝<n>/tomorrow<n><sg>$ ^要<vaux>/want<vblex>/will<vblex>/want to<vbmod>$ ^落雪<vblex>/snow<vblex>$ ^.<sent>/.<sent>
- full translation output: tomorrow #will #snow .
-
- (17)
wuu: 侬住拉阿里搭？-
eng: Where do you live? - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^住<vblex>/live<vblex>$ ^拉<pr>/at<pr>$ ^阿里搭<adv>/where<adv><itg>$ ^.<sent>/.<sent>
- full translation output: you #live at where ?
-
- (18)
wuu: 侬要多少钞票？-
eng: How much money do you want? - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^要<vaux>/want<vblex>/will<vblex>/want to<vbmod>$ ^多少<adv>/how much<adv><itg>$ ^钞票<n>/money<n><sg>$ ^.<sent>/.<sent>
- full translation output: you #want how much money ?
-
- (19)
wuu: 对勿起。-
eng: Excuse me. - lexical transfer output: ^对勿起<ij>/excuse me<ij>$ ^.<sent>/.<sent>
- full translation output: excuse me .
-
- (20)
wuu: 侬非常勇敢。-
eng: You are very brave. - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^非常<adv>/very<adv>$ ^勇敢<adj>/brave<adj><sint>$ ^.<sent>/.<sent>
- full translation output: you very brave .
-
- (21)
wuu: 侬选好了伐？-
eng: Have you chosen? - lexical transfer output: ^侬<prn><pers><p2><sg>/you<prn><pers><p2><mf><sg>$ ^选好<vblex>/chose<vblex>$ ^了<part>/$ ^伐<qst>/$ ^.<sent>/.<sent>
- full translation output: you #chose ?
-
- (22)
wuu: 够了。-
eng: That's enough. - lexical transfer output: ^够<adv>/enough<adv>$ ^了<part>/$ ^.<sent>/.<sent>
- full translation output: enough .
-
- (23)
wuu: 皮带是棕颜色个。-
eng: The belt is brown. - lexical transfer output: ^皮带<n>/belt<n><sg>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^棕颜色<adj>/brown<adj><sint>$ ^个<part>/$ ^.<sent>/.<sent>
- full translation output: belt #is brown .
-
- (24)
wuu: 我欢喜我个闲话。-
eng: I like my language. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^欢喜<vblex>/like<vblex>$ ^我<prn><pers><p1><sg><pos>/I<prn><subj><p1><mf><sg><pos>$ ^闲话<n>/language<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #like my language .
-
- (25)
wuu: 我有一支笔。-
eng: I have a pen. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^有<vblex>/have<vblex>$ ^一<num>/one<num><sg>$ ^支<part>/$ ^笔<n>/pen<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #have one pen .
-
- (26)
wuu: 有四个方向，东，南，西，北。-
eng: There are four cardinal points, East, south, west and north. - lexical transfer output: ^有<vblex>/have<vblex>$ ^四<num>/four<num><pl>$ ^个<part>/$ ^方向<n>/direction<n><pl>$ ^，<cm>/,<cm>$ ^东<adj>/east<adj>$ ^，<cm>/,<cm>$ ^南<adj>/south<adj><sint>$ ^，<cm>/,<cm>$ ^西<adj>/west<adj>$ ^，<cm>/,<cm>$ ^北<adj>/north<adj><sint>$ ^.<sent>/.<sent>
- full translation output: #have four directions , east , south , west , north .
-
- (27)
wuu: 一年有四季，春夏秋冬。-
eng: There are four seasons in a year, spring, summer, fall and winter. - lexical transfer output: ^一<num>/one<num><sg>$ ^年<n>/year<n><sg>$ ^有<vblex>/have<vblex>$ ^四<num>/four<num><pl>$ ^季<n>/season<n><pl>$ ^，<cm>/,<cm>$ ^春<n>/spring<n><sg>$ ^夏<n>/summer<n><sg>$ ^秋<n>/autumn<n><sg>$ ^冬<n>/winter<n><sg>$ ^.<sent>/.<sent>
- full translation output: one year #have four seasons , spring summer autumn winter .
-
- (28)
wuu: 请拿。-
eng: Take it, please. - lexical transfer output: ^请<ij>/please<ij>$ ^拿<vblex>/take<vblex>$ ^.<sent>/.<sent>
- full translation output: please #take .
-
- (29)
wuu: 我是游客。-
eng: I'm a tourist. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^游客<n>/tourist<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #is tourist .
-
- (30)
wuu: 现在我可以走了𠲎？-
eng: Can I leave now? - lexical transfer output: ^现在<adv>/now<adv>$ ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^可以<vbmod>/can<vbmod>$ ^走<vblex>/go<vblex>$ ^了<part>/$ ^.<sent>/.<sent>
- full translation output: now I #can #go ?
-
- (31)
wuu: 我会得弹钢琴。-
eng: I can play piano. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^会得<vbmod>/can<vbmod>$ ^弹<vblex>/play<vblex>$ ^钢琴<n>/piano<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #can #play piano .
-
- (32)
wuu: 打网球是伊个兴趣。-
eng: Playing tennis is his hobby. - lexical transfer output: ^打<vblex>/play<vblex>$ ^网球<n>/tennis<n><sg>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^伊<prn><pers><p3><sg><pos>/he<prn><subj><p3><m><sg><pos>/it<prn><subj><p3><nt><sg><pos>/her<prn><obj><p3><f><sg><pos>/him<prn><obj><p3><m><sg><pos>/his<prn><pos><p3><m><sg><pos>/she<prn><subj><p3><f><sg><pos>/hers<prn><pos><p3><f><sg><pos>$ ^兴趣<n>/hobby<n><sg>$ ^.<sent>/.<sent>
- full translation output: #play tennis #is his hobby .
-
- (33)
wuu: 勿是我个。-
eng: It's not mine. - lexical transfer output: ^勿是<vaux>/not<adv>$ ^我<prn><pers><p1><sg><pos>/I<prn><subj><p1><mf><sg><pos>$ ^.<sent>/.<sent>
- full translation output: not my .
-
- (34)
wuu: 我學習中國言話。-
eng: I learn Chinese. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^學習<vblex>/study<vblex>$ ^中國言話<adj>/Chinese<adj>$ ^.<sent>/.<sent>
- full translation output: I #study Chinese .
-
- (35)
wuu: 我申请了签证。-
eng: I applied for a visa. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^申请<vblex>/apply<vblex>$ ^了<part>/$ ^签证<n>/visa<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #apply visa .
-
- (36)
wuu: 吾欢喜吾个工作。-
eng: I like my job. - lexical transfer output: ^吾<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^欢喜<vblex>/like<vblex>$ ^吾<prn><pers><p1><sg><pos>/I<prn><subj><p1><mf><sg><pos>$ ^工作<n>/job<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #like my job .
-
- (37)
wuu: 生日快乐!-
eng: Happy birthday! - lexical transfer output: ^生日快乐<ij>/Happy birthday<ij>$ ^.<sent>/.<sent>
- full translation output: Happy birthday !
-
- (38)
wuu: 再会！-
eng: Bye! - lexical transfer output: ^再会<ij>/bye<ij>$ ^.<sent>/.<sent>
- full translation output: bye .
-
- (39)
wuu: 房间里向有老多学生子。-
eng: There are many students in the room. - lexical transfer output: ^房间<n>/room<n><sg>$ ^里向<n>/in<adv>$ ^有<vblex>/have<vblex>$ ^老<adv>/too<adv>$ ^多<adj>/many<det><qnt><pl>$ ^学生子<n>/student<n><pl>$ ^.<sent>/.<sent>
- full translation output: room in #have too many students .
-
- (40)
wuu: 伊会得讲十种语言。-
eng: He can speak ten languages. - lexical transfer output: ^伊<prn><pers><p3><sg>/he<prn><subj><p3><m><sg>/it<prn><subj><p3><nt><sg>/her<prn><obj><p3><f><sg>/him<prn><obj><p3><m><sg>/his<prn><pos><p3><m><sg>/she<prn><subj><p3><f><sg>/hers<prn><pos><p3><f><sg>$ ^会得<vbmod>/can<vbmod>$ ^讲<vblex>/speak<vblex>$ ^十<num>/ten<num><pl>$ ^种<part>/$ ^语言<n>/language<n><pl>$ ^.<sent>/.<sent>
- full translation output: he #can #speak ten languages .
-
- (41)
wuu: 吾嘴巴干。-
eng: I'm thirsty. - lexical transfer output: ^吾<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^嘴<n>/mouth<n><sg>$ ^巴干<vblex>/dry<vblex>$ ^.<sent>/.<sent>
- full translation output: I mouth #dry .
-
- (42)
wuu: 吾肚皮饿了。-
eng: I am hungry. - lexical transfer output: ^吾<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^肚皮<n>/stomach<n><sg>$ ^饿<vblex>/hungry<vblex>$ ^了<part>/$ ^.<sent>/.<sent>
- full translation output: I stomach #hungry
-
- (43)
wuu: 吾肚皮痛。-
eng: I have a stomachache. - lexical transfer output: ^吾<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^肚皮<n>/stomach<n><sg>$ ^痛<n>/ache<n><pl>$ ^.<sent>/.<sent>
- full translation output: I stomach aches .
-
- (44)
wuu: 伊是个好人。-
eng: He is a good person. - lexical transfer output: ^伊<prn><pers><p3><sg>/he<prn><subj><p3><m><sg>/it<prn><subj><p3><nt><sg>/her<prn><obj><p3><f><sg>/him<prn><obj><p3><m><sg>/his<prn><pos><p3><m><sg>/she<prn><subj><p3><f><sg>/hers<prn><pos><p3><f><sg>$ ^是<vblex>/is<vblex><p3><sg>/was<vblex><p3><sg>$ ^个<part>/$ ^好<adj>/good<adj><sint>$ ^人<n>/person<n><sg>$ ^.<sent>/.<sent>
- full translation output: he #is good person .
-
- (45)
wuu: 我要吃鱼跟海鲜。-
eng: I want to eat fish and seafood. - lexical transfer output: ^我<prn><pers><p1><sg>/I<prn><subj><p1><mf><sg>$ ^要<vaux>/want<vblex>/will<vblex>/want to<vbmod>$ ^吃<vblex>/eat<vblex>/drink<vblex>$ ^鱼<n>/fish<n><sg>$ ^跟<cnjcoo>/and<cnjcoo>$ ^海鲜<n>/seafood<n><sg>$ ^.<sent>/.<sent>
- full translation output: I #want to #eat fish and seafood .
-
Statistics about input files
- Number of words in reference: 8105
- Number of words in test: 9263
- Number of unknown words (marked with a star) in test: 4696
- Percentage of unknown words: 50.70 %
Results when removing unknown-word marks (stars)
- Edit distance: 9777
- Word error rate (WER): 120.63 %
- Number of position-independent correct words: 156
- Position-independent word error rate (PER): 112.36 %
