Difference between revisions of "Sardinian and English"
(→Final evaluation) |
(→Final evaluation) |
||
| Line 52: | Line 52: | ||
Position-independent word error rate (PER): 70.79 % | Position-independent word error rate (PER): 70.79 % | ||
** The proportion of stems translated correctly in the <code>longer</code> corpus. | ** The proportion of stems translated correctly in the <code>longer</code> corpus. | ||
| + | 118/346 = 34.6% | ||
** Trimmed coverage over <code>longer</code> and <code>large</code> corpora. | ** Trimmed coverage over <code>longer</code> and <code>large</code> corpora. | ||
** The number of tokens in <code>longer</code> and <code>large</code> corpora. | ** The number of tokens in <code>longer</code> and <code>large</code> corpora. | ||
Revision as of 18:04, 4 May 2023
Contents
Resources for Machine Translation from Sardinian to English
Developed Resources
- Parallel corpus git repo.
- Lines 1-8 from this website.
- Git repo for language pair
- Git repo for Sardinian
- Forked git repo for English
- Lexical selection wiki
- Contrastive grammar wiki
- Structural transfer wiki
srd → eng evaluation
- coverage of monolingual Sardinian transducer on srd.sentences.txt:
Number of tokenised words in the corpus: 262 Coverage: 94.66%
- coverage of bilingual transducer on srd.sentences
Number of tokenised words in the corpus: 266 Coverage: 85.71%
Additions for polished RBMT system
- Over 100 new stems to bilingual dictionary
- (now we have 172 total entries in the .dix file)
- 4 sets of lexical selection rules
- (now we have rules that solve 5 problems in total)
- 3 items from contrastive grammar implemented in transfer rules
- (now we have rules that implement 4 total items)
Final evaluation
- For the monolingual transducer:
- Updated precision and recall against the (updated)
eval.testandeval.goldfiles - Coverage over the
largecorpus: - The number of words in the
largecorpus, - The number of stems in the transducer.
- Updated precision and recall against the (updated)
- For MT in the direction we developed (
srd-eng):- WER and PER over
longercorpus:
- WER and PER over
------------------------------------------------------- Number of words in reference: 315 Number of words in test: 341 Number of unknown words (marked with a star) in test: 35 Percentage of unknown words: 10.26 % Results when removing unknown-word marks (stars) ------------------------------------------------------- Edit distance: 246 Word error rate (WER): 78.10 % Number of position-independent correct words: 118 Position-independent word error rate (PER): 70.79 %
- The proportion of stems translated correctly in the
longercorpus.
- The proportion of stems translated correctly in the
118/346 = 34.6%
- Trimmed coverage over
longerandlargecorpora. - The number of tokens in
longerandlargecorpora.
- Trimmed coverage over
10 sentences glosses and outputs
- Note: These are outputs at end of lexical transfer before lexical selection and other weeks' improvements were implemented
| Sardinian sentence | intended English translation | output of srd-eng-biltrans (lexical transfer) mode | output of srd-eng (full translation) mode | |
| 1) Su sardu est una limba antica. | Sardinian is an ancient language. | ^Su<det><def><m><sg>/The<det><def><m><sg>$ ^sardu<n><m><sg>/Sardinian<n><sg>$ ^èssere<vbser><pri><p3><sg>/be<vbser><pri><p3><sg>$ ^unu<det><ind><f><sg>/a<det><ind><f><sg>$ ^limba<n><f><sg>/language<n><sg>$ ^anticu<adj><f><sg>/ancient<adj><f><sg>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | #The Sardinian #be #a language #ancient | |
| 2) Pro bider s'artìculu sighire custu culligamentu. | To read the article click on this link. | ^Pro<pr>/For<pr>/To<pr>$ ^bider<vblex><inf>/read<vblex><inf>$ ^su<det><def><mf><sg>/the<det><def><mf><sg>$ ^artìculu<n><m><sg>/article<n><sg>$ ^sighire<vblex><inf>/click<vblex><inf>$ ^custu<det><dem><m><sg>/this<det><m><sg>$ ^culligamentu<n><m><sg>/link<n><sg>$^.<sent>/.<sent>$^.<sent>/.<sent>$<m><sg>$ ^culligamentu<n><m><sg>/link<n><sg>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | For read #the article click #this link. | |
| 3) Su trenu sinke fit andande. | The train was leaving. | ^Su<det><def><m><sg>/The<det><def><m><sg>$ ^trenu<n><m><sg>/train<n><sg>$ ^sinke<cnjadv>/$ ^èssere<vbser><pii><p3><sg>/be<vbser><pii><p3><sg>$ ^andare<vblex><ger>/leave<vblex><ger>/go<vblex><ger>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | #The train #be leaving. | |
| 4) Su trenu at a arrivare a sas deke. | The train will arrive at ten. | ^Su<det><def><m><sg>/The<det><def><m><sg>$ ^trenu<n><m><sg>/train<n><sg>$ ^àere<vbhaver><pri><p3><sg>/have<vbhaver><pri><p3><sg>$ ^a<pr>/at<pr>/on<pr>/to<pr>$ ^arrivare<vblex><inf>/arrive<vblex><inf>$ ^a<pr>/at<pr>/on<pr>/to<pr>$ ^su<det><def><f><pl>/the<det><def><f><pl>$ ^deke<num><mf><sp>/ten<num><mf><sp>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | #The train #have at arrive at #the #ten. | |
| 5) Su trenu devet arrivare a sas deke. | The train should arrive at ten. | ^Su<det><def><m><sg>/The<det><def><m><sg>$ ^trenu<n><m><sg>/train<n><sg>$ ^dèvere<vblex><pri><p3><sg>/shall<vbmod><pri><p3><sg>$ ^arrivare<vblex><inf>/arrive<vblex><inf>$ ^a<pr>/at<pr>/on<pr>/to<pr>$ ^su<det><def><f><pl>/the<det><def><f><pl>$ ^deke<num><mf><sp>/ten<num><mf><sp>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | #The train #shall arrive at #the #ten. | |
| 6) T'appo natu ki su trenu devíat arrivare a sas deke. | I told you that the train would arrive at ten. | ^Ti<prn><pro><p2><mf><sg>/You<prn><pro><p2><mf><sg>$ ^àere<vbhaver><pri><p1><sg>/have<vbhaver><pri><p1><sg>$ ^nàrrere<vblex><pp><m><sg>/tell<vblex><pp><m><sg>$ ^chi<cnjsub>/that<cnjsub>$ ^su<det><def><m><sg>/the<det><def><m><sg>$ ^trenu<n><m><sg>/train<n><sg>$ ^dèvere<vblex><pii><p3><sg>/shall<vbmod><pii><p3><sg>$ ^arrivare<vblex><inf>/arrive<vblex><inf>$ ^a<pr>/at<pr>/on<pr>/to<pr>$ ^su<det><def><f><pl>/the<det><def><f><pl>$ ^deke<num><mf><sp>/ten<num><mf><sp>$^.<sent>/.<sent>$^.<sent>/.<sent>$ | #You #have #tell that #the train #shall arrive at #the #ten. | |
| 7) No'isco si at a pròere cras. | I do not know if it will rain tomorrow. | ^No<adv>/Not<adv>$'^iscoare<vblex><pri><p1><sg>/know<vblex><pri><p1><sg>$ ^si<cnjsub>/if<cnjsub>$ ^àere<vbhaver><pri><p3><sg>/have<vbhaver><pri><p3><sg>$ ^a<pr>/at<pr>/on<pr>/to<pr>$ ^pròere<vblex><inf>/rain<vblex><inf>$ ^cras<adv>/tomorrow<adv>$^.<sent>/.<sent>$ | Not'#know if #have at rain tomorrow | |
| 8) Una de sas berbekes est maláida. | One of the sheep is sick. | ^Unu<num><f><sp>/One<num><f><sp>$ ^de<pr>/to<pr>/of<pr>$ ^su<det><def><f><pl>/the<det><def><f><pl>$ ^berbeke<n><f><pl>/sheep<n><pl>$ ^èssere<vbser><pri><p3><sg>/be<vbser><pri><p3><sg>$ ^malàidu<adj><f><sg>/sick<adj><f><sg>$^.<sent>/.<sent>$ | #One to #the sheep #be #sick | |
| 9) Appo pèrditu duos de sos libros meos. | I have lost two of my books. | ^Àere<vbhaver><pri><p1><sg>/Have<vbhaver><pri><p1><sg>$ ^pèrdere<vblex><pp><m><sg>/lose<vblex><pp><m><sg>$ ^duos<num><m><sp>/two<num><m><sp>$ ^de<pr>/to<pr>/of<pr>$ ^su<det><def><m><pl>/the<det><def><m><pl>$ ^libru<n><m><pl>/book<n><pl>$ ^meu<prn><pos><m><pl>/my<prn><pos><m><pl>$^.<sent>/.<sent>$ | #Have #lose #two to #the books #my | |
| 10) M'an natu ki su trenu devíat arrivare a sas nove. | They told me that the train was supposed to arrive at nine. | ^Mi<prn><pro><p1><mf><sg>/I<prn><pro><p1><mf><sg>$ ^àere<vbhaver><pri><p3><pl>/have<vbhaver><pri><p3><pl>$ ^nàrrere<vblex><pp><m><sg>/tell<vblex><pp><m><sg>$ ^chi<cnjsub>/that<cnjsub>$ ^su<det><def><m><sg>/the<det><def><m><sg>$ ^trenu<n><m><sg>/train<n><sg>$ ^dèvere<vblex><pii><p3><sg>/shall<vbmod><pii><p3><sg>$ ^arrivare<vblex><inf>/arrive<vblex><inf>$ ^a<pr>/at<pr>/on<pr>/to<pr>$ ^su<det><def><f><pl>/the<det><def><f><pl>$ ^nove<num><mf><sp>/nine<num><mf><sp>$^.<sent>/.<sent>$ | #I #have #tell that #the train #shall arrive at #the #nine |
expanding lexicon
| medas | many | <adj> | |
| piseddas | girls | <n><pl> | |
| sun | they are | <v> | |
| bennidas | to come (home) | <v><pp><fpl> | |
| balladu | to dance | <v><pp> | |
| cantaiat | to sing | <v><sg3> | |
| sos/sa | the | <det> | |
| piattos | plates | <n><pl> | |
| mesa | table | <n><sg> | |
| bi/b' | N/A | <cl> | |
| problemas | problems | <n><pl> | |
| unu | one/a | <adj>/<det> | |
| ube | where | <adv> | |
| mortu | dead | <v><pp> | |
| sordatos | soldiers | <n><pl> | |
| tenimus | we have | <v><pl1> | |
| frores | flowers | <n><pl> | |
| keret | to be necessary | <v><sg3> | |
| mancat | to be missing | <v><sg3> | |
| ovos | eggs | <n><pl> | |
| danca | meadow | <n> | |
| ortu | orchard | <n> | |
| frade | brother | <n> | |
| fizza | daughter | <n> | |
| re | king | <n> | |
| ora | hour | <n> | |
| subra | above/on | <prep> | |
| a | to/at | <prep> | |
| cumintzos | origins | <n><pl> | |
| e | and | <conj> | |
| andamentu | evolution | <n> | |
| istòricu | historical | <adj> | |
| de | of/to | <prep> | |
| sa | the | <det> | |
| poesia | poetry | <n> | |
| a bolu | improvised | <adj> (a bolu = improvised, on the fly) | |
| in | in | <prep> | |
| sardu | Sardinian | <n> | |
| logudoresu | Logudorese | <adj> | |
| non | not | <adv> | |
| ischit | known | <v><pp> | |
| meda | much | <adv> | |
| custu | this | <det><prox> | |
| artìculu | article | <n> | |
| chircat | tries | <v><sg3> | |
| bogare | to bring out | <v> | |
| pizu | surface | <n> (bogare a pizu = to shed light on, to bring to the surface; see complicated translations of bogare: here) | |
| ammentos | memories | <n><pl> | |
| ammentu | memory | <n> | |
| ammentare | to remember | <v> | |
| documentados | documented | <adj> | |
| si | [null] | <> -- reflexive | |
| primas | first | <adj> | |
| disputas | competitions | <n><pl> | |
| primas | first | <adj> | |
| tra | between | <prep> | |
| poetes | poets | <n><pl> | |
| cale | which | <prn><rel> | |
| esserent | were | <v> past imperfect 3rd person plural | |
| règulas | rules, modalities | <n><pl> | |
| su | the | <det> | |
| cunfruntu | confrontation | <n> | |
| sende | being | <v><ger> | |
| una | a/one | <art>/<adj> | |
| chirca | research | <n> | |
| andera | ongoing/progressive | <adj> | |
| testu | text | <n> | |
| diat | [null] | <subj><sg3> | |
| poder | to be able to | <v><inf> | |
| aer | to have | <v><inf> (also hàere or àere) | |
| mudonzos | modifications | <n><pl> | |
| mudonzos | modifications | <n><pl> | |
| novas | new | <adj><pl> | |
| noas | data | <n><pl> | |
| Pro | to | <prep> <-- keep this in mind for lexical selection (to) | |
| bider | to read | <v><inf> | |
| artìculu | article | <n> | |
| sighire | click on | <v><inf> | |
| intrare | enter | <v><inf> | |
| desizadu | desired | <adj> | |
| trenu | train | <n> | |
| sinke | [null] | <foc> | |
| fit | was | <v> <imp><sg3> | |
| andande | leaving | <v><ger> | |
| at | it will | <> | |
| sas | the | <det> | |
| deke | ten | <n> | |
| devet | should | <adv> | |
| deke | ten | <adj> | |
| appo | I have | <v><sg1> | |
| natu | told | <v><pp> | |
| próere | to rain | <v><inf> | |
| arrivare | to arrive | <v><inf> | |
| isco | I know | <v><sg1> | |
| si | if | <conj> | |
| ki | that | <conj> | |
| cras | tomorrow | <adv> | |
| meos | my | <pos> | |
| andatos | gone | <adj><pl> |
glosses
Cando so arrivatu a s'istazione, su trenu sink'andaiat
'when I arrived at the station, the train was leaving'
Su trenu sinke fit andande
'The train was leaving"
Su trenu at a arrivare a sas deke
'The train will arrive at ten o'clock'
Su trenu devet arrivare a sas deke
'The train is supposed to arrive at ten o'clock'
T'appo natu ki su trenu diat arrivare a sas deke
'I told you that the train would arrive at ten o'clock'
M'an natu ki su trenu devíat arrivare a sas nove
'They told me that the train was supposed to arrive at nine'
At a próere cras
'It will rain tomorrow'
Devet próere cras
'it is supposed to rain tomorrow'
At a próere cras? Si emmo abbarramus in domo, ma su nono andamus a mare
'Will it rain tomorrow? If so we shall stay at homr, buy if not we will go to the sea'
No'isco si at a próere cras
'I do to know whether it will rain tomorrow'
Una de sas berbekes est maláida
'one of the sheep is sick'
Appo pèrditu duos de sos libros meos
'I have lost two of my books'
Metas de custas pitzinnas sun galanas
'Many of these girls are pretty'
Una pitzinna meta bella
'a very beautiful girl'
Cussas duas bravas pitzinnas
'those two good girls'
unu better cane bellu
'a huge beautiful dog'
un'átteru bette cane
'another huge dog'
Sun andatos a Frantza
'they went to France'
Est ghiratu dae Corsica
'He returned from Corsica'
Connnosco bene sa Frantza
"i know France well'
Custu libru est iscrittu in tedescu
'This book is written in German'
Cussus paráula venit dae su catalanu
'This word comes from Catalan'
Su sardu est una limba antica
'Sardinian is an ancient language'
Appo mandicatu casu
'I ate cheese'
Laura est toddende frores
'Laura is picking flowers'
De frores non nd'appo tódditu
'I did not pick any flowers'
No'amus comporatu pane
'We did not buy bread'
Mandico sa pasta kin casu
'I ate pasta with cheese'
Tres sórrikes an mandicatu tottu su casu
'Three mice ate all the cheese'
semus ponnende vinu in ampullas
'We are putting wine in bottles'
lettu meu esr
'It is my bed'
No'appo lessu libru perunu
'i did not read any book'
Sos k'an furatu si dinari at a èssere punitos
'The people who stole the money will be punished'
Appo invitat sos de Juanne
'I invited Jon's family'
Cussa pinna est sa mea
'That pen is mine'
Cudda mákkina est sa de Juanne
'That car is John's'
Custa ricca at datu mili francos a su vetzu
'This rich woman gave a thousand lira to the old man'
Su guvernu devíat dare ua pensione a dondzi vetzu
'The government should give a pension to every old person'
External Resources
- Github repository for Sardinian transducer (and our clone)
- Github repository for English transducer
- Dictionary pdf
- Online official dictionary
- Web-based machine translator
- Sardinian-Italian web-based dictionary
- 1931 pdf with select translations
- Definiteness effects: evidence from Sardinian
- Webster's Sardinian English Thesaurus Dictionary
- Italian-Sardinian Dictionary
- Old but extensive Sardo-Italian and vice versa dictionary
- nice Sardo-Italiano dictionary pdf
- Conjugations of "to have" in Sardinian
- Whole Sardinian grammar page about conjugations of to have all written in Sardinian language!
- Sardinian grammar:pdf,,