LING073 - User contributions [en]

Mirandese/Disambiguation

2023-05-08T17:25:01Z

Nferris1:

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Github repo]

== Initial Evaluation of Ambiguity ==

Ambiguity: ~1.02782605224897238628

----

L home ten l deber de bibir plenamente.

l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> '''deber<n><m><sg>'''/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

'''la<det><def><f><sg>'''/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj><f><sg> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

*Note: Sentences are from corpus, but shortened.

== Constraints ==

*If an infinitive is preceded by a determiner (article), it functions as a noun.
*If "la" precedes a feminine singular noun, it functions as a determiner (definite article).

== Final Evaluation of Ambiguity ==

Ambiguity before disambiguation: ~1.08845420729756605105

Ambiguity after disambiguation: ~1.08774542337666751302

About 2000 forms disambiguated.

[[Category:Sp23_Disambiguation]][[Category:Mirandese]]

Mirandese/Final project

2023-05-02T18:06:12Z

Nferris1: Created page with "* Outlines what you did * Links to your code * Results of your evaluation Category:sp23_FinalProjects"

* Outlines what you did
* Links to your code
* Results of your evaluation

[[Category:sp23_FinalProjects]]

Mirandese

2023-05-02T18:05:40Z

Nferris1:

=== Developed Resources ===

*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Github repo]
*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]
*[[Mirandese/Disambiguation|Disambiguator Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Disambiguator Github repo]
*[[Mirandese and Portuguese]]
*[[Mirandese/Final project]]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blogspot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Category:Sp23 FinalProjects

2023-05-02T18:04:21Z

Nferris1:

{|class="wikitable"
|-
! group !! project
|-
| Aaliyah, Jadyn, Keira || New <code>vmw</code> transducer
|-
| Alina & Sasha || Expand and publish <code>uum</code> transducer
|-
| Athena, Rhea, Rowan || Keyboard layout suite for <code>wol</code>
|-
| Bua & Mark || Expand and publish <code>shn</code> transducer
|-
| Emilio & Niall || Expand and publish <code>mwl</code> transducer
|-
| Emily || Structural transfer for <code>ami-eng</code>
|-
| Emrys || New [[Mchalfo1/Final_Project|<code>pwn</code> transducer]]
|-
| Finn & Henry || Expand and publish <code>abe</code> transducer
|-
| Fiona & Sam || Expand and publish <code>qwh</code> transducer
|-
| Levin, Yang, Yue || Orthographic conversion / multiscript transducer for <code>jya</code>
|-
| Lonnie || Python vs. HFST for analysis of <code>ami</code>
|-
| Paulina & Tehya || New <code>roh</code> transducer
|}

[[Category:Final projects]]
[[Category:Spring 2023]]

Mirandese

2023-05-02T18:02:25Z

Nferris1: /* Developed Resources */

=== Developed Resources ===

*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Github repo]
*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]
*[[Mirandese/Disambiguation|Disambiguator Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Disambiguator Github repo]
*[[Mirandese and Portuguese]]
*[[Final project]]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blogspot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese and Portuguese

2023-04-28T18:48:27Z

Nferris1:

Resources for machine translation between [[Mirandese]] and [[Portuguese]]

== Developed Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por-corpus.git Corpus Repo]
* [[Mirandese and Portuguese/Evaluation]]
* [[Mirandese and Portuguese/Lexical selection]]
* [[Mirandese and Portuguese/Contrastive Grammar]]
* [[Mirandese and Portuguese/Structural transfer]]

== External Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por.git Mirandese and Portuguese Repo]
* [https://github.com/ferriswaynen/apertium-por.git Portuguese Transducer]
* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl.git Mirandese Transducer]

== Additions ==

* 5 mwl paradigms
* 3 mwl disambiguation rules
* 3 por disambiguation rules

== Final Evaluation ==

*Monolingual Transducer:
** Updated precision & recall:
***Precision: 98.26590%
***Recall: 57.23906%
** Coverage over large corpus: ~0.51365440837854797405
** Number of words in large corpus: 3066116
** Number of stems in the transducer: 426

*mwl-por:
**WER and PER over large corpus:
***WER: 37.82 %
***PER: 34.24 %
**Proportion of stems translated correctly in the longer corpus: 315
**Trimmed coverage over longer and large corpora:
***Longer: 421 / 596 (~0.70637583892617449664)
***Large: 1574090 / 3075136 (~0.51187654789901975067)
**Number of tokens in longer and large corpora:
***Longer: 608
***Large: 3078793

[[Category:Sp23_TranslationPairs]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese and Portuguese

2023-04-28T18:47:19Z

Nferris1:

Resources for machine translation between [[Mirandese]] and [[Portuguese]]

== Developed Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por-corpus.git Corpus Repo]
* [[Mirandese and Portuguese/Evaluation]]
* [[Mirandese and Portuguese/Lexical selection]]
* [[Mirandese and Portuguese/Contrastive Grammar]]
* [[Mirandese and Portuguese/Structural transfer]]

== External Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por.git Mirandese and Portuguese Repo]
* [https://github.com/ferriswaynen/apertium-por.git Portuguese Transducer]
* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl.git Mirandese Transducer]

== Additions ==

* 5 mwl paradigms
* 3 mwl disambiguation rules
* 3 por disambiguation rules

== Final Evaluation ==

*Monolingual Transducer:
** Updated precision & recall:
***Precision: 98.26590%
***Recall: 57.23906%
** Coverage over large corpus: ~0.51365440837854797405
** Number of words in large corpus: 3066116
** Number of stems in the transducer: 426

*mwl-por:
**WER and PER over large corpus:
***WER: 37.82 %
***PER: 34.24 %
**Proportion of stems translated correctly in the longer corpus: 315
**Trimmed coverage over longer and large corpora:
***Longer: 421 / 596
***Large: 1574090
**Number of tokens in longer and large corpora:
***Longer: 608
***Large: 3078793

[[Category:Sp23_TranslationPairs]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese and Portuguese

2023-04-28T18:45:21Z

Nferris1:

Resources for machine translation between [[Mirandese]] and [[Portuguese]]

== Developed Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por-corpus.git Corpus Repo]
* [[Mirandese and Portuguese/Evaluation]]
* [[Mirandese and Portuguese/Lexical selection]]
* [[Mirandese and Portuguese/Contrastive Grammar]]
* [[Mirandese and Portuguese/Structural transfer]]

== External Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por.git Mirandese and Portuguese Repo]
* [https://github.com/ferriswaynen/apertium-por.git Portuguese Transducer]
* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl.git Mirandese Transducer]

== Additions ==

* 5 mwl paradigms
* 3 mwl disambiguation rules
* 3 por disambiguation rules

== Final Evaluation ==

*Monolingual Transducer:
** Updated precision & recall:
***Precision: 98.26590%
***Recall: 57.23906%
** Coverage over large corpus: ~0.51365440837854797405
** Number of words in large corpus: 3066116
** Number of stems in the transducer: 426

*mwl-por:
**WER and PER over large corpus:
***WER: 37.82 %
***PER: 34.24 %
**Proportion of stems translated correctly in the longer corpus: 315
**Trimmed coverage over longer and large corpora:
***Longer:
***Large: 1574090
**Number of tokens in longer and large corpora:
***Longer: 608
***Large: 3078793

[[Category:Sp23_TranslationPairs]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese/Transducer

2023-04-27T21:30:36Z

Nferris1:

== Analyser Evaluation ==

* 165 stems (lexicon entries)
** NounRoot: 11
** RegNounInfl: 4
** AdjRoot: 3
** RegAdjInfl: 2
** AdvRoot: 4
** RegAdvInfl: 1
** PrnRoot: 25
** V-Stem: 3
** Infin: 3
** V-SimplePresentIndicative: 18
** V-SimplePastIndicative: 18
** V-SimpleFutureIndicative: 18
** V-SimpleFutureSubjunctive: 18
** Preposition: 1
** Punctuation: 22
** Numeral: 10
** All anonymous lexicons: 4

TOP UNKNOWN WORDS:
88 ^de/*de$
48 ^i/*i$
21 ^que/*que$
16 ^ls/*ls$
11 ^ye/*ye$
11 ^a/*a$
10 ^por/*por$
9 ^ne/*ne$
9 ^cumo/*cumo$
9 ^an/*an$
8 ^ua/*ua$
8 ^se/*se$
8 ^para/*para$
8 ^na/*na$
7 ^lhéngua/*lhéngua$
6 ^un/*un$
6 ^cun/*cun$
5 ^ó/*ó$
5 ^tecnologie/*tecnologie$
5 ^ser/*ser$
coverage: 303 / 1279 (~0.23690383111806098514)
remaining unknown forms: 976
ambiguity: 1321 / 1279 (~1.03283815480844409695)

'''Notes'''

By adding "de<pr> ↔ de" to the transducer, coverage went from 23.7% to 30.6%»

== Generator Evaluation ==

'''Initial evaluation of morphological generation'''

Morph analysis tests:

Corpus 1 of 5: Nouns-morph
11/11 (100.0%) tests pass (10/11 (90.91%) match gold)

Corpus 2 of 5: Adjectives-morph
3/3 (100.0%) tests pass (0/3 (0.0%) match gold)

Corpus 3 of 5: Verbs-morph
68/68 (100.0%) tests pass (30/68 (44.12%) match gold)

Corpus 4 of 5: Pronouns-morph
22/22 (100.0%) tests pass (7/22 (31.82%) match gold)

Corpus 5 of 5: Adverbs-morph
4/4 (100.0%) tests pass (4/4 (100.0%) match gold)

Current coverage number: 30.6%

Morph generator tests:

Corpus 1 of 5: Nouns-gen
11/11 (100.0%) tests pass (5/11 (45.45%) match gold)

Corpus 2 of 5: Adjectives-gen
3/3 (100.0%) tests pass (0/3 (0.0%) match gold)

Corpus 3 of 5: Verbs-gen
72/72 (100.0%) tests pass (52/72 (72.22%) match gold)

Corpus 4 of 5: Pronouns-gen
24/24 (100.0%) tests pass (13/24 (54.17%) match gold)

Corpus 5 of 5: Adverbs-gen
3/3 (100.0%) tests pass (3/3 (100.0%) match gold)

== Final evaluation of morphological generation ==

Corpus 1 of 5: Nouns-gen
11/11 (100.0%) tests pass (11/11 (100.0%) match gold)

Corpus 2 of 5: Adjectives-gen
3/3 (100.0%) tests pass (1/3 (33.33%) match gold)

Corpus 3 of 5: Verbs-gen
72/72 (100.0%) tests pass (52/72 (72.22%) match gold)

Corpus 4 of 5: Pronouns-gen
24/24 (100.0%) tests pass (13/24 (54.17%) match gold)

Corpus 5 of 5: Adverbs-gen
3/3 (100.0%) tests pass (3/3 (100.0%) match gold)

* Four twol rules added.

* 30.6% coverage.

[[Category:Sp23_Transducers]][[Category:Mirandese]]

Mirandese/Transducer

2023-04-27T21:29:39Z

Nferris1:

Mirandese/Transducer

2023-04-27T21:29:22Z

Nferris1:

Mirandese and Portuguese/Structural transfer

2023-04-20T21:31:05Z

Nferris1: /* Post-evaluation */

== Pre-evaluation ==

Word error rate (WER): 44.36 %

Position-independent word error rate (PER): 42.38 %

Coverage: ~0.51166666666666666667

== Outputs ==

Example: Ye un nuoç nutritib'''o''' (mwl) --> É uma noz nutritiv'''a''' (por)
* Tagger: ^ser<vbser><pri><p3><sg>$ ^un<det><ind><m><sg>$ ^nuoç<n><m><sg>$ ^nutritibo<adj><m><sg>$^.<sent>$
* Lex: ^ser<vbser><pri><p3><sg>/ser<vbser><pri><p3><sg>$ ^un<det><ind><m><sg>/um<det><ind><m><sg>$ ^nuoç<n><m><sg>/noz<n><f><sg>$ ^nutritibo<adj><m><sg>/nutritivo<adj><m><sg>$^.<sent>/.<sent>$
* Transfer:

No rule specified: ^ser<vbser><pri><p3><sg>/ser<vbser><pri><p3><sg>$

No rule specified: ^un<det><ind><m><sg>/um<det><ind><m><sg>$

Applying rule 1 (line 27): ^nuoç<n><m><sg>/noz<n><f><sg>$ ^nutritibo<adj><m><sg>/nutritivo<adj><m><sg>$

Applying output rule 0 (line 27): default<NP><ND> -> ^nuoç<n><m><sg>/noz<n><f><sg>$ ^nutritibo<adj><m><sg>/nutritivo<adj><m><sg>$

No rule specified: ^noz<n><f><sg>$

No rule specified: ^nutritivo<adj><f><sg>$

No rule specified: ^.<sent>/.<sent>$
^ser<vbser><pri><p3><sg>$ ^um<det><ind><m><sg>$ ^noz<n><f><sg>$ ^nutritivo<adj><f><sg>$^.<sent>$

* Pair itself: é um noz nutritiva

== Post-evaluation ==

Word error rate (WER): 37.62 %

Position-independent word error rate (PER): 35.64 %

Coverage: ~0.52333333333333333333

[[Category:Sp23_StructuralTransfer]]

Mirandese and Portuguese/Contrastive Grammar

2023-04-13T20:48:08Z

Nferris1:

== mwl-por tests ==

* Adjective agreement

** {{transferTest|mwl|por|Ye un nuoç nutritibo|É uma noz nutritiva}} ("It is a nutritious nut.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} un{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} nuoç{{tag|n}}{{tag|m}}{{tag|sg}} nutritibo{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} noz{{tag|n}}{{tag|f}}{{tag|sg}} nutritiva{{tag|adj}}{{tag|f}}{{tag|sg}}}}

** {{transferTest|mwl|por|Ye un cacho buono|É uma proporção boa}} ("It is a good proportion.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} un{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} cacho{{tag|n}}{{tag|m}}{{tag|sg}} buono{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} proporção{{tag|n}}{{tag|f}}{{tag|sg}} boa{{tag|adj}}{{tag|f}}{{tag|sg}}}}

* Determiner agreement

** {{transferTest|mwl|por|Ye un nuoç chinés|É uma noz chinesa}} ("It is a Chinese nut.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} l{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} nuoç{{tag|n}}{{tag|m}}{{tag|sg}} chinés{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} noz{{tag|n}}{{tag|f}}{{tag|sg}} chinesa{{tag|adj}}{{tag|f}}{{tag|sg}}}}

** {{transferTest|mwl|por|Ye un cacho cundensado|É a proporção condensada}} ("It is a condensed proportion.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} un{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} cacho{{tag|n}}{{tag|m}}{{tag|sg}} cundensado{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} proporção{{tag|n}}{{tag|f}}{{tag|sg}} condensada{{tag|adj}}{{tag|f}}{{tag|sg}}}}

* Preposition 1 to 2 mapping

** {{transferTest|mwl|por|Eisite la pasta cula lheite|Existe a massa com a leite}} ("The pasta with the milk exists.")
*: {{transferMorphTest|mwl|por|eisiste{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} la{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} pasta{{tag|n}}{{tag|f}}{{tag|sg}} cun{{tag|pr}} la{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} lheite{{tag|n}}{{tag|m}}{{tag|sg}}|existe{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} a{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} massa{{tag|n}}{{tag|f}}{{tag|sg}} com{{tag|pr}} a{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} leite{{tag|adj}}{{tag|f}}{{tag|sg}}}}

** {{transferTest|mwl|por|La lheite ye dua baca|A leite é dua vaca}} ("The milk is from a cow.")
*: {{transferMorphTest|mwl|por|la{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} de{{tag|pr}} una{{tag|det}}{{tag|ind}}{{tag|f}{{tag|sg}} baca{{tag|n}}{{tag|f}}{{tag|sg}}|a{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} leite{{tag|adj}}{{tag|f}}{{tag|sg}} é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} de{{tag|pr}} uma{{tag|det}}{{tag|ind}}{{tag|f}{{tag|sg}} vaca{{tag|n}}{{tag|f}}{{tag|sg}}}}
* Pronoun order 1

* Pronoun order 2

[[Category:Sp23_ContrastiveGrammars]]

Mirandese and Portuguese/Contrastive Grammar

2023-04-13T20:47:52Z

Nferris1: /* mwl-por tests */

== mwl-por tests ==

* Adjective agreement

** {{transferTest|mwl|por|Ye un nuoç nutritibo|É uma noz nutritiva}} ("It is a nutritious nut.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} un{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} nuoç{{tag|n}}{{tag|m}}{{tag|sg}} nutritibo{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} noz{{tag|n}}{{tag|f}}{{tag|sg}} nutritiva{{tag|adj}}{{tag|f}}{{tag|sg}}}}

** {{transferTest|mwl|por|Ye un cacho buono|É uma proporção boa}} ("It is a good proportion.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} un{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} cacho{{tag|n}}{{tag|m}}{{tag|sg}} buono{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} proporção{{tag|n}}{{tag|f}}{{tag|sg}} boa{{tag|adj}}{{tag|f}}{{tag|sg}}}}

* Determiner agreement

** {{transferTest|mwl|por|Ye un nuoç chinés|É uma noz chinesa}} ("It is a Chinese nut.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} l{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} nuoç{{tag|n}}{{tag|m}}{{tag|sg}} chinés{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} noz{{tag|n}}{{tag|f}}{{tag|sg}} chinesa{{tag|adj}}{{tag|f}}{{tag|sg}}}}

** {{transferTest|mwl|por|Ye un cacho cundensado|É a proporção condensada}} ("It is a condensed proportion.")
*: {{transferMorphTest|mwl|por|ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} un{{tag|det}}{{tag|ind}}{{tag|m}}{{tag|sg}} cacho{{tag|n}}{{tag|m}}{{tag|sg}} cundensado{{tag|adj}}{{tag|m}}{{tag|sg}}|é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} uma{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} proporção{{tag|n}}{{tag|f}}{{tag|sg}} condensada{{tag|adj}}{{tag|f}}{{tag|sg}}}}

* Preposition 1 to 2 mapping

** {{transferTest|mwl|por|Eisite la pasta cula lheite|Existe a massa com a leite}} ("The pasta with the milk exists.")
*: {{transferMorphTest|mwl|por|eisiste{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} la{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} pasta{{tag|n}}{{tag|f}}{{tag|sg}} cun{{tag|pr}} la{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} lheite{{tag|n}}{{tag|m}}{{tag|sg}}|existe{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} a{{tag|det}}{{tag|ind}}{{tag|f}}{{tag|sg}} massa{{tag|n}}{{tag|f}}{{tag|sg}} com{{tag|pr}} a{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} leite{{tag|adj}}{{tag|f}}{{tag|sg}}}}

** {{transferTest|mwl|por|La lheite ye dua baca|A leite é dua vaca}} ("The milk is from a cow.")
*: {{transferMorphTest|mwl|por|la{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} ye{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} de{{tag|pr}} una{{tag|det}}{{tag|ind}}{{tag|f}{{tag|sg}} baca{{tag|n}}{{tag|f}}{{tag|sg}}|a{{tag|det}}{{tag|def}}{{tag|f}{{tag|sg}} leite{{tag|adj}}{{tag|f}}{{tag|sg}} é{{tag|vbser}}{{tag|pri}}{{tag|p3}}{{tag|sg}} de{{tag|pr}} uma{{tag|det}}{{tag|ind}}{{tag|f}{{tag|sg}} vaca{{tag|n}}{{tag|f}}{{tag|sg}}}}}}
* Pronoun order 1

* Pronoun order 2

[[Category:Sp23_ContrastiveGrammars]]

Mirandese and Portuguese/Contrastive Grammar

2023-04-13T14:30:30Z

Nferris1:

== mwl-por tests ==

[[Category:Sp23_ContrastiveGrammars]]

Mirandese and Portuguese/Contrastive Grammar

2023-04-13T14:29:47Z

Nferris1:

== por-mwl tests ==

[[Category:Sp23_ContrastiveGrammars]]

Mirandese and Portuguese

2023-04-13T13:58:56Z

Nferris1:

Mirandese and Portuguese

2023-04-13T13:57:58Z

Nferris1:

Mirandese and Portuguese/Lexical selection

2023-04-06T13:58:21Z

Nferris1:

== mwl → por ==

[[Category:Sp23_LexicalSelection]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese and Portuguese

2023-04-06T13:57:33Z

Nferris1:

Mirandese and Portuguese/Evaluation

2023-03-30T23:35:26Z

Nferris1: Created page with "Category:Sp23_TranslationPairs Category:Mirandese Category:Portuguese"

[[Category:Sp23_TranslationPairs]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese and Portuguese

2023-03-30T23:34:27Z

Nferris1:

Resources for machine translation between [[Mirandese]] and [[Portuguese]]

== Developed Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por-corpus.git Corpus Repo]
* [[mwl → por evalutation]]

== External Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por.git Mirandese and Portuguese Repo]
* [https://github.com/ferriswaynen/apertium-por.git Portuguese Transducer]
* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl.git Mirandese Transducer]

[[Category:Sp23_TranslationPairs]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese and Portuguese

2023-03-30T14:45:55Z

Nferris1:

Resources for machine translation between [[Mirandese]] and [[Portuguese]]

== Developed Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por-corpus.git Corpus Repo]

== External Resources ==

* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-por.git Mirandese and Portuguese Repo]
* [https://github.com/ferriswaynen/apertium-por.git Portuguese Transducer]
* [https://github.swarthmore.edu/Ling073-sp23/ling073-mwl.git Mirandese Transducer]

[[Category:Sp23_TranslationPairs]] [[Category:Mirandese]] [[Category:Portuguese]]

Mirandese

2023-03-22T17:49:57Z

Nferris1: /* Developed Resources */

=== Developed Resources ===

*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Github repo]
*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]
*[[Mirandese/Disambiguation|Disambiguator Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Disambiguator Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-03-22T17:49:13Z

Nferris1: /* Developed Resources */

=== Developed Resources ===

*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]
*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]
*[[Mirandese/Disambiguation|Disambiguator Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Disambiguator Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-03-22T17:48:55Z

Nferris1:

=== Developed Resources ===

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''
*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]
*[[Mirandese/Disambiguation|Disambiguator Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Disambiguator Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese/Disambiguation

2023-03-22T17:48:07Z

Nferris1:

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Github repo]

== Initial Evaluation of Ambiguity ==

Ambiguity: ~1.02782605224897238628

----

L home ten l deber de bibir plenamente.

l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> '''deber<n><m><sg>'''/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

'''la<det><def><f><sg>'''/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

*Note: Sentences are from corpus, but shortened.

== Constraints ==

*If an infinitive is preceded by a determiner (article), it functions as a noun.
*If "la" precedes a feminine singular noun, it functions as a determiner (definite article).

== Final Evaluation of Ambiguity ==

Ambiguity before disambiguation: ~1.08845420729756605105

Ambiguity after disambiguation: ~1.08774542337666751302

About 2000 forms disambiguated.

[[Category:Sp23_Disambiguation]][[Category:Mirandese]]

Mirandese/Transducer

2023-03-22T17:46:06Z

Nferris1:

Mirandese/Disambiguation

2023-03-16T15:49:24Z

Nferris1: /* Initial Evaluation of Ambiguity */

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Github repo]

== Initial Evaluation of Ambiguity ==

Ambiguity: ~1.02782605224897238628

----

L home ten l deber de bibir plenamente.

l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> '''deber<n><m><sg>'''/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

'''la<det><def><f><sg>'''/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

*Note: Sentences are from corpus, but shortened.

== Final Evaluation of Ambiguity ==

Ambiguity before disambiguation: ~1.08845420729756605105
Ambiguity after disambiguation: ~1.08774542337666751302

== Constraints ==

*If an infinitive is preceded by a determiner (article), it functions as a noun.
*If "la" precedes a feminine singular noun, it functions as a determiner (definite article).

[[Category:Sp23_Disambiguation]]

Mirandese/Disambiguation

2023-03-16T15:27:31Z

Nferris1: /* Initial Evaluation of Ambiguity */

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Github repo]

== Initial Evaluation of Ambiguity ==

Ambiguity: ~1.02782605224897238628

----

L home ten l deber de bibir plenamente.

l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> '''deber<n><m><sg>'''/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

'''la<det><def><f><sg>'''/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

*Note: Sentences are from corpus, but shortened.

== Constraints ==

*If an infinitive is preceded by a determiner (article), it functions as a noun.
*If "la" precedes a feminine singular noun, it functions as a determiner (definite article).

[[Category:Sp23_Disambiguation]]

Mirandese

2023-03-16T15:07:09Z

Nferris1:

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]
*[[Mirandese/Disambiguation|Disambiguator Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Disambiguator Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese/Disambiguation

2023-03-16T15:03:23Z

Nferris1: /* Initial Evaluation of Ambiguity */

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Github repo]

== Initial Evaluation of Ambiguity ==

Ambiguity: 3

----

L home ten l deber de bibir plenamente.

l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> '''deber<n><m><sg>'''/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

'''la<det><def><f><sg>'''/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

*Note: Sentences are from corpus, but shortened.

== Constraints ==

*If an infinitive is preceded by a determiner (article), it functions as a noun.
*If "la" precedes a feminine singular noun, it functions as a determiner (definite article).

[[Category:Sp23_Disambiguation]]

Mirandese/Disambiguation

2023-03-16T14:37:37Z

Nferris1:

== Initial Evaluation of Ambiguity ==

Ambiguity: 3

----

L home ten l deber de bibir plenamente.

l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> deber<n><m><sg>/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

la<det><def><f><sg>/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

[[Category:Sp23_Disambiguation]]

Mirandese/Disambiguation

2023-03-16T14:37:23Z

Nferris1:

Mirandese/Disambiguation

2023-03-16T14:37:00Z

Nferris1: /* Initial Evaluation of Ambiguity */

== Initial Evaluation of Ambiguity ==

Ambiguity: 3

----

L home ten l deber de bibir plenamente.

* l<det><def><m><sg> home<n><m><sg> ten<pres><p3><sg> l<det><def><m><sg> deber<n><m><sg>/deber<inf> de<pr> bibir<inf> plenamente<adv>

La lhéngua chinesa ye mui cuncisa.

la<det><def><f><sg>/la<prn><pers><p3><f><sg><obj> lhéngua<n><f><sg> chinesa<adj> ye<pres><p3><sg> mui<adv> cuncisa<adj><f><sg>

[[Category:Sp23_Disambiguation]]

Mirandese/Transducer

2023-03-02T15:59:04Z

Nferris1:

Mirandese/Transducer

2023-03-02T15:52:06Z

Nferris1:

== Evaluation ==

* 165 stems (lexicon entries)
** NounRoot: 11
** RegNounInfl: 4
** AdjRoot: 3
** RegAdjInfl: 2
** AdvRoot: 4
** RegAdvInfl: 1
** PrnRoot: 25
** V-Stem: 3
** Infin: 3
** V-SimplePresentIndicative: 18
** V-SimplePastIndicative: 18
** V-SimpleFutureIndicative: 18
** V-SimpleFutureSubjunctive: 18
** Preposition: 1
** Punctuation: 22
** Numeral: 10
** All anonymous lexicons: 4

TOP UNKNOWN WORDS:
88 ^de/*de$
48 ^i/*i$
21 ^que/*que$
16 ^ls/*ls$
11 ^ye/*ye$
11 ^a/*a$
10 ^por/*por$
9 ^ne/*ne$
9 ^cumo/*cumo$
9 ^an/*an$
8 ^ua/*ua$
8 ^se/*se$
8 ^para/*para$
8 ^na/*na$
7 ^lhéngua/*lhéngua$
6 ^un/*un$
6 ^cun/*cun$
5 ^ó/*ó$
5 ^tecnologie/*tecnologie$
5 ^ser/*ser$
coverage: 303 / 1279 (~0.23690383111806098514)
remaining unknown forms: 976
ambiguity: 1321 / 1279 (~1.03283815480844409695)

== Notes ==

By adding "de<pr> ↔ de" to the transducer, coverage went from 23.7% to 30.6%»

== Generator Evaluation ==

'''Initial evaluation of morphological generation'''

Current coverage number: 30.6%

Corpus 1 of 5: Nouns-gen
11/11 (100.0%) tests pass (5/11 (45.45%) match gold)

Corpus 2 of 5: Adjectives-gen
3/3 (100.0%) tests pass (0/3 (0.0%) match gold)

Corpus 3 of 5: Verbs-gen
72/72 (100.0%) tests pass (52/72 (72.22%) match gold)

Corpus 4 of 5: Pronouns-gen
24/24 (100.0%) tests pass (13/24 (54.17%) match gold)

Corpus 5 of 5: Adverbs-gen
3/3 (100.0%) tests pass (3/3 (100.0%) match gold)

[[Category:Sp23_Transducers]]

Morphological analyser

2023-02-28T17:04:30Z

Nferris1: /* Evaluation */

== Morphological transducers ==

A morphological transducer is just a directed graph. It consists of nodes (numbered below) and arcs (with labels), with a starting node (0 below) and an ending node (16 below).

[[Image:Simple transducer.png|1000px]]

You follow the arcs that are available from your input. The only acceptable paths are ones that start from starting node and end at the ending node. You may match your input to either side of the arc's label (separated by : above), and the other side is returned as output.

In the transducer above, the left side is the form and the right side is the analysis. If you match your input to the left side (the form), then your output will be the right side (the analysis)—this is '''morphological analysis'''. Likewise, if you follow the transducer by matching your input to the right side (the analysis) and output the left side (the form), then you are performing '''morphological generation'''.

An example of a complete path is <code>w:w o:o l:l v:f e:{{tag|n}} s:{{tag|pl}}</code>. The left/form side of this spells <code>wolves</code> and the right/analysis side of this spells <code>wolf{{tag|n}}{{tag|pl}}</code>. Mapping between one and the other is as simple as taking one as input and following the path—by outputting the other side of each arc, you will get the other as output!

'''Question''': What are all the possible paths provided by this transducer?

== The formalism we use (lexd) ==

Transducers are pretty cool, and quite efficient... for computers. Following paths by hand is tedious, and drawing a transducer for anything more complex than the example above is torture. See the transducer below for Tuvan.

[[File:tuvan transducer.png|1000px]]

This transducer provides the combinations of about 8 case marker, 5 possessive morphemes, and the plural marker for three Tuvan nouns.

An example is <code>өг>{{archiphon|L}}{{archiphon|A}}р>{{archiphon|i}}м>{{archiphon|D}}{{archiphon|A}}н</code> mapping to <code>өг{{tag|n}}{{tag|pl}}{{tag|px1sg}}{{tag|abl}}</code>, meaning "from my houses". The analysis side is clear to anyone familiar with tags (and knowing that "өг" means "house"). The form side is actually something that will get fixed by morphophonology, which we'll worry about later (for now: letters like <code>{{archiphon|L}}</code> can be realised in a variety of ways, and <code>></code> is used as a morpheme boundary); the actual orthographic form is <code>өглеримден</code>.

'''Question''': How can we quantify the complexity of this graph? 

Fortunately, we don't have to draw this graph by hand. We can simply define the various sections of it and link them together with a straightforward formalism called '''lexd'''. A section of a lexd file that corresponds to the graph above looks like the following:

<pre>
PATTERNS

N-Stems [ <n>: ] [ <pl>:>{L}{A}р ]? Possession? Cases

LEXICON N-Stems

өг:өг # "yurt"
аът:аът # "horse"
ном:ном # "book"

LEXICON Possession

<px1sg>:>{i}м
<px2sg>:>{i}ң
<px3sp>:>{z}{I}{n}
<px1pl>:>{i}в{I}с
<px2pl>:>{i}ң{A}р

LEXICON Cases

<nom>:
<gen>:>{N}{I}ң
<acc>:>{N}I
<dat>:>{G}{A}
<loc>:>{D}{A}
<abl>:>{D}{A}н
<all>:>{J}е
<all>:>{D}{I}в{A} # Dir/LR
</pre>

'''Questions'''
* What is <code>#</code> doing? 
* What is <code>:</code> doing? 
* What are the <code>?</code>s doing? 
* How are the lists of parts (LEXICONs) combined into a whole? 

* What is not mentioned in this code that is in the graph above? 
* Can you match sections of the graph to sections of the code? 

== Additional nuances ==

=== Phonology ===
The symbols like {{archiphon|L}} above will need to be realised as different characters in different context.

For any symbols in your language that will be realised in different ways in different environments, you'll want to set up such an "archiphoneme". Use an uppercase letter for something that just has different forms, and use a lowercase letter for something that is inserted or deleted (i.e., is sometimes realised as nothing).

For now, it will suffice to define all the ways in which each archiphoneme surfaces by making a list in your <code>twol</code> file. This essentially allows all of the options to surface, which means you will be able to analyse incorrect forms as well as correct ones. Later, when you make a generator, you'll write rules to constrain where each of the symbols can occur.

=== Defining symbols ===

You'll want to define your archiphoneme symbols in the twol file, each with all its possible outputs.

So your twol file should contain an <code>Alphabet</code> section, which lists all the characters of the alphabet, and then all the archiphonemes with all their realisations. You will also want the <code>></code> morpheme separator and some punctuation marks, all escaped. A condensed example for Tuvan follows:

<pre>
Alphabet

А Б В Г Д Е Ё Ж З И Й К Л М Н Ң О Ө П Р С Т У Ү Ф Х Ц Ч Ш Щ Ъ Ы Ь Э Ю Я
а б в г д е ё ж з и й к л м н ң о ө п р с т у ү ф х ц ч ш щ ъ ы ь э ю я

%{A%}:а %{A%}:е
%{L%}:л %{L%}:н
%{i%}:0 %{i%}:ы %{i%}:и %{i%}:у %{i%}:ү

%.
%-

%>:0
;

</pre>

=== Starting point ===

You'll need at least one <code>PATTERNS</code> section in your lexd file. Bootstrapping a new language module per the instructions will create this for you, but don't forget that it's a thing!

=== Morphology that isn't suffixes ===

You may remember from last week that we discussed that analyses are generally in the form '''stem''' + '''POS tags''' + '''subcategory tags''' + '''function tags'''. What if some of your functional morphology occurs before the stem?

You can certainly implement that as shown above, but there's a problem: your tags will occur in the middle of the analysis. That is, instead of something like {{morphTest|do{{tag|v}}{{tag|tv}}{{tag|rep}}{{tag|prc}}|redoing}}, you'd get something like {{morphTest|{{tag|rep}}do{{tag|v}}{{tag|tv}}{{tag|prog}}|redoing}}. This is undesirable in terms of keeping track of which of your tags are for what.

Fortunately lexd offers a trick for handling such things! You can list the left and right side of a given LEXICON in different parts of a PATTERN, and the pieces will be matched. The following is a simple example (which assumes that the "re" prefix in English should be treated as productive and inflectional, which it probably shouldn't):

<pre>
PATTERNS

Verbs

PATTERN Verbs

V-Base V-Tenses

PATTERN V-Base

V-Stems(1) [<v>:] V-Stems(2):
V-Prefixes(1) V-Stems(1) [<v>:] V-Stems(2): V-Prefixes(2)

LEXICON V-Prefixes(2)

:re> <rep>:
:un> <rev>:

LEXICON V-Tenses

<prog>:>ing
<past>:>{e}d

LEXICON V-Stems(2)

tie:tie <tv>
start:start <tv>
</pre>

'''Questions:'''
* What are the forms output by this transducer?
* (How many forms are there?)
* What are the numbers in <code>()</code>?
* What part of the file adds the prefixes and what part of the file adds the prefix tags?
* What are the different <code>PATTERN</code> groups for?

==== another example ====
Here's a better example, showing (productive, inflectional) gender agreement on verbs in Avar. Note the other way of matching prefixes to tags (the <code>V-Gender</code> lexicon as compared to <code>V-Prefixes</code> in English).

<pre>
PATTERNS

Verbs

PATTERN Verbs

:V-Gender V-Stems(1) [<v>:] V-Stems(2): V-Tense V-Gender:

LEXICON V-Tense

<aor>:>уна

LEXICON V-Gender

<nt>:б>
<m>:в>
<f>:й>
<pl>:р>

LEXICON V-Stems(2)

бицине:иц <tv> # "говорить"
</pre>

The output analyses would be the following:

<pre>
бицине<v><tv><aor><nt>:бицуна
бицине<v><tv><aor><f>:йицуна
бицине<v><tv><aor><m>:вицуна
бицине<v><tv><aor><pl>:рицуна
</pre>

== In-class exercise ==

See [[Morphological analyser/Exercises]].

The work we did on this in class is available on Swarthmore's github at [https://github.swarthmore.edu/Ling073-sp23/ling073-eng ling073-sp23/ling073-eng].

== Documentation ==

'''[https://github.com/apertium/lexd/blob/master/Usage.md Documentation of <code>lexd</code>]''' is available.

== Evaluation ==
This section lists various commands that will help you evaluate your progress / how well the analyser is functioning.

=== Individual forms ===
To test whether/how your analyser is analysing a form, you can run the following:
echo "form" | apertium -d /path/to/analyser/ xyz-morph
An example might be the following:
apertium-tyv$ echo өглеримден | apertium -d . tyv-morph
^өглеримден/өг<n><pl><px1sg><abl>$^./.<sent>$
You can also do it this way:
apertium-tyv$ echo өглеримден | hfst-proc tyv.automorf.hfst
This output means that for the form <code>өглеримден</code> there is one analysis: <code>өг{{tag|n}}{{tag|pl}}{{tag|px1sg}}{{tag|abl}}</code>. A form with multiple analysis would have them separated by <code>/</code>, like the following:
^өг/өг<n><nom>/өг<n><attr>/өг<n><nom>+э<cop><aor><p3><sg>$^./.<sent>$
A form with no analyses in the transducer will just return the form with an <code>*</code> before it, like the following:
^өглеримнен/*өглеримнен$^./.<sent>$

=== See full contents of analyser ===

The following command outputs the '''full contents of the transducer'''. Note that it only does one cycle through the graph, which means for numbers you'll only get double digits. Without <code>-c0</code> (or <code>-c1</code>, etc.—to tell it how many times to cycle through) it will cycle indefinitely, which probably isn't what you want.

hfst-expand -c0 xyz.automorf.hfst

If all the numbers are annoying, you can do this to get only non-number contents:

hfst-expand -c0 xyz.automorf.hfst | grep -v '<num>'

Likewise, you can focus on a particular part of speech, e.g. {{tag|n}}s:

hfst-expand -c0 xyz.automorf.hfst | grep '<n>'

=== A long list of forms with known analyses ===
To test whether your analyser is analysing forms correctly, you can
# put your analyses or forms into a file in <code>test/</code> and run [[apertium-regtest]].
# put your analyses into a <code>yaml</code> file and use <code>morph-test</code> (or <code>[[apertium-quality|aq-morftest]]</code>):
#: <code>morph-test -csi xyz.yaml | most</code>
#: or
#: <code>aq-morftest -csi xyz.yaml | most</code>

=== Coverage over a corpus ===
To test coverage over a corpus, you can use <code>coverage-hfst</code> or <code>[[apertium-quality|aq-covtest]]</code>:
coverage-hfst xyz.corpus.basic.txt /path/to/xyz.automorf.hfst

aq-covtest xyz.corpus.basic.txt /path/to/xyz.automorf.bin

=== Generating forms ===
If you need to test how a form generates, you can do something like the following:
echo "^house<n><pl>$" | apertium -d . -f none xyz-gener
This will return all forms currently being generated, e.g. <code>houses/housees</code>

But note that the next lab will be about [[morphological generator|morphological generation]].

=== Counting lexicon entries ===
You can run the following command to list lexicons and counts in them all:
lexd -x apertium-xyz.xyz.lexd > /dev/null

Note that a number of these lexicons are probably related to your morphology. If you're counting "lexical entries", you should probably exclude the morphology ones.

== The assignment ==
This assignment will be due at the end of the day Friday of the 6th week of class (this semester: '''23:59 on Friday, February 24th, 2023''').

This assignment is to develop a morphological analyser that implements a good deal of the basic morphology of your language.

=== Getting set up ===
# Bootstrap a transducer for your language using <code>apertium-init</code> (installed on the lab machines):
#: <code>apertium-init -a lexd --with-spellrelax --prefix=ling073 xyz</code>
# Create a new ''empty'' repo (that is, don't check the README option) in [https://github.swarthmore.edu/Ling073-sp23/ the course's GitHub organisation] with the name <code>ling073-xyz</code> (with your language's code in place of <code>xyz</code>). Then add the SSH link as a remote origin in your initialised module and push the module to the GitHub repo:
#: <code>git remote add origin git@github.swarthmore.edu:Ling073-sp23/ling073-xyz.git</code>
#: <code>git push --set-upstream origin master</code>
# Go into the new directory (<code>cd ling073-xyz</code>), initialise the module (<code>./autogen.sh</code>), and compile it (<code>make</code>).
#* If this is successful, you should have several "modes" available; run <code>apertium -d . -l</code> to see.
#* One mode should be an <code>xyz-morph</code> mode; this is your analyser. Check it by running <code>echo "houses" | apertium -d . xyz-morph</code> , which should give you a morphological analysis of the word "houses".
# {{highlight|Integrate any comments I've provided to you on your grammar documentation page so that all of your morphTests are in good order. See the sanity checks at [[Grammar documentation#Sanity checks]] to check the main things.}}
# Augment the commented section at the top of the <code>apertium-xyz.xyz.lexd</code> file with any tags you came up with during the [[Grammar documentation]] assignment that aren't there already. Provide a symbol, and a brief comment explaining what the symbol means.
# Add ''all'' the characters of your language's orthography to the <code>Alphabet</code> section of the <code>apertium-xyz.xyz.twol</code> file. You may need to add archiphonemes later.
# Use the <code>[[morphTests2regtest]]</code> script (installed on the lab machines) to create a set of test files in a subdirectory called <code>test/</code>.
#* Commit these files to the git repo!
#* (You can remove empty files if you like.)
#* There should be at least 50 tests in the "-morph" files in this directory. You can make sure you have enough by counting lines in the <code>*-morph-input.txt</code> files; this will count the number of tests in each file and also return a total:
#*: <code>wc -l test/*/*-morph-input.txt</code>

=== The hard stuff ===
# '''Build your morphological transducer''', adding all of the stems from your Grammar documentation assignment, categorised correctly, so that '''at least half of your tests pass'''. You'll need to build up the morphotactics too.
#* If too many of your grammar points are too hard to implement at this point (e.g., require some rules to change some characters to other characters), then you can skip one or two of them and instead add more "easy" forms to your transducer.
#* Alternatively "hard-code" some forms, but add a comment in the lexd file near the relevant forms indicating that they need further work, and mention it on the wiki page (see below).
#* Also don't forget to clean up your grammar page. Don't forget to rerun the scraping script to get a fresh version of the tests file. If you're happy with your grammar page and don't expect to change it much, feel free to "clean up" your tests file manually.
# '''Create a page on the wiki''' <code>Language/Transducer</code> that links to the code and has Evaluation and Notes sections.
#* In the Notes section, say what tests still don't work and why.
#* Add the page to the category [[:Category:Sp23_Transducers]].

=== Evaluation ===
When you've finished getting half of your tests to pass.

Evaluate coverage on your corpus and add the one of the most frequent unanalysed words:
# Use <code>coverage-hfst</code> or <code>[[apertium-quality|aq-covtest]]</code> (as above) to see how many forms in your basic corpus are analysed, and what the top unknown forms are.
#* Make note of the coverage at this point
# Make a new <code>txt</code> file in your tests directory with the top unanalysed words.
#* Name the file something like <code>commonwords-morph-input.txt</code>
#* For each analysis, just put an {{tag|unk}} tag (for "unknown") after each form.
#* You'll need to add these files to your <code>test/tests.json</code> file. See [[Apertium-regtest#Manually adding tests]] for more information on manually adding tests.
#* Don't forget to commit these files to your git repository!
# Figure out what the analyses of '''at least three''' of these words should be, using the resources you have available (grammar books, etc.), and add gold accordingly.
# Add '''at least one''' of these analyses to your transducer so that the test passes.
# Rerun <code>apertium-regtest test</code> to see by how much your coverage improved.
#* Add a note to the notes section of the additional top word(s) you added, and the resulting change in coverage (e.g., «by adding "{{morphTest|and{{tag|cnjcoo}}|and}}" to the transducer, coverage went from 19.76% to 22.32%»)

In the Evaluation section on the wiki page, add the following:
* Total number of stems in the transducer. You can use the following method, or count the stems manually.
*: <code>lexd -x apertium-xyz.xyz.lexd > /dev/null</code> (then add the counts for the relevant individual lexicons)
* Current coverage over your combined corpus
* The current list of top unknown words returned by <code>apertium-regtest test -c .-morph</code>
* Number of tests that pass in each test
** The test files should have at least half of the tests passing
** The <code>commonwords-morph-*.txt</code> files should have at least 1 passing test

=== Housekeeping ===
# Add yourself to the <code>AUTHORS</code> file.
# Make sure the <code>COPYING</code> file contains an open-source license to your liking (default should be [https://www.gnu.org/licenses/quick-guide-gplv3.html GPL3]).
# Add links to the transducer repo and wiki page to the list of resources you developed for your language on the language's page on this wiki.

=== Sanity checks before submitting ===
# Did you commit ''just'' the initial files created by bootstrap ''before'' you initialised or compiled the module? If not, start over with bootstrapping, being sure copy over any files you've changed. Or use [[Removing binaries from transducer repo|this method]].
# Did you commit your updates to <code>lexd</code> and <code>twol</code> files? And the <code>txt</code> test files?
# Do you have at least 50 tests in the main tests file? Do at least half of them match gold via <code>apertium-regtest test -c .-morph</code>?
# Did you add everything asked for to the wiki page (evaluation, etc.) and your repo (e.g., files in your <code>test/</code> directory).
# If you have trouble analysing or compiling, are all your tags and symbols (full alphabet) defined in your twol file?

[[Category:Assignments]]
[[Category:Tutorials]]
[[Category:Activities]]

Morphological analyser

2023-02-28T17:03:48Z

Nferris1: /* Evaluation */

== Morphological transducers ==

A morphological transducer is just a directed graph. It consists of nodes (numbered below) and arcs (with labels), with a starting node (0 below) and an ending node (16 below).

[[Image:Simple transducer.png|1000px]]

You follow the arcs that are available from your input. The only acceptable paths are ones that start from starting node and end at the ending node. You may match your input to either side of the arc's label (separated by : above), and the other side is returned as output.

In the transducer above, the left side is the form and the right side is the analysis. If you match your input to the left side (the form), then your output will be the right side (the analysis)—this is '''morphological analysis'''. Likewise, if you follow the transducer by matching your input to the right side (the analysis) and output the left side (the form), then you are performing '''morphological generation'''.

An example of a complete path is <code>w:w o:o l:l v:f e:{{tag|n}} s:{{tag|pl}}</code>. The left/form side of this spells <code>wolves</code> and the right/analysis side of this spells <code>wolf{{tag|n}}{{tag|pl}}</code>. Mapping between one and the other is as simple as taking one as input and following the path—by outputting the other side of each arc, you will get the other as output!

'''Question''': What are all the possible paths provided by this transducer?

== The formalism we use (lexd) ==

Transducers are pretty cool, and quite efficient... for computers. Following paths by hand is tedious, and drawing a transducer for anything more complex than the example above is torture. See the transducer below for Tuvan.

[[File:tuvan transducer.png|1000px]]

This transducer provides the combinations of about 8 case marker, 5 possessive morphemes, and the plural marker for three Tuvan nouns.

An example is <code>өг>{{archiphon|L}}{{archiphon|A}}р>{{archiphon|i}}м>{{archiphon|D}}{{archiphon|A}}н</code> mapping to <code>өг{{tag|n}}{{tag|pl}}{{tag|px1sg}}{{tag|abl}}</code>, meaning "from my houses". The analysis side is clear to anyone familiar with tags (and knowing that "өг" means "house"). The form side is actually something that will get fixed by morphophonology, which we'll worry about later (for now: letters like <code>{{archiphon|L}}</code> can be realised in a variety of ways, and <code>></code> is used as a morpheme boundary); the actual orthographic form is <code>өглеримден</code>.

'''Question''': How can we quantify the complexity of this graph? 

Fortunately, we don't have to draw this graph by hand. We can simply define the various sections of it and link them together with a straightforward formalism called '''lexd'''. A section of a lexd file that corresponds to the graph above looks like the following:

<pre>
PATTERNS

N-Stems [ <n>: ] [ <pl>:>{L}{A}р ]? Possession? Cases

LEXICON N-Stems

өг:өг # "yurt"
аът:аът # "horse"
ном:ном # "book"

LEXICON Possession

<px1sg>:>{i}м
<px2sg>:>{i}ң
<px3sp>:>{z}{I}{n}
<px1pl>:>{i}в{I}с
<px2pl>:>{i}ң{A}р

LEXICON Cases

<nom>:
<gen>:>{N}{I}ң
<acc>:>{N}I
<dat>:>{G}{A}
<loc>:>{D}{A}
<abl>:>{D}{A}н
<all>:>{J}е
<all>:>{D}{I}в{A} # Dir/LR
</pre>

'''Questions'''
* What is <code>#</code> doing? 
* What is <code>:</code> doing? 
* What are the <code>?</code>s doing? 
* How are the lists of parts (LEXICONs) combined into a whole? 

* What is not mentioned in this code that is in the graph above? 
* Can you match sections of the graph to sections of the code? 

== Additional nuances ==

=== Phonology ===
The symbols like {{archiphon|L}} above will need to be realised as different characters in different context.

For any symbols in your language that will be realised in different ways in different environments, you'll want to set up such an "archiphoneme". Use an uppercase letter for something that just has different forms, and use a lowercase letter for something that is inserted or deleted (i.e., is sometimes realised as nothing).

For now, it will suffice to define all the ways in which each archiphoneme surfaces by making a list in your <code>twol</code> file. This essentially allows all of the options to surface, which means you will be able to analyse incorrect forms as well as correct ones. Later, when you make a generator, you'll write rules to constrain where each of the symbols can occur.

=== Defining symbols ===

You'll want to define your archiphoneme symbols in the twol file, each with all its possible outputs.

So your twol file should contain an <code>Alphabet</code> section, which lists all the characters of the alphabet, and then all the archiphonemes with all their realisations. You will also want the <code>></code> morpheme separator and some punctuation marks, all escaped. A condensed example for Tuvan follows:

<pre>
Alphabet

А Б В Г Д Е Ё Ж З И Й К Л М Н Ң О Ө П Р С Т У Ү Ф Х Ц Ч Ш Щ Ъ Ы Ь Э Ю Я
а б в г д е ё ж з и й к л м н ң о ө п р с т у ү ф х ц ч ш щ ъ ы ь э ю я

%{A%}:а %{A%}:е
%{L%}:л %{L%}:н
%{i%}:0 %{i%}:ы %{i%}:и %{i%}:у %{i%}:ү

%.
%-

%>:0
;

</pre>

=== Starting point ===

You'll need at least one <code>PATTERNS</code> section in your lexd file. Bootstrapping a new language module per the instructions will create this for you, but don't forget that it's a thing!

=== Morphology that isn't suffixes ===

You may remember from last week that we discussed that analyses are generally in the form '''stem''' + '''POS tags''' + '''subcategory tags''' + '''function tags'''. What if some of your functional morphology occurs before the stem?

You can certainly implement that as shown above, but there's a problem: your tags will occur in the middle of the analysis. That is, instead of something like {{morphTest|do{{tag|v}}{{tag|tv}}{{tag|rep}}{{tag|prc}}|redoing}}, you'd get something like {{morphTest|{{tag|rep}}do{{tag|v}}{{tag|tv}}{{tag|prog}}|redoing}}. This is undesirable in terms of keeping track of which of your tags are for what.

Fortunately lexd offers a trick for handling such things! You can list the left and right side of a given LEXICON in different parts of a PATTERN, and the pieces will be matched. The following is a simple example (which assumes that the "re" prefix in English should be treated as productive and inflectional, which it probably shouldn't):

<pre>
PATTERNS

Verbs

PATTERN Verbs

V-Base V-Tenses

PATTERN V-Base

V-Stems(1) [<v>:] V-Stems(2):
V-Prefixes(1) V-Stems(1) [<v>:] V-Stems(2): V-Prefixes(2)

LEXICON V-Prefixes(2)

:re> <rep>:
:un> <rev>:

LEXICON V-Tenses

<prog>:>ing
<past>:>{e}d

LEXICON V-Stems(2)

tie:tie <tv>
start:start <tv>
</pre>

'''Questions:'''
* What are the forms output by this transducer?
* (How many forms are there?)
* What are the numbers in <code>()</code>?
* What part of the file adds the prefixes and what part of the file adds the prefix tags?
* What are the different <code>PATTERN</code> groups for?

==== another example ====
Here's a better example, showing (productive, inflectional) gender agreement on verbs in Avar. Note the other way of matching prefixes to tags (the <code>V-Gender</code> lexicon as compared to <code>V-Prefixes</code> in English).

<pre>
PATTERNS

Verbs

PATTERN Verbs

:V-Gender V-Stems(1) [<v>:] V-Stems(2): V-Tense V-Gender:

LEXICON V-Tense

<aor>:>уна

LEXICON V-Gender

<nt>:б>
<m>:в>
<f>:й>
<pl>:р>

LEXICON V-Stems(2)

бицине:иц <tv> # "говорить"
</pre>

The output analyses would be the following:

<pre>
бицине<v><tv><aor><nt>:бицуна
бицине<v><tv><aor><f>:йицуна
бицине<v><tv><aor><m>:вицуна
бицине<v><tv><aor><pl>:рицуна
</pre>

== In-class exercise ==

See [[Morphological analyser/Exercises]].

The work we did on this in class is available on Swarthmore's github at [https://github.swarthmore.edu/Ling073-sp23/ling073-eng ling073-sp23/ling073-eng].

== Documentation ==

'''[https://github.com/apertium/lexd/blob/master/Usage.md Documentation of <code>lexd</code>]''' is available.

== Evaluation ==
This section lists various commands that will help you evaluate your progress / how well the analyser is functioning.

=== Individual forms ===
To test whether/how your analyser is analysing a form, you can run the following:
echo "form" | apertium -d /path/to/analyser/ xyz-morph
An example might be the following:
apertium-tyv$ echo өглеримден | apertium -d . tyv-morph
^өглеримден/өг<n><pl><px1sg><abl>$^./.<sent>$
You can also do it this way:
apertium-tyv$ echo өглеримден | hfst-proc tyv.automorf.hfst
This output means that for the form <code>өглеримден</code> there is one analysis: <code>өг{{tag|n}}{{tag|pl}}{{tag|px1sg}}{{tag|abl}}</code>. A form with multiple analysis would have them separated by <code>/</code>, like the following:
^өг/өг<n><nom>/өг<n><attr>/өг<n><nom>+э<cop><aor><p3><sg>$^./.<sent>$
A form with no analyses in the transducer will just return the form with an <code>*</code> before it, like the following:
^өглеримнен/*өглеримнен$^./.<sent>$

=== See full contents of analyser ===

The following command outputs the '''full contents of the transducer'''. Note that it only does one cycle through the graph, which means for numbers you'll only get double digits. Without <code>-c0</code> (or <code>-c1</code>, etc.—to tell it how many times to cycle through) it will cycle indefinitely, which probably isn't what you want.

hfst-expand -c0 xyz.automorf.hfst

If all the numbers are annoying, you can do this to get only non-number contents:

hfst-expand -c0 xyz.automorf.hfst | grep -v '<num>'

Likewise, you can focus on a particular part of speech, e.g. {{tag|n}}s:

hfst-expand -c0 xyz.automorf.hfst | grep '<n>'

=== A long list of forms with known analyses ===
To test whether your analyser is analysing forms correctly, you can
# put your analyses or forms into a file in <code>test/</code> and run [[apertium-regtest]].
# put your analyses into a <code>yaml</code> file and use <code>morph-test</code> (or <code>[[apertium-quality|aq-morftest]]</code>):
#: <code>morph-test -csi xyz.yaml | most</code>
#: or
#: <code>aq-morftest -csi xyz.yaml | most</code>

=== Coverage over a corpus ===
To test coverage over a corpus, you can use <code>coverage-hfst</code> or <code>[[apertium-quality|aq-covtest]]</code>:
coverage-hfst xyz.corpus.basic.txt /path/to/xyz.automorf.hfst

aq-covtest xyz.corpus.basic.txt /path/to/xyz.automorf.bin

=== Generating forms ===
If you need to test how a form generates, you can do something like the following:
echo "^house<n><pl>$" | apertium -d . -f none xyz-gener
This will return all forms currently being generated, e.g. <code>houses/housees</code>

But note that the next lab will be about [[morphological generator|morphological generation]].

=== Counting lexicon entries ===
You can run the following command to list lexicons and counts in them all:
lexd -x apertium-xyz.xyz.lexd > /dev/null

Note that a number of these lexicons are probably related to your morphology. If you're counting "lexical entries", you should probably exclude the morphology ones.

== The assignment ==
This assignment will be due at the end of the day Friday of the 6th week of class (this semester: '''23:59 on Friday, February 24th, 2023''').

This assignment is to develop a morphological analyser that implements a good deal of the basic morphology of your language.

=== Getting set up ===
# Bootstrap a transducer for your language using <code>apertium-init</code> (installed on the lab machines):
#: <code>apertium-init -a lexd --with-spellrelax --prefix=ling073 xyz</code>
# Create a new ''empty'' repo (that is, don't check the README option) in [https://github.swarthmore.edu/Ling073-sp23/ the course's GitHub organisation] with the name <code>ling073-xyz</code> (with your language's code in place of <code>xyz</code>). Then add the SSH link as a remote origin in your initialised module and push the module to the GitHub repo:
#: <code>git remote add origin git@github.swarthmore.edu:Ling073-sp23/ling073-xyz.git</code>
#: <code>git push --set-upstream origin master</code>
# Go into the new directory (<code>cd ling073-xyz</code>), initialise the module (<code>./autogen.sh</code>), and compile it (<code>make</code>).
#* If this is successful, you should have several "modes" available; run <code>apertium -d . -l</code> to see.
#* One mode should be an <code>xyz-morph</code> mode; this is your analyser. Check it by running <code>echo "houses" | apertium -d . xyz-morph</code> , which should give you a morphological analysis of the word "houses".
# {{highlight|Integrate any comments I've provided to you on your grammar documentation page so that all of your morphTests are in good order. See the sanity checks at [[Grammar documentation#Sanity checks]] to check the main things.}}
# Augment the commented section at the top of the <code>apertium-xyz.xyz.lexd</code> file with any tags you came up with during the [[Grammar documentation]] assignment that aren't there already. Provide a symbol, and a brief comment explaining what the symbol means.
# Add ''all'' the characters of your language's orthography to the <code>Alphabet</code> section of the <code>apertium-xyz.xyz.twol</code> file. You may need to add archiphonemes later.
# Use the <code>[[morphTests2regtest]]</code> script (installed on the lab machines) to create a set of test files in a subdirectory called <code>test/</code>.
#* Commit these files to the git repo!
#* (You can remove empty files if you like.)
#* There should be at least 50 tests in the "-morph" files in this directory. You can make sure you have enough by counting lines in the <code>*-morph-input.txt</code> files; this will count the number of tests in each file and also return a total:
#*: <code>wc -l test/*/*-morph-input.txt</code>

=== The hard stuff ===
# '''Build your morphological transducer''', adding all of the stems from your Grammar documentation assignment, categorised correctly, so that '''at least half of your tests pass'''. You'll need to build up the morphotactics too.
#* If too many of your grammar points are too hard to implement at this point (e.g., require some rules to change some characters to other characters), then you can skip one or two of them and instead add more "easy" forms to your transducer.
#* Alternatively "hard-code" some forms, but add a comment in the lexd file near the relevant forms indicating that they need further work, and mention it on the wiki page (see below).
#* Also don't forget to clean up your grammar page. Don't forget to rerun the scraping script to get a fresh version of the tests file. If you're happy with your grammar page and don't expect to change it much, feel free to "clean up" your tests file manually.
# '''Create a page on the wiki''' <code>Language/Transducer</code> that links to the code and has Evaluation and Notes sections.
#* In the Notes section, say what tests still don't work and why.
#* Add the page to the category [[:Category:Sp23_Transducers]].

=== Evaluation ===
When you've finished getting half of your tests to pass.

Evaluate coverage on your corpus and add the one of the most frequent unanalysed words:
# Use <code>coverage-hfst</code> or <code>[[apertium-quality|aq-covtest]]</code> (as above) to see how many forms in your basic corpus are analysed, and what the top unknown forms are.
#* Make note of the coverage at this point
# Make a new <code>txt</code> file in your tests directory with the top unanalysed words.
#* Name the file something like <code>commonwords-morph-input.txt</code>
#* For each analysis, just put an {{tag|unk}} tag (for "unknown") after each form.
#* You'll need to add these files to your <code>test/tests.json</code> file. See [[Apertium-regtest#Manually adding tests]] for more information on manually adding tests.
#* Don't forget to commit these files to your git repository!
# Figure out what the analyses of '''at least three''' of these words should be, using the resources you have available (grammar books, etc.), and add gold accordingly.
# Add '''at least one''' of these analyses to your transducer so that the test passes.
# Rerun <code>apertium-regtest test</code> to see by how much your coverage improved.
#* Add a note to the notes section of the additional top word(s) you added, and the resulting change in coverage (e.g., «by adding "{{morphTest|and{{tag|cnjcoo}}|and}}" to the transducer, coverage went from 19.76% to 22.32%»)

In the Evaluation section on the wiki page, add the following:
* Total number of stems in the transducer. You can use the following method, or count the stems manually.
*: <code>lexd -x apertium-xyz.xyz.lexd > /dev/null</code> (then add the counts for the relevant individual lexicons)
* Current coverage over your combined corpus
* The current list of top unknown words returned by <code>apertium-regtest test -c .-morph</code>
* Number of tests that pass in each yaml file
** The test files should have at least half of the tests passing
** The <code>commonwords-morph-*.txt</code> files should have at least 1 passing test

=== Housekeeping ===
# Add yourself to the <code>AUTHORS</code> file.
# Make sure the <code>COPYING</code> file contains an open-source license to your liking (default should be [https://www.gnu.org/licenses/quick-guide-gplv3.html GPL3]).
# Add links to the transducer repo and wiki page to the list of resources you developed for your language on the language's page on this wiki.

=== Sanity checks before submitting ===
# Did you commit ''just'' the initial files created by bootstrap ''before'' you initialised or compiled the module? If not, start over with bootstrapping, being sure copy over any files you've changed. Or use [[Removing binaries from transducer repo|this method]].
# Did you commit your updates to <code>lexd</code> and <code>twol</code> files? And the <code>txt</code> test files?
# Do you have at least 50 tests in the main tests file? Do at least half of them match gold via <code>apertium-regtest test -c .-morph</code>?
# Did you add everything asked for to the wiki page (evaluation, etc.) and your repo (e.g., files in your <code>test/</code> directory).
# If you have trouble analysing or compiling, are all your tags and symbols (full alphabet) defined in your twol file?

[[Category:Assignments]]
[[Category:Tutorials]]
[[Category:Activities]]

Morphological analyser

2023-02-28T17:03:10Z

Nferris1: /* Evaluation */

== Morphological transducers ==

A morphological transducer is just a directed graph. It consists of nodes (numbered below) and arcs (with labels), with a starting node (0 below) and an ending node (16 below).

[[Image:Simple transducer.png|1000px]]

You follow the arcs that are available from your input. The only acceptable paths are ones that start from starting node and end at the ending node. You may match your input to either side of the arc's label (separated by : above), and the other side is returned as output.

In the transducer above, the left side is the form and the right side is the analysis. If you match your input to the left side (the form), then your output will be the right side (the analysis)—this is '''morphological analysis'''. Likewise, if you follow the transducer by matching your input to the right side (the analysis) and output the left side (the form), then you are performing '''morphological generation'''.

An example of a complete path is <code>w:w o:o l:l v:f e:{{tag|n}} s:{{tag|pl}}</code>. The left/form side of this spells <code>wolves</code> and the right/analysis side of this spells <code>wolf{{tag|n}}{{tag|pl}}</code>. Mapping between one and the other is as simple as taking one as input and following the path—by outputting the other side of each arc, you will get the other as output!

'''Question''': What are all the possible paths provided by this transducer?

== The formalism we use (lexd) ==

Transducers are pretty cool, and quite efficient... for computers. Following paths by hand is tedious, and drawing a transducer for anything more complex than the example above is torture. See the transducer below for Tuvan.

[[File:tuvan transducer.png|1000px]]

This transducer provides the combinations of about 8 case marker, 5 possessive morphemes, and the plural marker for three Tuvan nouns.

An example is <code>өг>{{archiphon|L}}{{archiphon|A}}р>{{archiphon|i}}м>{{archiphon|D}}{{archiphon|A}}н</code> mapping to <code>өг{{tag|n}}{{tag|pl}}{{tag|px1sg}}{{tag|abl}}</code>, meaning "from my houses". The analysis side is clear to anyone familiar with tags (and knowing that "өг" means "house"). The form side is actually something that will get fixed by morphophonology, which we'll worry about later (for now: letters like <code>{{archiphon|L}}</code> can be realised in a variety of ways, and <code>></code> is used as a morpheme boundary); the actual orthographic form is <code>өглеримден</code>.

'''Question''': How can we quantify the complexity of this graph? 

Fortunately, we don't have to draw this graph by hand. We can simply define the various sections of it and link them together with a straightforward formalism called '''lexd'''. A section of a lexd file that corresponds to the graph above looks like the following:

<pre>
PATTERNS

N-Stems [ <n>: ] [ <pl>:>{L}{A}р ]? Possession? Cases

LEXICON N-Stems

өг:өг # "yurt"
аът:аът # "horse"
ном:ном # "book"

LEXICON Possession

<px1sg>:>{i}м
<px2sg>:>{i}ң
<px3sp>:>{z}{I}{n}
<px1pl>:>{i}в{I}с
<px2pl>:>{i}ң{A}р

LEXICON Cases

<nom>:
<gen>:>{N}{I}ң
<acc>:>{N}I
<dat>:>{G}{A}
<loc>:>{D}{A}
<abl>:>{D}{A}н
<all>:>{J}е
<all>:>{D}{I}в{A} # Dir/LR
</pre>

'''Questions'''
* What is <code>#</code> doing? 
* What is <code>:</code> doing? 
* What are the <code>?</code>s doing? 
* How are the lists of parts (LEXICONs) combined into a whole? 

* What is not mentioned in this code that is in the graph above? 
* Can you match sections of the graph to sections of the code? 

== Additional nuances ==

=== Phonology ===
The symbols like {{archiphon|L}} above will need to be realised as different characters in different context.

For any symbols in your language that will be realised in different ways in different environments, you'll want to set up such an "archiphoneme". Use an uppercase letter for something that just has different forms, and use a lowercase letter for something that is inserted or deleted (i.e., is sometimes realised as nothing).

For now, it will suffice to define all the ways in which each archiphoneme surfaces by making a list in your <code>twol</code> file. This essentially allows all of the options to surface, which means you will be able to analyse incorrect forms as well as correct ones. Later, when you make a generator, you'll write rules to constrain where each of the symbols can occur.

=== Defining symbols ===

You'll want to define your archiphoneme symbols in the twol file, each with all its possible outputs.

So your twol file should contain an <code>Alphabet</code> section, which lists all the characters of the alphabet, and then all the archiphonemes with all their realisations. You will also want the <code>></code> morpheme separator and some punctuation marks, all escaped. A condensed example for Tuvan follows:

<pre>
Alphabet

А Б В Г Д Е Ё Ж З И Й К Л М Н Ң О Ө П Р С Т У Ү Ф Х Ц Ч Ш Щ Ъ Ы Ь Э Ю Я
а б в г д е ё ж з и й к л м н ң о ө п р с т у ү ф х ц ч ш щ ъ ы ь э ю я

%{A%}:а %{A%}:е
%{L%}:л %{L%}:н
%{i%}:0 %{i%}:ы %{i%}:и %{i%}:у %{i%}:ү

%.
%-

%>:0
;

</pre>

=== Starting point ===

You'll need at least one <code>PATTERNS</code> section in your lexd file. Bootstrapping a new language module per the instructions will create this for you, but don't forget that it's a thing!

=== Morphology that isn't suffixes ===

You may remember from last week that we discussed that analyses are generally in the form '''stem''' + '''POS tags''' + '''subcategory tags''' + '''function tags'''. What if some of your functional morphology occurs before the stem?

You can certainly implement that as shown above, but there's a problem: your tags will occur in the middle of the analysis. That is, instead of something like {{morphTest|do{{tag|v}}{{tag|tv}}{{tag|rep}}{{tag|prc}}|redoing}}, you'd get something like {{morphTest|{{tag|rep}}do{{tag|v}}{{tag|tv}}{{tag|prog}}|redoing}}. This is undesirable in terms of keeping track of which of your tags are for what.

Fortunately lexd offers a trick for handling such things! You can list the left and right side of a given LEXICON in different parts of a PATTERN, and the pieces will be matched. The following is a simple example (which assumes that the "re" prefix in English should be treated as productive and inflectional, which it probably shouldn't):

<pre>
PATTERNS

Verbs

PATTERN Verbs

V-Base V-Tenses

PATTERN V-Base

V-Stems(1) [<v>:] V-Stems(2):
V-Prefixes(1) V-Stems(1) [<v>:] V-Stems(2): V-Prefixes(2)

LEXICON V-Prefixes(2)

:re> <rep>:
:un> <rev>:

LEXICON V-Tenses

<prog>:>ing
<past>:>{e}d

LEXICON V-Stems(2)

tie:tie <tv>
start:start <tv>
</pre>

'''Questions:'''
* What are the forms output by this transducer?
* (How many forms are there?)
* What are the numbers in <code>()</code>?
* What part of the file adds the prefixes and what part of the file adds the prefix tags?
* What are the different <code>PATTERN</code> groups for?

==== another example ====
Here's a better example, showing (productive, inflectional) gender agreement on verbs in Avar. Note the other way of matching prefixes to tags (the <code>V-Gender</code> lexicon as compared to <code>V-Prefixes</code> in English).

<pre>
PATTERNS

Verbs

PATTERN Verbs

:V-Gender V-Stems(1) [<v>:] V-Stems(2): V-Tense V-Gender:

LEXICON V-Tense

<aor>:>уна

LEXICON V-Gender

<nt>:б>
<m>:в>
<f>:й>
<pl>:р>

LEXICON V-Stems(2)

бицине:иц <tv> # "говорить"
</pre>

The output analyses would be the following:

<pre>
бицине<v><tv><aor><nt>:бицуна
бицине<v><tv><aor><f>:йицуна
бицине<v><tv><aor><m>:вицуна
бицине<v><tv><aor><pl>:рицуна
</pre>

== In-class exercise ==

See [[Morphological analyser/Exercises]].

The work we did on this in class is available on Swarthmore's github at [https://github.swarthmore.edu/Ling073-sp23/ling073-eng ling073-sp23/ling073-eng].

== Documentation ==

'''[https://github.com/apertium/lexd/blob/master/Usage.md Documentation of <code>lexd</code>]''' is available.

== Evaluation ==
This section lists various commands that will help you evaluate your progress / how well the analyser is functioning.

=== Individual forms ===
To test whether/how your analyser is analysing a form, you can run the following:
echo "form" | apertium -d /path/to/analyser/ xyz-morph
An example might be the following:
apertium-tyv$ echo өглеримден | apertium -d . tyv-morph
^өглеримден/өг<n><pl><px1sg><abl>$^./.<sent>$
You can also do it this way:
apertium-tyv$ echo өглеримден | hfst-proc tyv.automorf.hfst
This output means that for the form <code>өглеримден</code> there is one analysis: <code>өг{{tag|n}}{{tag|pl}}{{tag|px1sg}}{{tag|abl}}</code>. A form with multiple analysis would have them separated by <code>/</code>, like the following:
^өг/өг<n><nom>/өг<n><attr>/өг<n><nom>+э<cop><aor><p3><sg>$^./.<sent>$
A form with no analyses in the transducer will just return the form with an <code>*</code> before it, like the following:
^өглеримнен/*өглеримнен$^./.<sent>$

=== See full contents of analyser ===

The following command outputs the '''full contents of the transducer'''. Note that it only does one cycle through the graph, which means for numbers you'll only get double digits. Without <code>-c0</code> (or <code>-c1</code>, etc.—to tell it how many times to cycle through) it will cycle indefinitely, which probably isn't what you want.

hfst-expand -c0 xyz.automorf.hfst

If all the numbers are annoying, you can do this to get only non-number contents:

hfst-expand -c0 xyz.automorf.hfst | grep -v '<num>'

Likewise, you can focus on a particular part of speech, e.g. {{tag|n}}s:

hfst-expand -c0 xyz.automorf.hfst | grep '<n>'

=== A long list of forms with known analyses ===
To test whether your analyser is analysing forms correctly, you can
# put your analyses or forms into a file in <code>test/</code> and run [[apertium-regtest]].
# put your analyses into a <code>yaml</code> file and use <code>morph-test</code> (or <code>[[apertium-quality|aq-morftest]]</code>):
#: <code>morph-test -csi xyz.yaml | most</code>
#: or
#: <code>aq-morftest -csi xyz.yaml | most</code>

=== Coverage over a corpus ===
To test coverage over a corpus, you can use <code>coverage-hfst</code> or <code>[[apertium-quality|aq-covtest]]</code>:
coverage-hfst xyz.corpus.basic.txt /path/to/xyz.automorf.hfst

aq-covtest xyz.corpus.basic.txt /path/to/xyz.automorf.bin

=== Generating forms ===
If you need to test how a form generates, you can do something like the following:
echo "^house<n><pl>$" | apertium -d . -f none xyz-gener
This will return all forms currently being generated, e.g. <code>houses/housees</code>

But note that the next lab will be about [[morphological generator|morphological generation]].

=== Counting lexicon entries ===
You can run the following command to list lexicons and counts in them all:
lexd -x apertium-xyz.xyz.lexd > /dev/null

Note that a number of these lexicons are probably related to your morphology. If you're counting "lexical entries", you should probably exclude the morphology ones.

== The assignment ==
This assignment will be due at the end of the day Friday of the 6th week of class (this semester: '''23:59 on Friday, February 24th, 2023''').

This assignment is to develop a morphological analyser that implements a good deal of the basic morphology of your language.

=== Getting set up ===
# Bootstrap a transducer for your language using <code>apertium-init</code> (installed on the lab machines):
#: <code>apertium-init -a lexd --with-spellrelax --prefix=ling073 xyz</code>
# Create a new ''empty'' repo (that is, don't check the README option) in [https://github.swarthmore.edu/Ling073-sp23/ the course's GitHub organisation] with the name <code>ling073-xyz</code> (with your language's code in place of <code>xyz</code>). Then add the SSH link as a remote origin in your initialised module and push the module to the GitHub repo:
#: <code>git remote add origin git@github.swarthmore.edu:Ling073-sp23/ling073-xyz.git</code>
#: <code>git push --set-upstream origin master</code>
# Go into the new directory (<code>cd ling073-xyz</code>), initialise the module (<code>./autogen.sh</code>), and compile it (<code>make</code>).
#* If this is successful, you should have several "modes" available; run <code>apertium -d . -l</code> to see.
#* One mode should be an <code>xyz-morph</code> mode; this is your analyser. Check it by running <code>echo "houses" | apertium -d . xyz-morph</code> , which should give you a morphological analysis of the word "houses".
# {{highlight|Integrate any comments I've provided to you on your grammar documentation page so that all of your morphTests are in good order. See the sanity checks at [[Grammar documentation#Sanity checks]] to check the main things.}}
# Augment the commented section at the top of the <code>apertium-xyz.xyz.lexd</code> file with any tags you came up with during the [[Grammar documentation]] assignment that aren't there already. Provide a symbol, and a brief comment explaining what the symbol means.
# Add ''all'' the characters of your language's orthography to the <code>Alphabet</code> section of the <code>apertium-xyz.xyz.twol</code> file. You may need to add archiphonemes later.
# Use the <code>[[morphTests2regtest]]</code> script (installed on the lab machines) to create a set of test files in a subdirectory called <code>test/</code>.
#* Commit these files to the git repo!
#* (You can remove empty files if you like.)
#* There should be at least 50 tests in the "-morph" files in this directory. You can make sure you have enough by counting lines in the <code>*-morph-input.txt</code> files; this will count the number of tests in each file and also return a total:
#*: <code>wc -l test/*/*-morph-input.txt</code>

=== The hard stuff ===
# '''Build your morphological transducer''', adding all of the stems from your Grammar documentation assignment, categorised correctly, so that '''at least half of your tests pass'''. You'll need to build up the morphotactics too.
#* If too many of your grammar points are too hard to implement at this point (e.g., require some rules to change some characters to other characters), then you can skip one or two of them and instead add more "easy" forms to your transducer.
#* Alternatively "hard-code" some forms, but add a comment in the lexd file near the relevant forms indicating that they need further work, and mention it on the wiki page (see below).
#* Also don't forget to clean up your grammar page. Don't forget to rerun the scraping script to get a fresh version of the tests file. If you're happy with your grammar page and don't expect to change it much, feel free to "clean up" your tests file manually.
# '''Create a page on the wiki''' <code>Language/Transducer</code> that links to the code and has Evaluation and Notes sections.
#* In the Notes section, say what tests still don't work and why.
#* Add the page to the category [[:Category:Sp23_Transducers]].

=== Evaluation ===
When you've finished getting half of your tests to pass.

Evaluate coverage on your corpus and add the one of the most frequent unanalysed words:
# Use <code>coverage-hfst</code> or <code>[[apertium-quality|aq-covtest]]</code> (as above) to see how many forms in your basic corpus are analysed, and what the top unknown forms are.
#* Make note of the coverage at this point
# Make a new <code>txt</code> file in your tests directory with the top unanalysed words.
#* Name the file something like <code>commonwords-morph-input.txt</code>
#* For each analysis, just put an {{tag|unk}} tag (for "unknown") after each form.
#* You'll need to add these files to your <code>test/tests.json</code> file. See [[Apertium-regtest#Manually adding tests]] for more information on manually adding tests.
#* Don't forget to commit these files to your git repository!
# Figure out what the analyses of '''at least three''' of these words should be, using the resources you have available (grammar books, etc.), and update your test file accordingly.
# Add '''at least one''' of these analyses to your transducer so that the test passes.
# Rerun <code>apertium-regtest test</code> to see by how much your coverage improved.
#* Add a note to the notes section of the additional top word(s) you added, and the resulting change in coverage (e.g., «by adding "{{morphTest|and{{tag|cnjcoo}}|and}}" to the transducer, coverage went from 19.76% to 22.32%»)

In the Evaluation section on the wiki page, add the following:
* Total number of stems in the transducer. You can use the following method, or count the stems manually.
*: <code>lexd -x apertium-xyz.xyz.lexd > /dev/null</code> (then add the counts for the relevant individual lexicons)
* Current coverage over your combined corpus
* The current list of top unknown words returned by <code>apertium-regtest test -c .-morph</code>
* Number of tests that pass in each yaml file
** The test files should have at least half of the tests passing
** The <code>commonwords-morph-*.txt</code> files should have at least 1 passing test

=== Housekeeping ===
# Add yourself to the <code>AUTHORS</code> file.
# Make sure the <code>COPYING</code> file contains an open-source license to your liking (default should be [https://www.gnu.org/licenses/quick-guide-gplv3.html GPL3]).
# Add links to the transducer repo and wiki page to the list of resources you developed for your language on the language's page on this wiki.

=== Sanity checks before submitting ===
# Did you commit ''just'' the initial files created by bootstrap ''before'' you initialised or compiled the module? If not, start over with bootstrapping, being sure copy over any files you've changed. Or use [[Removing binaries from transducer repo|this method]].
# Did you commit your updates to <code>lexd</code> and <code>twol</code> files? And the <code>txt</code> test files?
# Do you have at least 50 tests in the main tests file? Do at least half of them match gold via <code>apertium-regtest test -c .-morph</code>?
# Did you add everything asked for to the wiki page (evaluation, etc.) and your repo (e.g., files in your <code>test/</code> directory).
# If you have trouble analysing or compiling, are all your tags and symbols (full alphabet) defined in your twol file?

[[Category:Assignments]]
[[Category:Tutorials]]
[[Category:Activities]]

Mirandese

2023-02-24T02:45:41Z

Nferris1: /* Developed Resources */

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl Transducer Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-02-24T02:43:33Z

Nferris1:

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Transducer|Transducer Wiki page]]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-02-24T02:42:52Z

Nferris1: /* Developed Resources */

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[Mirandese/Grammar|Transducer]]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-02-24T02:42:23Z

Nferris1: /* Developed Resources */

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]
*[[https://wikis.swarthmore.edu/ling073/Mirandese/Transducer Transducer Wiki page]]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese/Transducer

2023-02-24T01:34:15Z

Nferris1:

== Evaluation ==

== Notes ==

TOP UNKNOWN WORDS:
88 ^de/*de$
48 ^i/*i$
21 ^que/*que$
16 ^ls/*ls$
11 ^ye/*ye$
11 ^a/*a$
10 ^por/*por$
9 ^ne/*ne$
9 ^cumo/*cumo$
9 ^an/*an$
8 ^ua/*ua$
8 ^se/*se$
8 ^para/*para$
8 ^na/*na$
7 ^lhéngua/*lhéngua$
6 ^un/*un$
6 ^cun/*cun$
5 ^ó/*ó$
5 ^tecnologie/*tecnologie$
5 ^ser/*ser$
coverage: 141 / 1127 (~0.12511091393078970719)
remaining unknown forms: 986
ambiguity: 1169 / 1127 (~1.03726708074534161491)

[[Category:Sp23_Transducers]]

Mirandese/Transducer

2023-02-24T01:21:23Z

Nferris1:

== Evaluation ==

== Notes ==

[[Category:Sp23_Transducers]]

Mirandese/Transducer

2023-02-24T01:20:12Z

Nferris1: Created page with " == Evaluation == == Notes =="

== Evaluation ==

== Notes ==

Mirandese

2023-02-16T16:33:36Z

Nferris1: /* Developed Resources */

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

*[[Mirandese/Keyboard|Keyboard Wiki page]]
*[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]
*[[Mirandese/Grammar|Grammar documentation]]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-02-16T16:32:33Z

Nferris1: /* Developed Resources */

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

[[Mirandese/Keyboard|Keyboard Wiki page]]

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]

Mirandese

2023-02-16T15:17:09Z

Nferris1:

'''[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-corpus Corpus Repository]'''

=== Developed Resources ===

[https://wikis.swarthmore.edu/ling073/Mirandese/Keyboard Keyboard Wiki page]

[https://github.swarthmore.edu/Ling073-sp23/ling073-mwl-keyboard Keyboard Github repo]

=== External Resources ===

== Computational Resources ==
[https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/dd4208e1-f965-41cb-a852-7ceda542bbbd/content Scholarspace] Scholarly article about the creation of the first Mirandese text-to-speech system. Creative Commons

[https://student.dei.uc.pt/~crpires/tradutor/Tradutor.html Tradutor] Portuguese to Mirandese online translator (no source code available). Copyright, All Rights Reserved

[https://www.verbix.com/languages/mirandese Verbix] Mirandese verb conjugator. Copyright, All Rights Reserved

== Dictionaries ==

[https://glosbe.com/en/mwl Glosbe] Any language to Mirandese word-by-word translator with dictionary definitions included, individual definitions added by public users. N/A

[http://www.travelphrases.info/languages/mirandese.htm Travel Phrases] Short list of Mirandese travel phrases. N/A

[http://www.mirandadodouro.com/dicionario/ Miranda Do Douro] Portuguese to Mirandese translator with dictionary definitions included (no source code available). Copyright

== Grammatical Descriptions ==

[https://studosmirandeses.blogs.sapo.pt/1294.html Studos Mirandeses] Detailed blog post about the Mirandese language with example words. N/A

[https://www.youtube.com/watch?v=K0jy9x-U4zU YouTube] Mini-video that teaches Mirandese. Copyright

[https://www.cm-mdouro.pt/pages/246?poi_id=156 Miranda Do Douro] Book publication on grammatical aspects of Mirandese (paid access). Copyright, All Rights Reserved

== Scientific Works ==

[https://repositorio-aberto.up.pt/bitstream/10216/55872/2/MeirinhosEstudosMirandeses000127165.pdf MeirinhosEstudosMirandeses] A study in Portuguese about the Mirandese language. Copyright

[https://books.openedition.org/msha/1894 Open Edition] French study about the political position of Mirandese. Copyright

[https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwjx4LvPm_L8AhXCKFkFHZeuBlYQFnoECA0QAQ&url=https%3A%2F%2Fwww.raco.cat%2Findex.php%2FDialectologia%2Farticle%2Fdownload%2F367611%2F461472%2F&usg=AOvVaw13-N8P6uIY0WyAFudhdDtk Google Download] Lexical study in Spanish comparing Mirandese to Spanish, Portuguese, and Latin. Copyright

[https://journals.akademicka.pl/si/article/download/3302/3208/4302 Akademicka] Article in Spanish on the history, and phonetic features of Mirandese. N/A

[https://www.jstor.org/stable/44939318?sid=primo#metadata_info_tab_contents Fonologia JSTOR] A discussion of Mirandese phonology written in French. Copyright

== Corpora ==

[https://www.orbilat.com/Languages/Asturian-Mirandes/ Orbilat]
Website containing Mirandese jokes, kids’ songs, songs, riddles, proverbs, tales, and poems. Copyright

[https://www.ancora-editora.pt/pt/autores/amadeu-ferreira Ancora-Editora]
Website with (translated) books in Mirandese available for purchase. Copyright

[http://mirandes.blogspot.com/ Mirandes Blospot]
Mirandese blog. N/A

[https://mwl.wikipedia.org/wiki/Biquip%C3%A9dia:P%C3%A1igina_percipal Biquipédia]
Mirandese Wikipedia or Biquipédia /bikipedja/.

[https://labidamirandesa.pt/pt/homepage-pt/ L Princepico]
Link to The Little Prince in Mirandese (available for purchase). Copyright

[[Category:Mirandese]] [[Category:Sp23 ResourceDocumentation]]