Difference between revisions of "Spring 2018/Lexical transfer"
From LING073
| Line 1: | Line 1: | ||
| + | == Bootstrapping a language pair == | ||
| + | # To bootstrap a language pair whose primary function is to translate from language xyz to language abc, do the following: <code>apertium-init -a1 hfst -a2 hfst xyz-abc</code> | ||
| + | # Rename the directory to <code>ling073-xyz-abc</code>. | ||
| + | # Commit the entire thing to git the same way you did your [[Bootstrapping_a_transducer#Commit_to_github|transducer after bootstrapping it]] (unless you did it wrong). | ||
| + | # Initialise it (in the new directory) with the following command: <code>./auotgen --with-lang1=/path/to/ling073-xyz --with-lang1=/path/to/ling073-abc</code> | ||
| + | # Compile with <code>make</code> as always. | ||
| + | |||
== The assignment == | == The assignment == | ||
| − | # Bootstrap a language pair. | + | # Bootstrap a language pair. (The person you're working with will bootstrap the reverse pair) |
# Add all the words for transfer tests to dix. | # Add all the words for transfer tests to dix. | ||
#* And make sure each analyser can analyse all sentences correctly. | #* And make sure each analyser can analyse all sentences correctly. | ||
Revision as of 08:05, 16 March 2017
Bootstrapping a language pair
- To bootstrap a language pair whose primary function is to translate from language xyz to language abc, do the following:
apertium-init -a1 hfst -a2 hfst xyz-abc - Rename the directory to
ling073-xyz-abc. - Commit the entire thing to git the same way you did your transducer after bootstrapping it (unless you did it wrong).
- Initialise it (in the new directory) with the following command:
./auotgen --with-lang1=/path/to/ling073-xyz --with-lang1=/path/to/ling073-abc - Compile with
makeas always.
The assignment
- Bootstrap a language pair. (The person you're working with will bootstrap the reverse pair)
- Add all the words for transfer tests to dix.
- And make sure each analyser can analyse all sentences correctly.
- Make some decisions to bring your tagsets closer together, and add mappings to dix.
- You may have used any of <v>, <vb>, <vblex>, <verb> for verbs, and if it's not the same one, it doesn't matter.
- If one of you marked transitivity on verbs and one of you didn't, ________
- You probably will want to bring your grammatical information tags closer together, e.g., <nz>/<nmz> and <ger> could potentially be combined.
- Find more words (examine dictionaries, texts) so that there's a total of at least 50 words, with at least 10 nouns and 10 verbs.
- Make sure all the words are in monolingual dictionaries.
- Find at least one case in each direction of a one-to-many mapping.
- Evaluate in the following ways:
- WER, PER on tests (probably 0%)
- number of stems translated correctly on tests (hopefully close to 100%)
- number of forms in corpus with translated stems
way to scrape and store tests