Difference between revisions of "Final projects/Transducer"

From LING073
Jump to: navigation, search
(Created page with "* You can contribute straight to Apertium: ask for commit access. * To get random forms from your corpora for precision/recall measures: *# <pre>ca...")
(No difference)

Revision as of 20:42, 2 May 2017

  • You can contribute straight to Apertium: ask for commit access.
  • To get random forms from your corpora for precision/recall measures:
    1. cat corpus1.txt corpus2.txt | apertium -d . abc-tagger | sed -r 's/\$\s*\^/\$\n\^/g' | cut -f1 -d'/' | sed 's/[\^\s\t]*//' | sort -Ru | head -n 1200 > words.txt
    2. cat words.txt | apertium -d . abc-disam
    3. Then do this again: Polished RBMT system#Hand-annotating corpora