Difference between revisions of "Using the tools on your own system"

From LING073
Jump to: navigation, search
(→‎Installing core tools)
(→‎Misc tools)
 
(4 intermediate revisions by the same user not shown)
Line 4: Line 4:
 
* The core tools:
 
* The core tools:
 
** Apertium, with <code>lttoolbox</code> and other dependencies
 
** Apertium, with <code>lttoolbox</code> and other dependencies
−
** <code>apertium-lex-tools</code>, <code>apertium-separable</code>, <code>apertium-recursive</code>, <code>apertium-anaphora</code>
+
** <code>apertium-lex-tools</code>, <code>apertium-separable</code>, <code>apertium-recursive</code>
 
** HFST
 
** HFST
 
** CG-3
 
** CG-3
Line 18: Line 18:
  
 
Alternatively, you can install VirtualBox and use a [[:apertium:Apertium VirtualBox|Linux virtual machine with Apertium tools installed]].
 
Alternatively, you can install VirtualBox and use a [[:apertium:Apertium VirtualBox|Linux virtual machine with Apertium tools installed]].
−
 
  
 
=== Apertium installation on Debian/Ubuntu (including under Windows WSL) ===
 
=== Apertium installation on Debian/Ubuntu (including under Windows WSL) ===
Line 61: Line 60:
 
First, for <code>morph-test</code> to work, you'll need PyYAML.
 
First, for <code>morph-test</code> to work, you'll need PyYAML.
  
−
  # on macOS using homebrew:
+
On Debian/Ubuntu (including under Windows with WSL):
 +
  $ sudo apt-get install python3-yaml
 +
 
 +
On macOS using homebrew and pretty much any other system where you don't mind bypassing your package manager:
 
  $ pip3 install PyYAML
 
  $ pip3 install PyYAML
−
# on Debian/Ubuntu (including under Windows with WSL):
 
−
$ sudo apt-get install python3-yaml
 
  
−
Then clone the tools repo:
+
Then clone the tools repo, being sure to use the <code>--recurse-submodules</code> option (since the repo includes two subrepos):
  
 
  $ git clone --recurse-submodules git@github.swarthmore.edu:Ling073-sp21/tools.git
 
  $ git clone --recurse-submodules git@github.swarthmore.edu:Ling073-sp21/tools.git
  
−
And then run <code>make</code> or <code>sudo make</code>.
+
And then run <code>make</code> or <code>sudo make</code> to install the tools to either your local <code>~/bin</code> directory or the system <code>$PREFIX</code>, respectively.
 +
 
 +
If the latter, you need to be a system administrator; if the former, make sure you have your <code>~/bin</code> in your <code>$PATH</code>.  How to do this will depend on your shell; in bash, edit your <code>~/.bash_profile</code> file, and make sure <code>$HOME/bin</code> is in the <code>PATH=</code> list, separated from other entries by <code>:</code>.
  
 +
== Also see ==
 +
* [[Accessing the lab machines remotely]]
  
 
[[Category:Tutorials]]
 
[[Category:Tutorials]]
 
[[Category:Tools]]
 
[[Category:Tools]]

Latest revision as of 04:15, 17 January 2023

It's possible to use the tools we make use of in class on your own system.

The following is the complete list of tools you'll need:

  • The core tools:
    • Apertium, with lttoolbox and other dependencies
    • apertium-lex-tools, apertium-separable, apertium-recursive
    • HFST
    • CG-3
    • lexd
  • udpipe (not needed Spring 2021)
  • Miscellaneous tools (from repo)

Installing core tools

There are three main methods to install the core tools:

Alternatively, you can install VirtualBox and use a Linux virtual machine with Apertium tools installed.

Apertium installation on Debian/Ubuntu (including under Windows WSL)

Set up the Apertium nightly script.

Then install all development packages

$ sudo apt-get -f install apertium-all-dev

That should install all the core tools on your system!

Apertium installation on Mac using homebrew

Install homebrew

Homebrew is a package manager for Mac. To install it, open a terminal run the following:

$ /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

This will take several minutes.

Note that you'll probably need the XCode developer tools from Apple to install homebrew. If you don't have them installed, Homebrew may direct you to install them—perhaps automatically—but it may not.

Install dependencies from homebrew

$ brew install gperftools help2man pcre icu4c perl518 gawk autoconf automake pkg-config cmake wget gcc

This will take a couple minutes.

Install apertium core tools and HFST

$ wget https://apertium.projectjj.com/osx/install-nightly.sh -O - | bash

This will take a minute.

UDpipe

Follow these instructions.

Misc tools

First, for morph-test to work, you'll need PyYAML.

On Debian/Ubuntu (including under Windows with WSL):

$ sudo apt-get install python3-yaml

On macOS using homebrew and pretty much any other system where you don't mind bypassing your package manager:

$ pip3 install PyYAML

Then clone the tools repo, being sure to use the --recurse-submodules option (since the repo includes two subrepos):

$ git clone --recurse-submodules git@github.swarthmore.edu:Ling073-sp21/tools.git

And then run make or sudo make to install the tools to either your local ~/bin directory or the system $PREFIX, respectively.

If the latter, you need to be a system administrator; if the former, make sure you have your ~/bin in your $PATH. How to do this will depend on your shell; in bash, edit your ~/.bash_profile file, and make sure $HOME/bin is in the PATH= list, separated from other entries by :.

Also see