User:Tjones5/Final project
From LING073
Placeholder page for final project
Notes
- To implement:
- Reduplication
- Get a big corpus:
- Build a scraper? to get corpus up to 25K
- Use regular expressions to clean up scraped (or copied/pasted) text
- For evaluation:
- Go back and look at coverage
- Other ling to do: UD pipeline
Presentation
What will be expected for this assignment is a 10 minute presentation in which you share the following with your classmates:
- A description of the problem addressed by your project. For some projects this may require thinking about it in a somewhat new light. Whether or not the problem is something we've dealt with in class, provide a brief but complete introduction to the problem.
- What is a transducer? What does it do?
- A morphological transducer connects forms with analyses.
- Any previous work you've found that also addresses this problem or similar problems, and how it relates to what you're doing.
- Previous work?
- Many languages
- Your thoughts on who might benefit from your project and in what way. E.g., might a language community be able to find a use for what you're doing, or maybe [computational] linguists working on a language or issue?
- Why is a transducer useful to a community of Warlpiri speakers?
- How you're approaching the solution to the overall problem, including how you're implementing the solution. You can talk here about smaller individual issues that have arisen as well.
- What specifics have I worked on?
- Need to build a scraper to test on a larger corpus
- Mostly have worked within lexc and twol files
- Disambiguation is a challenge because of flexible word order
- How you're evaluating the effectiveness of the solution, and some preliminary look at results of the evaluation. We'll understand that the project isn't yet complete, so the evaluation may show that the project is entirely ineffective and useless :-P
| status | description | stems | coverage |
|---|---|---|---|
| prototype | language module that has not received heavy development | <1,000 | <60% |
| development | language module under development | ≥1,000 | ≥60% |
| working | language module with near-production-quality performance | ≥8,000 | ≥80% |
| production | language module used in a released pair | ≥10,000 | ≥90% |
Table Source: http://wiki.apertium.org/wiki/Languages
