Difference between revisions of "User:Qfeng1/Final project"

From LING073
Jump to: navigation, search
(Major Steps)
Line 1: Line 1:
Our project is to expand what we have accomplished in class, the monolingual transducer for the Chechen language. We are aiming at a goal of over 85% coverage rate over the large corpus we extracted from Wikipedia pages that are in Chechen.
+
Our project is to expand what we have accomplished in class, the monolingual transducer for the Chechen language. The main goal is to increase the coverage rate of the transducer over a large corpus (we have a large corpus extracted from Wikipedia with all pages in Chechen and therefore there is a wide range of vocabularies included).  
  
 
==Major Steps==
 
==Major Steps==
 
*To expand the morphology (in lexc and towl files)  
 
*To expand the morphology (in lexc and towl files)  
 
*To generate the top list of unknown words in corpus and add more word stems to lexc file
 
*To generate the top list of unknown words in corpus and add more word stems to lexc file
 +
 +
==Code at GitHub==
  
 
==Evaluation==
 
==Evaluation==
Line 22: Line 24:
  
 
==Further Improvement==
 
==Further Improvement==
 +
*more verb morphology needs to be added:
 +
:*proverb
 +
:*deictic
 +
:* agreement on noun class (when happen and when do not)
  
  
 
[[Category:sp19_FinalProjects]]
 
[[Category:sp19_FinalProjects]]

Revision as of 14:39, 14 May 2019

Our project is to expand what we have accomplished in class, the monolingual transducer for the Chechen language. The main goal is to increase the coverage rate of the transducer over a large corpus (we have a large corpus extracted from Wikipedia with all pages in Chechen and therefore there is a wide range of vocabularies included).

Major Steps

  • To expand the morphology (in lexc and towl files)
  • To generate the top list of unknown words in corpus and add more word stems to lexc file

Code at GitHub

Evaluation

# of stems in transducer # of words in Wiki corpus Coverage Rate Precision Recall
608 14,093,835 ~80.10% ~75.34% ~56.97%

Further Improvement

  • more verb morphology needs to be added:
  • proverb
  • deictic
  • agreement on noun class (when happen and when do not)