Rgoel1/Final Project
From LING073
Revision as of 19:44, 7 May 2025 by Rgoel1 (talk | contribs) (Created page with "==An LLM-Based Approach to Generalized Linguistic Data Scraping== * For my final project, I developed a (preliminary) general-use web scraper that uses a Large Language Model...")
An LLM-Based Approach to Generalized Linguistic Data Scraping
- For my final project, I developed a (preliminary) general-use web scraper that uses a Large Language Model (LLM) to analyze the content and pagination structure of any given website containing linguistic text, and then automatically traverses the site while structuring/exporting the data as specified.
- The project aims to take the burden of having to manually write bespoke scrapers for different websites off of both academic linguists and communities looking to construct reliable corpora of their language's resources.
- GitHub Repository (more details in README.md): [1]
