Write a script to extract text from Inuktitut Magazine

[GoogleCodeExporter]

Purpose of addition of this task:
We want to use the text in Inuktitut Magazine because its an aligned corpus for 
3 languages(English, French, Inuktitut and Inuktitut Romanized)
To use the text we need to run pdftotext on the pdfs. Unfortunatly the encoding 
of the Inuktitut is Nunacom, not Unicode. We should try to find a transcoder 
(http://www.inuktitutcomputing.ca/Transcoder/index.php?lang=en) or write one to 
turn the seeming garbage into unicode.

When reviewing task, please focus on:
creating a quick and dirty transcoder for the words that look like garbage (on 
the hypothesis that those are sylabics)

After the review, please add the script to Tools for field linguistics source 
code.

After the review, the expected next step is to:
To run the extract function and content words script on the corpus to get a 
feel for the corpus size and vocabulary.

Original issue reported on code.google.com by [email protected] on 9 Nov 2011 at 10:25

• Blocking: Extract the vocabulary from the Inuktitut Corpus #14
• Blocked on: Inuktitut Corpus #10

[GoogleCodeExporter]

Original comment by [email protected] on 9 Nov 2011 at 10:35

[GoogleCodeExporter]

The script is in this commit

http://code.google.com/p/ilanguagelab/source/detail?r=ba1c76e0b92704034dc42cec08
222f59d16aba2b

Original comment by [email protected] on 9 Nov 2011 at 10:49

• Changed state: Fixed

[GoogleCodeExporter]

Original comment by [email protected] on 25 Nov 2011 at 10:25

• Added labels: Type-Implementation