v0.11

• allow NON_SPACING_MARKERs inside NUMBERs in all languages
• README.md: README: removed LaMachine reference

v0.10.1

Small addition:

• allow NON_SPACING_MARKERs inside NUMBERs

v0.10

• modernized configuration step
• French list of known abbreviations was not used at all!
  added that
• in English, for shouldn't be handled as an abbreviation, unless
  with a trailing dot. (.``)

v0.9.1

New English twitter config wasn't installed properly yet, fixed now.

v0.9

[Ko van der Sloot]

• fix for PREFIX rules in french and italian
• small fix to prevent loosing a character in the PREFIX rule. (see LanguageMachines/ucto#87 ) This doesn't fix the unwanted splits though.
• added SYMBOL, PICTOGRAM and EMOTICON to setdefinitions
• relaxed the e-mail rule a bit.

[Piroska Lendvai]

• Suggestions for German abbreviations

[Antal van den Bosch]

• New config file for English Twitter data. Recognizes and retains #hastags and @mentions.

v0.8

[Ko van der Sloot]

• separated .abr files from there main files for all Languages
• updated italian data (thanks to @texttheater)

[Iris Hendricks]

• updated abbrev files for Portuguese Turkish and French based on
  https://en.wiktionary.org/wiki/Category:Portuguese_abbreviations and
  https://en.wiktionary.org/wiki/Category:Turkish_initialisms.
• added full list of French abbreviations.
• added 'aub' to Dutch list

v0.7.1

Bug fix release:

• install some datafiles originally provided by 'ucto'

v0.7

[Ko vd Sloot]

• tokconfig-nld-historical: typo in rule
• updated all languages with new ABBREVIATION and NUMBER-ORDINAL rules:
  = accommodate ABBREVIATIONS within brackets.
  = avoid needless backtracking in NUMBER-ORDINAL

[Maarten van Gompel]

• Apparent bug in Italian config

v0.6

several fixes for problems addressed in
LanguageMachines/ucto#46
Notes:

• the suffix problems were already addressed in 0.5
• the colon problem is not addressed. Do we need REVERSE-SMILEY?

v0.5

• adding slightly adapted tokenizer configuration for historical dutch
  (a bit more conservative on splitting).
  INL/nederlab-linguistic-enrichment/#7