Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / Datok / a2f952f3883d14cfdd09e1d18c4dc7e7596de855 / src / de / tokenizer.xfst
  1. a2f952f Support Wikipedia templates by Akron · 4 weeks ago
  2. d8d8895 Introduce hyphenated abreviations in german tokenizer by Akron · 4 weeks ago
  3. 6dcb6ce Add arrows by Akron · 3 years, 11 months ago
  4. 78f6714 Split tokenizer rules into language-specific and language-dependent by Akron · 3 years, 11 months ago