Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / Datok / 4c2a1ad09d5c10ad0a472f11f986a8e695657a4e / src / tokenizer.xfst
  1. 4c2a1ad Introduce XML tests by Akron · 3 years, 3 months ago
  2. 3de361e Improved newline and abbreviation handling by Akron · 3 years, 3 months ago
  3. 57d0161 Add known terms with special characters by Akron · 3 years, 3 months ago
  4. e8837b5 Add file scheme by Akron · 3 years, 3 months ago
  5. fd92d7e Update abbreviations according to KorAP-Tokenizer by Akron · 3 years, 3 months ago
  6. a0bded5 Add ordinals by Akron · 3 years, 3 months ago
  7. 4af79f1 Added support for streetnames by Akron · 3 years, 3 months ago
  8. 310905f Add foma sources by Akron · 3 years, 3 months ago