Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-XML-TEI / 4ad648ee54032d8ee9c471d6a8ee5ce7dcb7c77c / t / tokenization-korap.t
  1. 4ad648e Bump KorAP-Tokenizer to v2.3.0 and our version to 2.6.2 by Marc Kupietz · 5 weeks ago
  2. 4ee372a Improve test suite for inability to use KorAP-Tokenizer by Akron · 3 years, 11 months ago v2.3.2
  3. dcd38b3 Update KorAP-Tokenizer to v2.2.2 (single quote bug fix) by Marc Kupietz · 4 years ago
  4. 179f221 Add tests for clitics and contractions: French, English, German by Marc Kupietz · 4 years, 6 months ago
  5. 985da0c Add -s option to use sentence boundaries provided by KorAP tokenizer by Marc Kupietz · 5 years ago
  6. 7c88a7b Update KorAP-Tokenizer to v2.0.0-SNAPSHOT by Marc Kupietz · 5 years ago
  7. 1e882fb Add -tk option to use the standard KoAP tokenizer by Marc Kupietz · 5 years ago