Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-XML-TEI / 72f4a8870f5f68d32ea7b41f39faad3f0f03dd4d / t / tokenization-korap.t
  1. 4ee372a Improve test suite for inability to use KorAP-Tokenizer by Akron · 2 years, 9 months ago v2.3.2
  2. dcd38b3 Update KorAP-Tokenizer to v2.2.2 (single quote bug fix) by Marc Kupietz · 2 years, 11 months ago
  3. 179f221 Add tests for clitics and contractions: French, English, German by Marc Kupietz · 3 years, 5 months ago
  4. 985da0c Add -s option to use sentence boundaries provided by KorAP tokenizer by Marc Kupietz · 3 years, 10 months ago
  5. 7c88a7b Update KorAP-Tokenizer to v2.0.0-SNAPSHOT by Marc Kupietz · 4 years, 2 months ago
  6. 1e882fb Add -tk option to use the standard KoAP tokenizer by Marc Kupietz · 4 years, 3 months ago