Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / a127e89faf0f1c1a7bc77b46018a7feaf18a4e0e
  1. 5c6df03 List available KorapTokenizerImplementation options for -T by Marc Kupietz · 4 years, 2 months ago
  2. ce48102 Recognize {LETTER}+str. as abbreviation for Straße in de-tokenizer by Marc Kupietz · 4 years, 1 month ago
  3. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 4 years, 2 months ago
  4. 8e197f3 Allow setting input encoding explicitely whith -e <encoding> by Marc Kupietz · 4 years, 2 months ago
  5. ad22e2c Update Readme.md to new call syntax by Marc Kupietz · 4 years, 2 months ago
  6. 3701806 Do not use commit ids for naming standalone jars by Marc Kupietz · 4 years, 2 months ago
  7. 751868b Make tokenizer implementation exchangeable by Marc Kupietz · 4 years, 2 months ago
  8. b9f45e0 Rename tokenizer class to KorAPDFATokenizer by Marc Kupietz · 4 years, 2 months ago
  9. c419d5b Add new command line options using picocli and sanitize code by Marc Kupietz · 4 years, 2 months ago
  10. de949de Bump version to 1.3 by Marc Kupietz · 4 years, 2 months ago
  11. f4df712 Change jar target naming conventions by Marc Kupietz · 4 years, 2 months ago
  12. 783e2a2 Ignore quoted email names like "John Doe"@xx.com by Marc Kupietz · 4 years, 2 months ago
  13. 571c194 Empty text (<EOT><EOT>) -> empty output line by Marc Kupietz · 4 years, 3 months ago
  14. 6afd121 Use standard EOT/EOF character x04 instead of magic escape \n\x03\n by Marc Kupietz · 4 years, 3 months ago
  15. 793f85d Add first tests for IPC invocation scenario by Marc Kupietz · 4 years, 3 months ago
  16. b9fb196 Update MAVEN_OPTS in Readme.md by Marc Kupietz · 4 years, 3 months ago
  17. b920f85 Set java version in pom by Marc Kupietz · 4 years, 3 months ago
  18. b2666fc Implement sentence splitter by Marc Kupietz · 4 years, 3 months ago
  19. 07d9714 Move tests to proper location by Marc Kupietz · 4 years, 3 months ago
  20. c315c2a Add .gitgnore by Marc Kupietz · 4 years, 3 months ago
  21. 8192509 Use original Span class and implement Tokenizer interface from OpenNLP by Marc Kupietz · 4 years, 3 months ago
  22. 478632e Clean up code by Marc Kupietz · 4 years, 3 months ago
  23. fe84dd0 Add Readme.md by Marc Kupietz · 4 years, 3 months ago
  24. 45dc0fe Add Apache copyright NOTICE by Marc Kupietz · 4 years, 3 months ago
  25. 656055b Add Apache LICENSE file by Marc Kupietz · 4 years, 3 months ago
  26. 3367773 Initial import from private/Ingestion by Marc Kupietz · 4 years, 3 months ago