Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / a1459227d3b167a31d31d5a706f0a90256ede74b / src / main / java
  1. a145922 Bump to new dev version 2.1.0.9000 by Marc Kupietz · 4 years, 10 months ago
  2. 732905f Release v2.1.0 by Marc Kupietz · 5 years ago v2.1.0
  3. 72cc171 Release v2.0.0 by Marc Kupietz · 5 years ago v2.0.0
  4. 755a150 Prepare for v2.0.0 by Marc Kupietz · 6 years ago
  5. f5a7e04 Add French tokenizer (-l fr) by Marc Kupietz · 6 years ago
  6. 74141b3 Add -l command line option to choose language by Marc Kupietz · 6 years ago
  7. 5c6df03 List available KorapTokenizerImplementation options for -T by Marc Kupietz · 6 years ago
  8. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 6 years ago
  9. 8e197f3 Allow setting input encoding explicitely whith -e <encoding> by Marc Kupietz · 6 years ago
  10. 751868b Make tokenizer implementation exchangeable by Marc Kupietz · 6 years ago
  11. b9f45e0 Rename tokenizer class to KorAPDFATokenizer by Marc Kupietz · 6 years ago
  12. c419d5b Add new command line options using picocli and sanitize code by Marc Kupietz · 6 years ago
  13. 8192509 Use original Span class and implement Tokenizer interface from OpenNLP by Marc Kupietz · 6 years ago
  14. 478632e Clean up code by Marc Kupietz · 6 years ago
  15. 45dc0fe Add Apache copyright NOTICE by Marc Kupietz · 6 years ago
  16. 3367773 Initial import from private/Ingestion by Marc Kupietz · 6 years ago