Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / a127e89faf0f1c1a7bc77b46018a7feaf18a4e0e / src
  1. f7ca6d7 Remove or fix some automatic API comments by Marc Kupietz · 1 year, 3 months ago
  2. 439731e Replace deprecated newInstance invocation by Marc Kupietz · 1 year, 3 months ago
  3. f8b7d95 Get version information from jar manifest by Marc Kupietz · 1 year, 3 months ago
  4. d1dc848 Add mostly auto-generated api documentation by Marc Kupietz · 1 year, 3 months ago
  5. c2f448c Bump version to 2.2.3, update Readme and Changlog by Marc Kupietz · 1 year, 3 months ago
  6. 33294d9 Bump opennlp-tools from 1.9.4 to 2.1.1 by dependabot[bot] · 1 year, 9 months ago
  7. 609ab47 Imports java.io's ByteArrayOutputStream instead of 3rd-party class by Gregor Middell · 2 years, 6 months ago
  8. 6e67723 Omission words cannot start with white space by Marc Kupietz · 2 years, 11 months ago
  9. 1501f5a Extend test suite by Akron · 3 years, 1 month ago
  10. 7cbc205 Remove 'du' from abbreviation list by Akron · 3 years, 1 month ago
  11. 5b8f674 Merge "Simplified FNAME rule" by Marc Kupietz · 3 years, 3 months ago
  12. 210fc24 Remove dir/Dir from German abbreviations by Akron · 3 years, 4 months ago
  13. f061efb Bump to dev version 2.2.0.9000 by Marc Kupietz · 3 years, 3 months ago
  14. b7084ce Simplified FNAME rule by Akron · 3 years, 4 months ago
  15. ab9187d Improve test suite and lower acceptance values by Akron · 3 years, 4 months ago
  16. 1f90daf Bump version to v2.2.0 by Marc Kupietz · 3 years, 4 months ago
  17. 6d28ed1 Separate apostrophe marked contractions and clitics for en and fr by Marc Kupietz · 3 years, 4 months ago
  18. a145922 Bump to new dev version 2.1.0.9000 by Marc Kupietz · 3 years, 4 months ago
  19. 732905f Release v2.1.0 by Marc Kupietz · 3 years, 5 months ago v2.1.0
  20. 96bd87c Improve systematicity of options -p, -s, --[no-]tokens by Marc Kupietz · 3 years, 8 months ago
  21. 72cc171 Release v2.0.0 by Marc Kupietz · 4 years ago v2.0.0
  22. 755a150 Prepare for v2.0.0 by Marc Kupietz · 4 years, 1 month ago
  23. cf9b5f5 Add heuristcis for distinguishing I. as abbrevation vs PPER / CARD by Marc Kupietz · 4 years, 1 month ago
  24. 2199f76 Simplify German abbreviations by Marc Kupietz · 4 years, 1 month ago
  25. e3282b0 Accept URLs starting with "www." without URI scheme by Marc Kupietz · 4 years, 1 month ago
  26. 4fb896a Amend English abbreviation macro by Marc Kupietz · 4 years, 2 months ago
  27. f5a7e04 Add French tokenizer (-l fr) by Marc Kupietz · 4 years, 2 months ago
  28. 74141b3 Add -l command line option to choose language by Marc Kupietz · 4 years, 2 months ago
  29. 5c6df03 List available KorapTokenizerImplementation options for -T by Marc Kupietz · 4 years, 2 months ago
  30. ce48102 Recognize {LETTER}+str. as abbreviation for Straße in de-tokenizer by Marc Kupietz · 4 years, 2 months ago
  31. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 4 years, 2 months ago
  32. 8e197f3 Allow setting input encoding explicitely whith -e <encoding> by Marc Kupietz · 4 years, 2 months ago
  33. 3701806 Do not use commit ids for naming standalone jars by Marc Kupietz · 4 years, 2 months ago
  34. 751868b Make tokenizer implementation exchangeable by Marc Kupietz · 4 years, 2 months ago
  35. b9f45e0 Rename tokenizer class to KorAPDFATokenizer by Marc Kupietz · 4 years, 2 months ago
  36. c419d5b Add new command line options using picocli and sanitize code by Marc Kupietz · 4 years, 2 months ago
  37. f4df712 Change jar target naming conventions by Marc Kupietz · 4 years, 2 months ago
  38. 783e2a2 Ignore quoted email names like "John Doe"@xx.com by Marc Kupietz · 4 years, 3 months ago
  39. 571c194 Empty text (<EOT><EOT>) -> empty output line by Marc Kupietz · 4 years, 3 months ago
  40. 6afd121 Use standard EOT/EOF character x04 instead of magic escape \n\x03\n by Marc Kupietz · 4 years, 3 months ago
  41. 793f85d Add first tests for IPC invocation scenario by Marc Kupietz · 4 years, 3 months ago
  42. b2666fc Implement sentence splitter by Marc Kupietz · 4 years, 3 months ago
  43. 07d9714 Move tests to proper location by Marc Kupietz · 4 years, 3 months ago
  44. 8192509 Use original Span class and implement Tokenizer interface from OpenNLP by Marc Kupietz · 4 years, 3 months ago
  45. 478632e Clean up code by Marc Kupietz · 4 years, 3 months ago
  46. 45dc0fe Add Apache copyright NOTICE by Marc Kupietz · 4 years, 3 months ago
  47. 3367773 Initial import from private/Ingestion by Marc Kupietz · 4 years, 3 months ago