- 01998cb Fix Unicode surrogate pair bugs by Marc Kupietz · 12 days ago
- a5804ff Fix unwanted split at :innen + lc letter by Marc Kupietz · 9 weeks ago
- a2db4c1 Fixed thousands separators not being handled consistently by Marc Kupietz · 9 weeks ago
- 4d59ee4 Fix emoticon matching before letters (e.g., Wikipedia:Diskussionen) by Marc Kupietz · 9 weeks ago
- 658e605 Add ver.di (Germn trade union) to abbreviations by Marc Kupietz · 9 weeks ago
- 5b8a95e Add de_old tokenizer variant without gender-sensitive rules by Marc Kupietz · 10 weeks ago
- 2173013 Add lookahead to noun gender endings to prevent false matches by Marc Kupietz · 10 weeks ago
- 9ef5dec Support German gender-sensitive DET, ADJ, PRON endings by Marc Kupietz · 10 weeks ago
- fc7c04a Add diff reporting to distanceToGoldStandard with -Dreport.diff=true by Marc Kupietz · 10 weeks ago
- a553bee Support German gender-sensitive noun endings with punctuation and braces by Marc Kupietz · 2 months ago
- c831089 Don't treat soft hyphens (U+00AD) as token boundaries by Marc Kupietz · 3 months ago
- be5de89 Add hyphenated compound abbreviations for German by Marc Kupietz · 4 months ago
- bf9f4de Add Wikipedia emoji template support by Marc Kupietz · 4 months ago
- 748fcb4 Add support for emoji clusters by Marc Kupietz · 4 months ago
- 88b15ed Fix Genderstern and ommission word token breaks after hyphens by Marc Kupietz · 4 months ago
- 0235ea0 Add build variable force.fast to speed up debug builds by Marc Kupietz · 4 months ago
- 439731e Replace deprecated newInstance invocation by Marc Kupietz · 2 years, 7 months ago
- 609ab47 Imports java.io's ByteArrayOutputStream instead of 3rd-party class by Gregor Middell · 3 years, 11 months ago
- 6e67723 Omission words cannot start with white space by Marc Kupietz · 4 years, 3 months ago
- 1501f5a Extend test suite by Akron · 4 years, 5 months ago
- 7cbc205 Remove 'du' from abbreviation list by Akron · 4 years, 6 months ago
- 5b8f674 Merge "Simplified FNAME rule" by Marc Kupietz · 4 years, 7 months ago
- 210fc24 Remove dir/Dir from German abbreviations by Akron · 4 years, 8 months ago
- b7084ce Simplified FNAME rule by Akron · 4 years, 8 months ago
- ab9187d Improve test suite and lower acceptance values by Akron · 4 years, 9 months ago
- 6d28ed1 Separate apostrophe marked contractions and clitics for en and fr by Marc Kupietz · 4 years, 9 months ago
- 96bd87c Improve systematicity of options -p, -s, --[no-]tokens by Marc Kupietz · 5 years ago
- cf9b5f5 Add heuristcis for distinguishing I. as abbrevation vs PPER / CARD by Marc Kupietz · 6 years ago
- e3282b0 Accept URLs starting with "www." without URI scheme by Marc Kupietz · 6 years ago
- 4fb896a Amend English abbreviation macro by Marc Kupietz · 6 years ago
- f5a7e04 Add French tokenizer (-l fr) by Marc Kupietz · 6 years ago
- 74141b3 Add -l command line option to choose language by Marc Kupietz · 6 years ago
- ce48102 Recognize {LETTER}+str. as abbreviation for Straße in de-tokenizer by Marc Kupietz · 6 years ago
- 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 6 years ago
- 8e197f3 Allow setting input encoding explicitely whith -e <encoding> by Marc Kupietz · 6 years ago
- 751868b Make tokenizer implementation exchangeable by Marc Kupietz · 6 years ago
- b9f45e0 Rename tokenizer class to KorAPDFATokenizer by Marc Kupietz · 6 years ago
- c419d5b Add new command line options using picocli and sanitize code by Marc Kupietz · 6 years ago
- 783e2a2 Ignore quoted email names like "John Doe"@xx.com by Marc Kupietz · 6 years ago
- 571c194 Empty text (<EOT><EOT>) -> empty output line by Marc Kupietz · 6 years ago
- 793f85d Add first tests for IPC invocation scenario by Marc Kupietz · 6 years ago
- b2666fc Implement sentence splitter by Marc Kupietz · 6 years ago
- 07d9714 Move tests to proper location by Marc Kupietz · 6 years ago
- 478632e Clean up code by Marc Kupietz · 6 years ago
- 3367773 Initial import from private/Ingestion by Marc Kupietz · 6 years ago