Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / 1501f5ab34b936c4491bcf14b38658c77df47501 / src / main / jpc / jflex
  1. 7cbc205 Remove 'du' from abbreviation list by Akron · 4 years, 7 months ago
  2. 5b8f674 Merge "Simplified FNAME rule" by Marc Kupietz · 4 years, 9 months ago
  3. 210fc24 Remove dir/Dir from German abbreviations by Akron · 4 years, 9 months ago
  4. b7084ce Simplified FNAME rule by Akron · 4 years, 10 months ago
  5. 6d28ed1 Separate apostrophe marked contractions and clitics for en and fr by Marc Kupietz · 4 years, 10 months ago
  6. 96bd87c Improve systematicity of options -p, -s, --[no-]tokens by Marc Kupietz · 5 years ago
  7. cf9b5f5 Add heuristcis for distinguishing I. as abbrevation vs PPER / CARD by Marc Kupietz · 6 years ago
  8. 2199f76 Simplify German abbreviations by Marc Kupietz · 6 years ago
  9. e3282b0 Accept URLs starting with "www." without URI scheme by Marc Kupietz · 6 years ago
  10. 4fb896a Amend English abbreviation macro by Marc Kupietz · 6 years ago
  11. f5a7e04 Add French tokenizer (-l fr) by Marc Kupietz · 6 years ago
  12. 74141b3 Add -l command line option to choose language by Marc Kupietz · 6 years ago
  13. ce48102 Recognize {LETTER}+str. as abbreviation for Straße in de-tokenizer by Marc Kupietz · 6 years ago
  14. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 6 years ago