Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / cf9b5f5cb448bcccc15d1bd505f4d4423a1ea3b3 / src / main / jpc
  1. cf9b5f5 Add heuristcis for distinguishing I. as abbrevation vs PPER / CARD by Marc Kupietz · 6 years ago
  2. 2199f76 Simplify German abbreviations by Marc Kupietz · 6 years ago
  3. e3282b0 Accept URLs starting with "www." without URI scheme by Marc Kupietz · 6 years ago
  4. 4fb896a Amend English abbreviation macro by Marc Kupietz · 6 years ago
  5. f5a7e04 Add French tokenizer (-l fr) by Marc Kupietz · 6 years ago
  6. 74141b3 Add -l command line option to choose language by Marc Kupietz · 6 years ago
  7. ce48102 Recognize {LETTER}+str. as abbreviation for Straße in de-tokenizer by Marc Kupietz · 6 years ago
  8. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 6 years ago