Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / a1459227d3b167a31d31d5a706f0a90256ede74b / src / main / jpc / jflex
  1. 96bd87c Improve systematicity of options -p, -s, --[no-]tokens by Marc Kupietz · 5 years ago
  2. cf9b5f5 Add heuristcis for distinguishing I. as abbrevation vs PPER / CARD by Marc Kupietz · 6 years ago
  3. 2199f76 Simplify German abbreviations by Marc Kupietz · 6 years ago
  4. e3282b0 Accept URLs starting with "www." without URI scheme by Marc Kupietz · 6 years ago
  5. 4fb896a Amend English abbreviation macro by Marc Kupietz · 6 years ago
  6. f5a7e04 Add French tokenizer (-l fr) by Marc Kupietz · 6 years ago
  7. 74141b3 Add -l command line option to choose language by Marc Kupietz · 6 years ago
  8. ce48102 Recognize {LETTER}+str. as abbreviation for Straße in de-tokenizer by Marc Kupietz · 6 years ago
  9. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 6 years ago