Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-Tokenizer / cf9b5f5cb448bcccc15d1bd505f4d4423a1ea3b3 / src / main / jpc / jflex / de / ids_mannheim / korap / tokenizer / DerekoDfaTokenizer.jflex
  1. cf9b5f5 Add heuristcis for distinguishing I. as abbrevation vs PPER / CARD by Marc Kupietz · 6 years ago
  2. e3282b0 Accept URLs starting with "www." without URI scheme by Marc Kupietz · 6 years ago
  3. 74141b3 Add -l command line option to choose language by Marc Kupietz · 6 years ago
  4. 67eed1c Build language specific tokenizers: de, en by Marc Kupietz · 6 years ago