Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-XML-TEI / 67ee44ec25b749325edc331f6d9992f5ccd549e8 / t / tokenization-external.t
  1. 52dc21b Send <EOT>\n to external tokenizer for separating texts by Marc Kupietz · 6 years ago
  2. 57c884e remove temp. files from tests per default by Peter Harders · 6 years ago
  3. 8b511f9 Establish tokenizer object for external base tokenization by Akron · 6 years ago