Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-XML-TEI / 4c6ff5b08659b889aeff9cb7ed77eb968d94cab5 / t / tokenization.t
  1. 4c6ff5b Merge "Bugfix: intern tokenization" by Peter Harders · 4 years, 4 months ago
  2. 57c884e remove temp. files from tests per default by Peter Harders · 4 years, 5 months ago
  3. 71f072b Bugfix: intern tokenization by Peter Harders · 4 years, 5 months ago
  4. 41c3562 changed comments, variable- and function-name(s) by Peter Harders · 4 years, 5 months ago
  5. d962747 Establish tokenizer objects for aggressive and conservative base tokenization by Akron · 4 years, 5 months ago
  6. 510a88c Minor speedup in tokenization by merging array pushes by Akron · 4 years, 5 months ago
  7. eac374d Separate dummy tokenization from main script with minimal changes by Akron · 4 years, 5 months ago