Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-XML-Krill / 303c4fd3fe54df1abbaf4563c023acf271d9c91c / t / real / tokenization.t
  1. 414ec95 Restructure test suite to prepare CPAN release by Akron · 4 years, 5 months ago[Renamed (93%) from t/tokenization.t]
  2. dec4312 Fixed gap behind last token and <base/s:t> length by Akron · 4 years, 10 months ago
  3. 6bf3cc9 Added links for wikipedia resources by Akron · 6 years ago
  4. 263274c Support koral versioning by Akron · 6 years ago
  5. c526e75 Include field serialization in versioned json output by Akron · 6 years ago
  6. ed9baf0 Support non-word-tokens (fixes #5) by Akron · 6 years ago