Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / Datok / 00cecd143eb74ec7a90e8f18c10f3fb744b67226 / testdata / tokenizer.datok
  1. 4ec8cec Prepare first official release by Akron · 3 years ago v0.1.0
  2. fac8abc Reorder longest match operator and update models by Akron · 3 years ago
  3. 17984c8 Improving time parsing by Akron · 3 years, 1 month ago
  4. a854faa Introduce EOT (end-of-transmission) marker by Akron · 3 years, 1 month ago
  5. 4c2a1ad Introduce XML tests by Akron · 3 years, 3 months ago
  6. 235ea12 Update generated tokenizers by Akron · 3 years, 3 months ago
  7. e184a91 Add new generated automata by Akron · 3 years, 3 months ago
  8. 03c92fe Support for tokenend MCS symbol by Akron · 3 years, 4 months ago
  9. b4bbb47 Added sentence splitter capabilities by Akron · 3 years, 4 months ago
  10. 3a063ef Fix loading routine by Akron · 3 years, 4 months ago