Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / Datok / 34dbe97f7f12eeebd67a9bba756c1f4e21bcfd33 / testdata / tokenizer.fst
  1. 235ea12 Update generated tokenizers by Akron · 3 years, 3 months ago
  2. e184a91 Add new generated automata by Akron · 3 years, 3 months ago
  3. 03c92fe Support for tokenend MCS symbol by Akron · 3 years, 4 months ago
  4. b4bbb47 Added sentence splitter capabilities by Akron · 3 years, 4 months ago
  5. c9d84a6 Sort alphabet prior to xCheck by Akron · 3 years, 4 months ago