1. fac8abc Reorder longest match operator and update models by Akron · 3 years, 1 month ago
  2. 65c0f21 Simplify tokenizer whitespace handling by Akron · 3 years, 1 month ago
  3. c840636 Separate xml rule from main script by Akron · 3 years, 1 month ago
  4. 7198645 Speed up build by Akron · 3 years, 1 month ago
  5. 6742b96 Add XML entities by Akron · 3 years, 1 month ago
  6. 11a05d9 Extend tokenizer fileending by Akron · 3 years, 1 month ago
  7. f1106ec Add single character abbreviations by Akron · 3 years, 1 month ago
  8. 17984c8 Improving time parsing by Akron · 3 years, 1 month ago
  9. 78dba06 Add time format to transducer by Akron · 3 years, 1 month ago
  10. 066d99c Fix XML empty element handling by Akron · 3 years, 1 month ago
  11. f6bdfdb Add trimming at the beginning of a text by Akron · 3 years, 1 month ago
  12. a854faa Introduce EOT (end-of-transmission) marker by Akron · 3 years, 1 month ago
  13. 4c2a1ad Introduce XML tests by Akron · 3 years, 3 months ago
  14. 3de361e Improved newline and abbreviation handling by Akron · 3 years, 4 months ago
  15. 57d0161 Add known terms with special characters by Akron · 3 years, 4 months ago
  16. e8837b5 Add file scheme by Akron · 3 years, 4 months ago
  17. fd92d7e Update abbreviations according to KorAP-Tokenizer by Akron · 3 years, 4 months ago
  18. a0bded5 Add ordinals by Akron · 3 years, 4 months ago
  19. 4af79f1 Added support for streetnames by Akron · 3 years, 4 months ago
  20. 310905f Add foma sources by Akron · 3 years, 4 months ago