1. e87906b Minor improvements by Akron · 3 years ago
  2. fac8abc Reorder longest match operator and update models by Akron · 3 years ago
  3. 65c0f21 Simplify tokenizer whitespace handling by Akron · 3 years ago
  4. c840636 Separate xml rule from main script by Akron · 3 years ago
  5. 7198645 Speed up build by Akron · 3 years ago
  6. 6742b96 Add XML entities by Akron · 3 years ago
  7. 11a05d9 Extend tokenizer fileending by Akron · 3 years, 1 month ago
  8. f1106ec Add single character abbreviations by Akron · 3 years, 1 month ago
  9. 17984c8 Improving time parsing by Akron · 3 years, 1 month ago
  10. 78dba06 Add time format to transducer by Akron · 3 years, 1 month ago
  11. 066d99c Fix XML empty element handling by Akron · 3 years, 1 month ago
  12. f6bdfdb Add trimming at the beginning of a text by Akron · 3 years, 1 month ago
  13. a854faa Introduce EOT (end-of-transmission) marker by Akron · 3 years, 1 month ago
  14. 4c2a1ad Introduce XML tests by Akron · 3 years, 3 months ago
  15. 3de361e Improved newline and abbreviation handling by Akron · 3 years, 3 months ago
  16. 57d0161 Add known terms with special characters by Akron · 3 years, 3 months ago
  17. e8837b5 Add file scheme by Akron · 3 years, 3 months ago
  18. fd92d7e Update abbreviations according to KorAP-Tokenizer by Akron · 3 years, 3 months ago
  19. a0bded5 Add ordinals by Akron · 3 years, 3 months ago
  20. 4af79f1 Added support for streetnames by Akron · 3 years, 3 months ago
  21. 310905f Add foma sources by Akron · 3 years, 3 months ago