- 65c0f21 Simplify tokenizer whitespace handling by Akron · 3 years, 1 month ago
- c840636 Separate xml rule from main script by Akron · 3 years, 1 month ago
- 7198645 Speed up build by Akron · 3 years, 1 month ago
- 6742b96 Add XML entities by Akron · 3 years, 1 month ago
- 11a05d9 Extend tokenizer fileending by Akron · 3 years, 1 month ago
- f1106ec Add single character abbreviations by Akron · 3 years, 1 month ago
- 17984c8 Improving time parsing by Akron · 3 years, 1 month ago
- 78dba06 Add time format to transducer by Akron · 3 years, 1 month ago
- 066d99c Fix XML empty element handling by Akron · 3 years, 1 month ago
- f6bdfdb Add trimming at the beginning of a text by Akron · 3 years, 1 month ago
- a854faa Introduce EOT (end-of-transmission) marker by Akron · 3 years, 1 month ago
- 4c2a1ad Introduce XML tests by Akron · 3 years, 3 months ago
- 3de361e Improved newline and abbreviation handling by Akron · 3 years, 3 months ago
- 1e10d00 Remove dir/Dir from abbreviation file by Akron · 3 years, 4 months ago
- 57d0161 Add known terms with special characters by Akron · 3 years, 4 months ago
- e8837b5 Add file scheme by Akron · 3 years, 4 months ago
- fd92d7e Update abbreviations according to KorAP-Tokenizer by Akron · 3 years, 4 months ago
- a0bded5 Add ordinals by Akron · 3 years, 4 months ago
- 4af79f1 Added support for streetnames by Akron · 3 years, 4 months ago
- 310905f Add foma sources by Akron · 3 years, 4 months ago