- cae3911 Fix buffer bug in token writer by Akron · 1 year, 7 months ago
- df27581 Make tokenizer robust and never failing by Akron · 2 years, 8 months ago
- 00cecd1 Initialize identity for sigma < 256 by Akron · 3 years ago
- 4880fb6 Improve rune2symbol conversion by Akron · 3 years ago
- 22c565a Fix out of range bug by reverting buffer rewind improvement by Akron · 3 years ago v0.1.1
- 90aa45b Minor code simplifications by Akron · 3 years ago
- 274600e Fix buffer flushing to work with tei2korapxml by Akron · 3 years, 1 month ago
- 9c3bf7f Change fmt to log for easier writing to STDOUT by Akron · 3 years, 1 month ago
- 04335c6 Update tests by Akron · 3 years, 1 month ago
- 96fdc9b Fix TokenWriter regarding sentence boundaries and remove simple TokenWriter by Akron · 3 years, 1 month ago
- 8cc2dd9 Fix buffer rewind at end of transmission by Akron · 3 years, 1 month ago
- 4f6b28c Support token offsets in token writer by Akron · 3 years, 1 month ago
- 32416ce Support offsets in token writer by Akron · 3 years, 1 month ago
- 98fbfef Improve offset handling in buffers by Akron · 3 years, 1 month ago
- f6bdfdb Add trimming at the beginning of a text by Akron · 3 years, 1 month ago
- a854faa Introduce EOT (end-of-transmission) marker by Akron · 3 years, 1 month ago
- e396a93 Introduce token_writer object by Akron · 3 years, 1 month ago
- 34eb74c Cleanup by Akron · 3 years, 2 months ago
- 28031b7 Introduce matrix serialization and deserialization by Akron · 3 years, 2 months ago
- 941f215 Support both matrix and da in the command by Akron · 3 years, 2 months ago
- 16c312e Serialize and deserialize matrix representation by Akron · 3 years, 2 months ago
- 5c82a92 Add sentence end detection to matrix by Akron · 3 years, 2 months ago
- 1c34ce6 Introduce alternative matrix representation by Akron · 3 years, 2 months ago