| Akron | d8d8895 | 2026-02-04 09:02:09 +0100 | [diff] [blame^] | 1 | 0.3.1 2026-02-03 |
| 2 | - Introduce hyphenated abbreviations in german tokenizer. | ||||
| 3 | |||||
| Akron | f66dc14 | 2023-09-06 20:00:47 +0200 | [diff] [blame] | 4 | 0.2.2 2023-09-06 |
| 5 | - Fix behaviour for end of text character positions | ||||
| 6 | when no end of sentence occured before. | ||||
| 7 | |||||
| Akron | 8e80393 | 2023-04-18 10:19:19 +0200 | [diff] [blame] | 8 | 0.2.1 2023-09-05 |
| Akron | cae3911 | 2023-04-26 19:43:16 +0200 | [diff] [blame] | 9 | - Add english tokenizer. |
| 10 | - Fix buffer bug. | ||||
| Akron | 5d68ae4 | 2023-09-05 12:14:53 +0200 | [diff] [blame] | 11 | - Improve Readme. |
| Akron | 8e80393 | 2023-04-18 10:19:19 +0200 | [diff] [blame] | 12 | - Minor performance improvements. |
| Akron | cae3911 | 2023-04-26 19:43:16 +0200 | [diff] [blame] | 13 | |
| Akron | 96c6548 | 2023-02-28 09:08:48 +0100 | [diff] [blame] | 14 | 0.1.7 2023-02-28 |
| Akron | 0597b27 | 2023-02-23 15:04:11 +0100 | [diff] [blame] | 15 | - Add dependabot checks. |
| Akron | 96c6548 | 2023-02-28 09:08:48 +0100 | [diff] [blame] | 16 | - Add update command. |
| Akron | 0597b27 | 2023-02-23 15:04:11 +0100 | [diff] [blame] | 17 | |
| Akron | b15acb9 | 2022-04-16 11:01:46 +0200 | [diff] [blame] | 18 | 0.1.6 2022-04-14 |
| 19 | - Rename TOKEN_SYMBOL to TOKEN_BOUND. | ||||
| 20 | |||||
| Akron | b98e4cf | 2022-03-27 23:56:49 +0200 | [diff] [blame] | 21 | 0.1.5 2022-03-28 |
| 22 | - Improve Emoticon-List. | ||||
| 23 | |||||
| Akron | b428755 | 2022-03-27 14:11:24 +0200 | [diff] [blame] | 24 | 0.1.4 2022-03-27 |
| Akron | 4222ac8 | 2022-03-11 01:06:21 +0100 | [diff] [blame] | 25 | - Improved handling of ellipsis. |
| Akron | b428755 | 2022-03-27 14:11:24 +0200 | [diff] [blame] | 26 | - Make algorithm more robust to nevere fail. |
| 27 | - Remove match option. | ||||
| Akron | 4222ac8 | 2022-03-11 01:06:21 +0100 | [diff] [blame] | 28 | |
| Akron | e96895f | 2022-03-08 19:58:37 +0100 | [diff] [blame] | 29 | 0.1.3 2022-03-08 |
| 30 | - Introduced refined handling of sentences including speech. | ||||
| 31 | |||||
| Akron | 936c0f5 | 2021-12-07 11:30:53 +0100 | [diff] [blame] | 32 | 0.1.2 2021-12-07 |
| Akron | 4880fb6 | 2021-12-05 12:03:05 +0100 | [diff] [blame] | 33 | - Improve performance of rune to symbol conversion in transduction |
| 34 | method. | ||||
| Akron | 936c0f5 | 2021-12-07 11:30:53 +0100 | [diff] [blame] | 35 | - Support Plusampersand word list in compounds. |