blob: cad6232e9048a600ddbb471968c5cb519ee4e34d [file] [log] [blame]
Akrona2f952f2026-02-04 09:51:51 +010010.3.1 2026-02-04
Akrond8d88952026-02-04 09:02:09 +01002 - Introduce hyphenated abbreviations in german tokenizer.
Akrona2f952f2026-02-04 09:51:51 +01003 - Support Wikipedia templates.
Akrond8d88952026-02-04 09:02:09 +01004
Akronf66dc142023-09-06 20:00:47 +020050.2.2 2023-09-06
6 - Fix behaviour for end of text character positions
7 when no end of sentence occured before.
8
Akron8e803932023-04-18 10:19:19 +020090.2.1 2023-09-05
Akroncae39112023-04-26 19:43:16 +020010 - Add english tokenizer.
11 - Fix buffer bug.
Akron5d68ae42023-09-05 12:14:53 +020012 - Improve Readme.
Akron8e803932023-04-18 10:19:19 +020013 - Minor performance improvements.
Akroncae39112023-04-26 19:43:16 +020014
Akron96c65482023-02-28 09:08:48 +0100150.1.7 2023-02-28
Akron0597b272023-02-23 15:04:11 +010016 - Add dependabot checks.
Akron96c65482023-02-28 09:08:48 +010017 - Add update command.
Akron0597b272023-02-23 15:04:11 +010018
Akronb15acb92022-04-16 11:01:46 +0200190.1.6 2022-04-14
20 - Rename TOKEN_SYMBOL to TOKEN_BOUND.
21
Akronb98e4cf2022-03-27 23:56:49 +0200220.1.5 2022-03-28
23 - Improve Emoticon-List.
24
Akronb4287552022-03-27 14:11:24 +0200250.1.4 2022-03-27
Akron4222ac82022-03-11 01:06:21 +010026 - Improved handling of ellipsis.
Akronb4287552022-03-27 14:11:24 +020027 - Make algorithm more robust to nevere fail.
28 - Remove match option.
Akron4222ac82022-03-11 01:06:21 +010029
Akrone96895f2022-03-08 19:58:37 +0100300.1.3 2022-03-08
31 - Introduced refined handling of sentences including speech.
32
Akron936c0f52021-12-07 11:30:53 +0100330.1.2 2021-12-07
Akron4880fb62021-12-05 12:03:05 +010034 - Improve performance of rune to symbol conversion in transduction
35 method.
Akron936c0f52021-12-07 11:30:53 +010036 - Support Plusampersand word list in compounds.