blob: 6b6d671d3e84c4086a25bc2d19876650cc333258 [file] [log] [blame]
Marc Kupietzb6fd6bc2025-04-16 12:47:26 +020012.6.1 2025-04-16
2 - Fix ASCII entity resolution.
Marc Kupietzd254f5c2025-04-16 10:37:08 +02003 - Make KorAP-Tokenizer heap size configurable via environment
4 variable KORAPXMLTEI_TOKENIZER_HEAP_SIZE.
5
Marc Kupietz5b3f1d82024-07-05 17:50:55 +020062.6.0 2024-11-11
Akron132bdeb2024-06-06 14:28:56 +02007 - Add -o parameter.
Akron6b1f26b2024-09-19 11:35:32 +02008 - Add support for inline dependency relations.
Marc Kupietzfc3a0ee2024-07-05 16:58:16 +02009 - Add support for --auto-textsigle.
Marc Kupietz5b3f1d82024-07-05 17:50:55 +020010 - Add support for multiple input files.
Akron132bdeb2024-06-06 14:28:56 +020011
Akron6b1f26b2024-09-19 11:35:32 +0200122.5.0 2024-01-24
Akron568b22f2024-01-23 10:12:34 +010013 - Upgrade minimal Perl version to 5.36 to improve
14 unicode handling.
15 - Upgrade KorAP-Tokenizer to v2.2.5 and Java to 17 to
16 improve unicode handling.
17
Akronec503252023-04-24 18:03:17 +0200182.4.4 2023-04-25
19 - Allow line-breaks in text only lines.
20
Akron72f4a882023-03-02 09:48:14 +0100212.4.3 2023-03-02
22 - Allow closing elements to start with "text".
23
Akron997aa222023-02-10 11:26:28 +0100242.4.2 2023-02-10
25 - Improve checks for numerical annotation bounds.
26
Akronfcff7342023-02-07 14:05:15 +0100272.4.1 2023-02-07
28 - Fix test.
29
Akronfc2a82a2023-02-07 11:29:11 +0100302.4.0 2023-02-07
Marc Kupietza671ae52022-12-22 16:28:14 +010031 - Conversion of standard TEI P5 should now work, at least
32 in some cases.
33 - Option --xmlid-to-textsigle <from-regex>@<to-c/to-d/to-t>
34 added to convert standard P5 text id attributes to I5
35 sigles with three parts.
Akronb93fabb2023-01-13 12:05:44 +010036 - Add --no-tokenizer parameter as a requirement
37 for relying on inline tokens only.
Marc Kupietza671ae52022-12-22 16:28:14 +010038
Akron2520a342022-03-29 18:18:05 +0200392.3.4 2022-11-09
Akron85269c02022-11-07 14:03:31 +010040 - Improve stability of XML entity replacement.
Akron2520a342022-03-29 18:18:05 +020041 - Check version for script and KorAP-Tokenizer
42 library when requested.
Akron85269c02022-11-07 14:03:31 +010043
Akron2520a342022-03-29 18:18:05 +0200442.3.3 2022-03-30
Akronbd4281e2022-03-28 08:31:40 +020045 - Load KorAP-Tokenizer only on request.
46
Akrond708a612022-03-21 16:00:01 +0100472.3.2 2022-03-23
Akron540fd622022-03-21 18:20:05 +010048 - Do not reference metadata.xml
Akrond708a612022-03-21 16:00:01 +010049 - Remove schema references from header files.
Akron4ee372a2022-02-24 17:54:24 +010050 - Improve test suite for unability to use
51 KorAP-Tokenizer.
Akron540fd622022-03-21 18:20:05 +010052
Marc Kupietz0bca4f12022-01-14 13:24:22 +0100532.3.1 2022-01-14 Release
Akrona3799ce2021-10-15 16:27:30 +020054 - Improve script handling of broken data
55 - Improve handling of unknown header types
56 - Check for valid sigles to avoid broken directories
57 - Introduce exclusivity for inline tokens handling.
Akrona2cb2812021-10-30 10:29:08 +020058 - Use single dash for STDIN.
Marc Kupietz0bca4f12022-01-14 13:24:22 +010059 - Update KorAP-Tokenizer to v2.2.2 (single quote, "du." bug fixes)
Akrona3799ce2021-10-15 16:27:30 +020060
612.2.0 2021-08-26 Release
Akrond658df72021-02-18 18:58:56 +010062 - Remove unnecessary branch in recursive call
Akrondd0be8f2021-02-18 19:29:41 +010063 - Support inline-structures parameter
Akron26a71522021-02-19 10:27:37 +010064 - Introduce --base-foundry, --data-file, and --header-file parameters
Akron91705d72021-02-19 10:59:45 +010065 - Introduce --tokens-file parameter
Akron75d63142021-02-23 18:40:56 +010066 - Introduce --skip-inline-tokens parameter
Akrond3e1d282021-02-24 14:51:27 +010067 - Minor cleanups and improvements
Akron54c3ff12021-02-25 11:33:37 +010068 - Introduce --skip-inline-tags parameter
Akroneb12e232021-02-25 13:49:50 +010069 - Introduce KorAP::XML::TEI::Inline class
Akron692d17d2021-03-05 13:21:03 +010070 - Introduce --skip-inline-token-annotations parameter
71 - Deprecate KORAPXMLTEI_INLINE environment variable
72 in favor of --skip-inline-token-annotations
Akrond658df72021-02-18 18:58:56 +010073
Akrona3799ce2021-10-15 16:27:30 +0200741.0.0 2021-02-18 Release
Akrond3e1d282021-02-24 14:51:27 +010075 - -s option added that uses sentence boundaries
76 provided by the KorAP tokenizer (-tk)
Marc Kupietza1421f02021-02-18 15:32:38 +010077 - Tokenizer invocation comments removed from KorAP XML output
78 - Indentation of </span> tags fixed
Akrond3e1d282021-02-24 14:51:27 +010079 - Character entities used in DeReKo are automatically
80 replaced by their corresponding characters
Marc Kupietza1421f02021-02-18 15:32:38 +010081 - Resources defined in Makefile
82 - Fixed possible IO deadlock with KorAP tokenizer
Akron4e3c7e32021-02-18 15:19:53 +010083 - Simplified debugging by combining with X::C::T line numbers
Akron1a5271a2021-02-18 13:18:15 +010084 - Support inline-tokens parameter
Akronf8088e62021-02-18 16:18:59 +010085 - Move verbose code documentation to trailing
86 script section
Marc Kupietzeed4cb12021-02-17 19:39:32 +010087
Akronf7084c42021-01-07 10:25:22 +0100880.03 2021-01-12
Marc Kupietzb505d442021-01-06 16:40:29 +010089 - Update KorAP-Tokenizer to released 2.0 version
Akronf7084c42021-01-07 10:25:22 +010090 - Improve test suite for recent version
91 of Mojolicious.
92
Marc Kupietz44b1f252020-11-26 16:31:40 +0100930.02 2020-11-27
Akronf7084c42021-01-07 10:25:22 +010094 - Update KorAP-Tokenizer to v2.0.0.
Akroneaa96232020-10-15 17:06:15 +020095 - Switch input encoding based on XML
96 processing instruction.
Marc Kupietz44b1f252020-11-26 16:31:40 +010097 - Fix handling of UTF-8 in sigles.
Akroneaa96232020-10-15 17:06:15 +020098
Akron0c41ab32020-09-29 07:33:33 +0200990.01 2020-09-28
100 - Initial release to GitHub.