blob: 2adee643c80df783ffc3f5540ff194ec9aea638e [file] [log] [blame]
Akronb9c33812020-10-21 16:19:35 +020010.42 2020-11-03
2 - Replaced Log4perl with Log::Any.
3
40.41 2020-08-10
Akron07e24772020-04-23 14:00:54 +02005 - Added support for RWK annotations.
Akron1cdbc9d2020-05-07 15:28:54 +02006 - Improved DGD support.
Akrone3e05362020-06-16 17:19:09 +02007 - Fixed bug in RWK support that broke on
8 some KorAP-XML files.
Akron414ec952020-08-03 15:48:43 +02009 - Separate "real data" test suite from artificial
10 tests to prepare for CPAN release.
Akron39df7ce2020-08-04 15:55:26 +020011 - Optimizations and cleanup based on profiling.
Akron129e4412020-08-05 15:30:12 +020012 - Remove MultiTerm->add() in favor of
13 MultiTerm->add_by_term().
Akron47426f02020-08-06 13:28:53 +020014 - Optimization by reducing calls to _offset().
Akron6a4cb162020-08-06 16:00:33 +020015 - Introduced add_span() method to MultiTermToken.
Akron11daf962020-08-07 16:29:22 +020016 - Removed deprecated 'primary' flag.
Akron6aed0562020-08-07 16:46:00 +020017 - Removed deprecated 'pretty' flag.
Akron56deacb2020-08-10 10:03:55 +020018 - Fix RWK paragraph handling.
Akrond2cd8e42020-10-30 16:37:19 +010019 - Updated 'Clone' dependency in Makefile.
Akron0b04b312020-10-30 17:39:18 +010020 - Make Sys::Info optional.
Akrondcbee642020-10-30 18:01:43 +010021 - Fixes a bug in XIP::Dependency and added
22 dependency checks for all annotation libraries.
Akron07e24772020-04-23 14:00:54 +020023
Akrondec43122020-03-03 11:22:25 +0100240.40 2020-03-03
Akrona0d5af32020-03-01 12:46:30 +010025 - Fixed XIP parser.
Akronb62d92a2020-03-01 16:32:00 +010026 - Added example corpus of the
27 Redewiedergabe-Korpus.
28 - Fixed span offset bug.
29 - Fixed milestones behind the last
30 token bug.
Akrondec43122020-03-03 11:22:25 +010031 - Fixed gap behind last token bug.
32 - Fixed <base/s:t> length.
Akrona0d5af32020-03-01 12:46:30 +010033
Akron6e886f72020-02-19 07:42:32 +0100340.39 2020-02-19
Akron7d5e6382019-08-08 16:36:27 +020035 - Added Talismane support.
Akron0d68a4b2019-11-13 15:42:11 +010036 - Added "distributor" field to I5 metadata.
Akron20294552019-11-29 16:15:35 +010037 - Added DGD link field to I5 metadata.
Akronb05b8422019-12-11 13:47:57 +010038 - Improve logging.
Akronc29b8e12019-12-16 14:28:09 +010039 - Added support for DGD pseudo-sentences
40 based on anchor milestones.
Akron8f69d632020-01-15 16:58:11 +010041 - Added brief explanation of the format.
Akrond4c5c102020-02-11 11:47:59 +010042 - Fixed parsing of editionStmt.
43 - Added documentation for supported I5 metadata
44 fields.
Akron6e886f72020-02-19 07:42:32 +010045 - Added integrated benchmark mechanism.
Akron7d5e6382019-08-08 16:36:27 +020046
Akron57510c12019-01-04 14:58:53 +0100470.38 2019-05-22
Akron9b04f602019-03-08 18:45:35 +010048 - Stop file processing when base tokenization
49 is wrong.
Akron57510c12019-01-04 14:58:53 +010050 - Added DGD support.
Akron9b04f602019-03-08 18:45:35 +010051
Akroneaffe932019-03-07 17:14:42 +0100520.37 2019-03-06
Akron263274c2019-02-07 09:48:30 +010053 - Support for 'koral:field' array.
54 - Support for Koral versioning.
Akron4e1712c2019-02-04 22:29:37 +010055 - Added tests for english sources.
Akron6bf3cc92019-02-07 12:11:20 +010056 - Added support for external links for
57 Wikipedia resources.
Akron63d03ee2019-02-13 18:49:38 +010058 - Ignore temporary extraction
59 on directory archiving.
Akron955b75b2019-02-21 14:28:41 +010060 - Remove extract_text and extract_doc in
61 favor of extract_sigle for archives.
Akron263274c2019-02-07 09:48:30 +010062
Akroned9baf02019-01-22 17:03:25 +0100630.36 2019-01-22
64 - Support for non-word tokens (fixes #5).
65
Akron6eff23b2018-09-24 10:31:20 +0200660.35 2018-09-24
67 - Lift minimum version of Perl to 5.16 as for
68 "fc"-feature.
69
Akrondd1c0f12018-07-19 06:45:28 +0200700.34 2018-07-19
71 - Preliminary support for HNC.
72
Akron28dc17f2018-02-01 15:31:41 +0100730.33 2018-02-01
Akron4c679192018-01-16 17:41:49 +010074 - Added LWC support.
Akron28dc17f2018-02-01 15:31:41 +010075 - Fixed TreeTagger certainties.
Akron4c679192018-01-16 17:41:49 +010076
Akron3c56f502017-10-24 15:37:27 +0200770.32 2017-10-24
Akron9a062ce2017-07-04 19:12:05 +020078 - Fixed tar building process in script.
Akron3c56f502017-10-24 15:37:27 +020079 - Support file extensions in base tokenization parameter.
Akron9a062ce2017-07-04 19:12:05 +020080
Akron0a6cce12017-06-30 23:03:21 +0200810.31 2017-06-30
Akron3abc03e2017-06-29 16:23:35 +020082 - Fixed exit codes in script.
Akron0a6cce12017-06-30 23:03:21 +020083 - Use CORE::fc for case folding.
Akron3abc03e2017-06-29 16:23:35 +020084
Akrond5bb4342017-06-19 11:50:49 +0200850.30 2017-06-19
86 - Fixed permission handling in test suite.
Akronce125b62017-06-19 11:54:36 +020087 - Added preliminary CMC support.
Akrond5bb4342017-06-19 11:50:49 +020088
Akronda3097e2017-04-23 19:53:57 +0200890.29 2017-04-23
90 - support --to-tar flag.
91
Akron9ec88872017-04-12 16:29:06 +0200920.28 2017-04-12
Akron86db52e2017-04-11 20:36:43 +020093 - Improved overwriting behaviour for unzip.
Akron9ec88872017-04-12 16:29:06 +020094 - Introduced --sequential-extraction flag.
Akron86db52e2017-04-11 20:36:43 +020095
Akron63f20d42017-04-10 23:40:29 +0200960.27 2017-04-10
Akron636aa112017-04-07 18:48:56 +020097 - Support configuration files.
Akron81500102017-04-07 20:45:44 +020098 - Support temporary extraction.
Akron63f20d42017-04-10 23:40:29 +020099 - Support serial conversion.
100 - Support input-base.
Akron636aa112017-04-07 18:48:56 +0200101
1020.26 2017-04-06
103 - Support wildcards on input.
104
Akron5809fea2017-03-14 20:02:26 +01001050.25 2017-03-14
Akron7e2eb882017-01-18 17:28:07 +0100106 - Updated to Mojolicious 7.20
107 - Fixed meta treatment in case analytic and monogr
108 are available
Akron4fa37c32017-01-20 14:43:10 +0100109 - Added DRuKoLa support to script
Akron38873012017-02-06 20:27:37 +0100110 - Liberated document and text sigle handling to be
111 compliant with CoRoLa.
Akron41ac10b2017-02-08 22:47:25 +0100112 - Added support for pagebreak annotations.
Akron08d54452017-02-16 23:19:49 +0100113 - Renamed "pages" to "srcPages".
Akron60a8caa2017-02-17 21:51:27 +0100114 - Fixed handling of prefixes for text sigles.
Akron3bd942f2017-02-20 20:09:14 +0100115 - Support for MarMoT.
Akron5809fea2017-03-14 20:02:26 +0100116 - Fix case insensitivity.
Akron55778f02017-03-14 20:47:26 +0100117 - Added preliminary support for diacritic insensitivity.
Akron3ec0a1c2017-01-18 14:41:55 +0100118
Akron3741f8b2016-12-21 19:55:21 +01001190.24 2016-12-21
120 - Added --base-sentences and --base-paragraphs options
121
Akron6f9fef52016-11-03 17:06:40 +01001220.23 2016-11-03
Akron2fd402b2016-10-27 21:26:48 +0200123 - Added wildcard support for document extraction
Akron2812ba22016-10-28 21:55:59 +0200124 - Fixed archive iteration to not duplicate the first archive
125 - Added parallel extraction for document sigles
Akron13d56622016-10-31 14:54:49 +0100126 - Improved return value for existing files
Akron3741f8b2016-12-21 19:55:21 +0100127 - Don't warn on recursion in CoreNLP/Constituency
Akron2fd402b2016-10-27 21:26:48 +0200128
Akron20807582016-10-26 17:11:34 +02001290.22 2016-10-26
130 - Added support for document extraction
Akronb4bbec72016-10-26 20:21:02 +0200131 - Fixed archive naming
Akron20807582016-10-26 17:11:34 +0200132
Akronb4bbec72016-10-26 20:21:02 +02001330.21 2016-10-24
Nils Diewaldb3e9ccd2016-10-24 15:16:52 +0200134 - Improved Windows support
135
Akron4c0cf312016-10-15 16:42:09 +02001360.20 2016-10-15
137 - Fixed treatment of temporary folders in script
138
Akronbdb64652016-08-17 23:30:01 +02001390.19 2016-08-17
Akron92ad95b2016-08-15 23:38:56 +0200140 - Added test for direct I5 support.
141 - Fixed support for Mojolicious 7.
142 - Added script test.
Akron5f51d422016-08-16 16:26:43 +0200143 - Fixed setting multiple annotations in
144 script.
Akrone2b902d2016-08-16 16:50:11 +0200145 - Fixed output of version and help messages.
Akron7d4cdd82016-08-17 21:39:45 +0200146 - Added script test for extraction.
Akron651cb8d2016-08-16 21:44:49 +0200147 - Fixed extraction with multiple archives and prefix
148 negation support.
Akron7d4cdd82016-08-17 21:39:45 +0200149 - Added script test for archives.
Akron1924bbe2016-06-22 16:05:41 +0200150
Akronbdb64652016-08-17 23:30:01 +02001510.18 2016-07-08
152 - Added REI test.
153 - Added multiple archive support to korapxml2krill.
154 - Added support for prefix negation in korapxml2krill.
155 - Added support for Malt#Dependency.
156 - Improved test suite for caching and REI.
157 - Added support for MDParser annotation.
158 - Added batch processing class for documents.
159
Akron1cd5b872016-03-22 00:23:46 +01001600.17 2016-03-22
161 - Rewrite siglen to use slashes as separators.
Akron5f51d422016-08-16 16:26:43 +0200162 - Zip listing optimized. Does no longer work with primary data
163 in text.xml files.
Akron1cd5b872016-03-22 00:23:46 +0100164
Akron11c80302016-03-18 19:44:43 +01001650.16 2016-03-18
166 - Added caching mechanism for
Akron5f51d422016-08-16 16:26:43 +0200167 metadata.
Akron11c80302016-03-18 19:44:43 +0100168
Akron35db6e32016-03-17 22:42:22 +01001690.15 2016-03-17
170 - Modularized metadata handling.
171 - Simplified metadata handling.
Akron5f51d422016-08-16 16:26:43 +0200172 - Added --meta option to script.
173 - Removed deprecated --human option from script.
Akron35db6e32016-03-17 22:42:22 +0100174
Akronc13a1702016-03-15 19:33:14 +01001750.14 2016-03-15
Akron151676d2016-03-14 20:12:14 +0100176 - Renamed ::Index to ::Annotate and ::Field to ::Index.
Akron5f51d422016-08-16 16:26:43 +0200177 - Renamed 'allow' to 'anno' as parameters of the script.
178 - Added readme.
Akron151676d2016-03-14 20:12:14 +0100179
Akron5b254312016-03-10 00:29:56 +01001800.13 2016-03-10
Akron44feb4e2016-03-02 12:45:47 +0100181 - Removed korapxml2krill_dir.
Akron5f51d422016-08-16 16:26:43 +0200182 - Renamed dependency nodes.
183 - Made dependency relations more effective (trimmed down TUIs)
184 ! This is currently very slow !
Akron44feb4e2016-03-02 12:45:47 +0100185
Akrondc898d82016-02-28 23:49:19 +01001860.12 2016-02-28
Akrone10ad322016-02-27 10:54:26 +0100187 - Added extract method to korapxml2krill.
Akron5f51d422016-08-16 16:26:43 +0200188 - Fixed Mate/Dependency.
189 - Fixed skip flag in korapxml2krill.
190 - Ignore spans outside the token range
191 (i.e. character offsets end before tokens have started).
Akrone10ad322016-02-27 10:54:26 +0100192
Akron941c1a62016-02-23 17:41:41 +01001930.11 2016-02-23
Akron44feb4e2016-03-02 12:45:47 +0100194 - Merged korapxml2krill and korapxml2krill_dir.
Akron941c1a62016-02-23 17:41:41 +0100195
Akron96165ad2016-02-15 18:09:41 +01001960.10 2016-02-15
197 - Added EXPERIMENTAL support for parallel jobs.
198
Akronc1babed2016-02-15 11:48:18 +01001990.09 2016-02-15
200 - Fixed temporary directory handling in scripts.
Akron5f51d422016-08-16 16:26:43 +0200201 - Improved skipping for archive handling in scripts.
Akronc1babed2016-02-15 11:48:18 +0100202
Akron150b29e2016-02-14 23:06:48 +01002030.08 2016-02-14
204 - Added support for archive streaming.
Akron5f51d422016-08-16 16:26:43 +0200205 - Improved scripts.
Akron150b29e2016-02-14 23:06:48 +0100206
Akron8c84aa52016-02-13 21:26:54 +01002070.07 2016-02-13
208 - Improved support for Schreibgebrauch meta data
Akron5f51d422016-08-16 16:26:43 +0200209 (IDS flavour).
Akron8c84aa52016-02-13 21:26:54 +0100210
2110.06 2016-02-11
Akron49a47652016-02-12 18:17:19 +0100212 - Improved support for Schreibgebrauch meta data
Akron5f51d422016-08-16 16:26:43 +0200213 (Duden flavour).
Akron49a47652016-02-12 18:17:19 +0100214
Akron93d620e2016-02-05 19:40:05 +01002150.05 2016-02-04
Akrone4c2e412016-01-28 15:10:50 +0100216 - Changed KorAP::Document to KorAP::XML::Krill.
Akron5f51d422016-08-16 16:26:43 +0200217 - Renamed "Schreibgebrauch" to "Sgbr".
218 - Preparation for GitHub release.
Akrone4c2e412016-01-28 15:10:50 +0100219
Akron9c0488f2016-01-28 14:17:15 +01002200.04 2016-01-28
Akron69a4a2f2016-01-17 12:55:50 +0100221 - Added PTI to all payloads.
Akron5f51d422016-08-16 16:26:43 +0200222 - Added support for empty elements.
223 - Added support for element attributes in struct.
224 - Added meta data support for Schreibgebrauch.
225 - Fixed test suite for meta data.
Akron69a4a2f2016-01-17 12:55:50 +0100226
2270.03 2014-11-03
Nils Diewald78674672014-11-03 21:43:12 +0000228 - Added new metadata scheme.
Akron5f51d422016-08-16 16:26:43 +0200229 - Fixed a minor bug in the constituency tree building.
230 - Sorted terms in tokens a priori.
Nils Diewald78674672014-11-03 21:43:12 +0000231
Akron69a4a2f2016-01-17 12:55:50 +01002320.02 2014-07-21
Nils Diewaldf03c6802014-07-21 16:39:44 +0000233 - Sentence annotations for all providing foundries
Akron5f51d422016-08-16 16:26:43 +0200234 - Starting subtokenization
Nils Diewaldf03c6802014-07-21 16:39:44 +0000235
Akron69a4a2f2016-01-17 12:55:50 +01002360.01 2014-04-15
Akron5f51d422016-08-16 16:26:43 +0200237 - [bugfix] for first token annotations
Nils Diewald7b847222014-04-23 11:14:00 +0000238 - Sentences are now available from all foundries that have it
239 - <>:p is now <>:base/para
Akron5f51d422016-08-16 16:26:43 +0200240 - Added <>:base/text