blob: aa7fc087f810586b352664e11f7b7f6f87c8c1f0 [file] [log] [blame]
Akron8dabdc12026-06-02 16:36:07 +020010.7.0 2026-06-08
Akronf3efc9e2026-06-03 10:46:37 +02002 - conllu2korapxml:
3 - Add automatic offset computation from 'text' comments
4 (implemented with AI assistance)
Akron8dabdc12026-06-02 16:36:07 +02005 - new option --text-sigle <template> to derive text sigle from newdoc id
6 (implemented with AI assistance)
Akron982dd1e2026-06-03 11:52:48 +02007 - Add --base-text option to generate data.xml with
8 reconstructed plain text from 'text' comment lines
9 (implemented with AI assistance)
Akroncdabed82026-06-03 15:35:39 +020010 - Add --base-tokens option to generate base/tokens.xml
11 (implemented with AI assistance)
Akronf3efc9e2026-06-03 10:46:37 +020012
Akron249fc832024-06-04 16:36:44 +0200130.6.3 2024-06-04
14 - Trim filenames to fix double space after filename metadata
15 - Set permissions of zip contents to 666
16 - Allow different foundries for morpho and dependency annotations
17 - Readme: Drop early stage warning
18 - Drop cherry-pick unfriendly test count prediction
19 - conllu2korapxml:
20 - escape &, <, >
21 - convert upos column to upos features
22
Marc Kupietz6dc97b72024-01-24 13:01:33 +0100230.6.2 2024-01-24
24 - Bump minimal perl version to 5.36 to improve unicode handling.
25 - korapxml2conllu
26 - Use implicit default utf8 encoding instead of explicit de/encodes. Speeds up processing by 10%.
27
Akrone24c9332023-03-22 10:59:33 +0100280.6.1 2023-03-22
29 - conllu2korapxml:
30 - Fix append for filehandle output.
31
Marc Kupietz66bb4952023-01-13 15:04:38 +0100320.6.0 2023-01-13
Marc Kupietz7e4cd6c2022-12-15 18:34:37 +010033 - korapxml2conllu:
Marc Kupietz534df182022-12-16 15:00:30 +010034 - the sigle-pattern option now affects the entire sigle
Marc Kupietz7e4cd6c2022-12-15 18:34:37 +010035 - handle docid attributes correctly if they are in a different line than their parent element <layer>
Akronf2b0bba2022-12-16 18:00:08 +010036 - Improve identification of offset errors
Marc Kupietz7e4cd6c2022-12-15 18:34:37 +010037
Marc Kupietz12f64e42022-09-29 08:58:16 +0200380.5.0 2022-09-29
39 - korapxml2conllu:
40 - --word2vec|lm-training-data option added to print word2vec input format
41 - --extract-metadata-regex added to extract some metadata values as context input for language model training
42 - by default sentence boundary information is now read from structure.xml files (use --s-bounds-from-morpho otherwise)
43 - use morpho.xml if present when run on base zips
44 - new option -c <columns>
45 - conllu2korapxml:
46 - ignore _-lemmas
47 - handle UDPipe comments
48 - ignore non-interpretable comments
49 - improve error handling for missing text ids and offsets
Marc Kupietzf1fdc192021-10-08 13:29:59 +020050
Marc Kupietza7d90c62021-07-31 23:48:13 +0200510.4.1 2021-07-31
52 - korapxml2conllu: fix patterns not extracted for last texts in archive
53
Marc Kupietz6beca9d2021-07-29 18:26:09 +0200540.4 2021-07-29
Marc Kupietzeb7d06a2021-03-19 16:29:16 +010055 - korapxml2conllu option -e <regex> added to extract element/attributes to comments
Marc Kupietz0ab8a2c2021-03-19 16:21:00 +010056
Marc Kupietz22858f82021-02-15 14:22:05 +0100570.3 2021-02-15
Marc Kupietz79ba1e52021-02-12 17:26:54 +010058 - Provide conllu2korapxml to convert from ConLL-U to KorAP-XML zip
59
Marc Kupietzb96c3862021-02-12 08:33:44 +0100600.2 2021-02-12
Marc Kupietzd8455832021-02-11 17:30:29 +010061 - Convert also KorAP-XML base zips
62
Marc Kupietz396b4d62021-02-12 08:29:35 +0100630.1 2020-09-23
64 - Initial release to GitHub.