blob: 64f5b5b3299034b2dbfdb86bf914c3c8bf6ff8f9 [file] [log] [blame]
Marc Kupietz6dc97b72024-01-24 13:01:33 +010010.6.2 2024-01-24
2 - Bump minimal perl version to 5.36 to improve unicode handling.
3 - korapxml2conllu
4 - Use implicit default utf8 encoding instead of explicit de/encodes. Speeds up processing by 10%.
5
Akrone24c9332023-03-22 10:59:33 +010060.6.1 2023-03-22
7 - conllu2korapxml:
8 - Fix append for filehandle output.
9
Marc Kupietz66bb4952023-01-13 15:04:38 +0100100.6.0 2023-01-13
Marc Kupietz7e4cd6c2022-12-15 18:34:37 +010011 - korapxml2conllu:
Marc Kupietz534df182022-12-16 15:00:30 +010012 - the sigle-pattern option now affects the entire sigle
Marc Kupietz7e4cd6c2022-12-15 18:34:37 +010013 - handle docid attributes correctly if they are in a different line than their parent element <layer>
Akronf2b0bba2022-12-16 18:00:08 +010014 - Improve identification of offset errors
Marc Kupietz7e4cd6c2022-12-15 18:34:37 +010015
Marc Kupietz12f64e42022-09-29 08:58:16 +0200160.5.0 2022-09-29
17 - korapxml2conllu:
18 - --word2vec|lm-training-data option added to print word2vec input format
19 - --extract-metadata-regex added to extract some metadata values as context input for language model training
20 - by default sentence boundary information is now read from structure.xml files (use --s-bounds-from-morpho otherwise)
21 - use morpho.xml if present when run on base zips
22 - new option -c <columns>
23 - conllu2korapxml:
24 - ignore _-lemmas
25 - handle UDPipe comments
26 - ignore non-interpretable comments
27 - improve error handling for missing text ids and offsets
Marc Kupietzf1fdc192021-10-08 13:29:59 +020028
Marc Kupietza7d90c62021-07-31 23:48:13 +0200290.4.1 2021-07-31
30 - korapxml2conllu: fix patterns not extracted for last texts in archive
31
Marc Kupietz6beca9d2021-07-29 18:26:09 +0200320.4 2021-07-29
Marc Kupietzeb7d06a2021-03-19 16:29:16 +010033 - korapxml2conllu option -e <regex> added to extract element/attributes to comments
Marc Kupietz0ab8a2c2021-03-19 16:21:00 +010034
Marc Kupietz22858f82021-02-15 14:22:05 +0100350.3 2021-02-15
Marc Kupietz79ba1e52021-02-12 17:26:54 +010036 - Provide conllu2korapxml to convert from ConLL-U to KorAP-XML zip
37
Marc Kupietzb96c3862021-02-12 08:33:44 +0100380.2 2021-02-12
Marc Kupietzd8455832021-02-11 17:30:29 +010039 - Convert also KorAP-XML base zips
40
Marc Kupietz396b4d62021-02-12 08:29:35 +0100410.1 2020-09-23
42 - Initial release to GitHub.