| Akron | 8dabdc1 | 2026-06-02 16:36:07 +0200 | [diff] [blame] | 1 | 0.7.0 2026-06-08 |
| Akron | f3efc9e | 2026-06-03 10:46:37 +0200 | [diff] [blame] | 2 | - conllu2korapxml: |
| 3 | - Add automatic offset computation from 'text' comments |
| 4 | (implemented with AI assistance) |
| Akron | 8dabdc1 | 2026-06-02 16:36:07 +0200 | [diff] [blame] | 5 | - new option --text-sigle <template> to derive text sigle from newdoc id |
| 6 | (implemented with AI assistance) |
| Akron | 982dd1e | 2026-06-03 11:52:48 +0200 | [diff] [blame] | 7 | - Add --base-text option to generate data.xml with |
| 8 | reconstructed plain text from 'text' comment lines |
| 9 | (implemented with AI assistance) |
| Akron | cdabed8 | 2026-06-03 15:35:39 +0200 | [diff] [blame] | 10 | - Add --base-tokens option to generate base/tokens.xml |
| 11 | (implemented with AI assistance) |
| Akron | db3d0cb | 2026-06-03 15:53:57 +0200 | [diff] [blame] | 12 | - Filter SpaceAfter/SpacesAfter from MISC column |
| 13 | (implemented with AI assistance) |
| Akron | 4f54262 | 2026-06-03 14:20:20 +0200 | [diff] [blame] | 14 | - Add struct.xml generation from sent_id and newpar comments |
| 15 | (implemented with AI assistance) |
| Akron | f3efc9e | 2026-06-03 10:46:37 +0200 | [diff] [blame] | 16 | |
| Akron | 249fc83 | 2024-06-04 16:36:44 +0200 | [diff] [blame] | 17 | 0.6.3 2024-06-04 |
| 18 | - Trim filenames to fix double space after filename metadata |
| 19 | - Set permissions of zip contents to 666 |
| 20 | - Allow different foundries for morpho and dependency annotations |
| 21 | - Readme: Drop early stage warning |
| 22 | - Drop cherry-pick unfriendly test count prediction |
| 23 | - conllu2korapxml: |
| 24 | - escape &, <, > |
| 25 | - convert upos column to upos features |
| 26 | |
| Marc Kupietz | 6dc97b7 | 2024-01-24 13:01:33 +0100 | [diff] [blame] | 27 | 0.6.2 2024-01-24 |
| 28 | - Bump minimal perl version to 5.36 to improve unicode handling. |
| 29 | - korapxml2conllu |
| 30 | - Use implicit default utf8 encoding instead of explicit de/encodes. Speeds up processing by 10%. |
| 31 | |
| Akron | e24c933 | 2023-03-22 10:59:33 +0100 | [diff] [blame] | 32 | 0.6.1 2023-03-22 |
| 33 | - conllu2korapxml: |
| 34 | - Fix append for filehandle output. |
| 35 | |
| Marc Kupietz | 66bb495 | 2023-01-13 15:04:38 +0100 | [diff] [blame] | 36 | 0.6.0 2023-01-13 |
| Marc Kupietz | 7e4cd6c | 2022-12-15 18:34:37 +0100 | [diff] [blame] | 37 | - korapxml2conllu: |
| Marc Kupietz | 534df18 | 2022-12-16 15:00:30 +0100 | [diff] [blame] | 38 | - the sigle-pattern option now affects the entire sigle |
| Marc Kupietz | 7e4cd6c | 2022-12-15 18:34:37 +0100 | [diff] [blame] | 39 | - handle docid attributes correctly if they are in a different line than their parent element <layer> |
| Akron | f2b0bba | 2022-12-16 18:00:08 +0100 | [diff] [blame] | 40 | - Improve identification of offset errors |
| Marc Kupietz | 7e4cd6c | 2022-12-15 18:34:37 +0100 | [diff] [blame] | 41 | |
| Marc Kupietz | 12f64e4 | 2022-09-29 08:58:16 +0200 | [diff] [blame] | 42 | 0.5.0 2022-09-29 |
| 43 | - korapxml2conllu: |
| 44 | - --word2vec|lm-training-data option added to print word2vec input format |
| 45 | - --extract-metadata-regex added to extract some metadata values as context input for language model training |
| 46 | - by default sentence boundary information is now read from structure.xml files (use --s-bounds-from-morpho otherwise) |
| 47 | - use morpho.xml if present when run on base zips |
| 48 | - new option -c <columns> |
| 49 | - conllu2korapxml: |
| 50 | - ignore _-lemmas |
| 51 | - handle UDPipe comments |
| 52 | - ignore non-interpretable comments |
| 53 | - improve error handling for missing text ids and offsets |
| Marc Kupietz | f1fdc19 | 2021-10-08 13:29:59 +0200 | [diff] [blame] | 54 | |
| Marc Kupietz | a7d90c6 | 2021-07-31 23:48:13 +0200 | [diff] [blame] | 55 | 0.4.1 2021-07-31 |
| 56 | - korapxml2conllu: fix patterns not extracted for last texts in archive |
| 57 | |
| Marc Kupietz | 6beca9d | 2021-07-29 18:26:09 +0200 | [diff] [blame] | 58 | 0.4 2021-07-29 |
| Marc Kupietz | eb7d06a | 2021-03-19 16:29:16 +0100 | [diff] [blame] | 59 | - korapxml2conllu option -e <regex> added to extract element/attributes to comments |
| Marc Kupietz | 0ab8a2c | 2021-03-19 16:21:00 +0100 | [diff] [blame] | 60 | |
| Marc Kupietz | 22858f8 | 2021-02-15 14:22:05 +0100 | [diff] [blame] | 61 | 0.3 2021-02-15 |
| Marc Kupietz | 79ba1e5 | 2021-02-12 17:26:54 +0100 | [diff] [blame] | 62 | - Provide conllu2korapxml to convert from ConLL-U to KorAP-XML zip |
| 63 | |
| Marc Kupietz | b96c386 | 2021-02-12 08:33:44 +0100 | [diff] [blame] | 64 | 0.2 2021-02-12 |
| Marc Kupietz | d845583 | 2021-02-11 17:30:29 +0100 | [diff] [blame] | 65 | - Convert also KorAP-XML base zips |
| 66 | |
| Marc Kupietz | 396b4d6 | 2021-02-12 08:29:35 +0100 | [diff] [blame] | 67 | 0.1 2020-09-23 |
| 68 | - Initial release to GitHub. |