commit | ed0505f2687936c3a9131a7e903d7f9c8b6b299e | [log] [tgz] |
---|---|---|
author | Marc Kupietz <kupietz@ids-mannheim.de> | Tue Feb 16 16:40:12 2021 +0100 |
committer | Marc Kupietz <kupietz@ids-mannheim.de> | Wed Feb 17 11:57:22 2021 +0100 |
tree | 888531863d0f933c8a17b187e1eb66f0b59eabd9 | |
parent | 985da0cafd247c9d6bb891ae862f9c4ac324820d [diff] [blame] |
Remove tokenizer invokations comments from KorAP XML output Change-Id: I895f11989bc1924e79dc0a35ec4b709ccb05c290
diff --git a/Changes b/Changes index 5bd0267..72adc31 100644 --- a/Changes +++ b/Changes
@@ -1,4 +1,5 @@ - -s option added that uses sentence boundaries provided by the KorAP tokenizer (-tk) + - tokenizer invocation comments removed from KorAP XML output 0.03 2021-01-12 - Update KorAP-Tokenizer to released 2.0 version - Improve test suite for recent version