blob: 53421c275d072d629d5568e87b0e7c0b350c6c94 [file] [log] [blame]
- -s option added that uses sentence boundaries provided by the KorAP tokenizer (-tk)
- tokenizer invocation comments removed from KorAP XML output
- indentation of </span> tags fixed
- character entities used in DeReKo are automatically replaced by their corresponding characters
- resources defined in Makefile
- fixed possible IO deadlock with KorAP tokenizer
- Simplified debugging by combining with X::C::T line numbers
- Support inline-tokens parameter
0.03 2021-01-12
- Update KorAP-Tokenizer to released 2.0 version
- Improve test suite for recent version
of Mojolicious.
0.02 2020-11-27
- Update KorAP-Tokenizer to v2.0.0.
- Switch input encoding based on XML
processing instruction.
- Fix handling of UTF-8 in sigles.
0.01 2020-09-28
- Initial release to GitHub.