tree dca5c4a79cff5ed0bdc00dd6cbf046ddb7824f7b
parent ed8cdf032bed29c2bb5ce76356da13c29417ee6f
author Marc Kupietz <kupietz@ids-mannheim.de> 1781171183 +0200
committer Marc Kupietz <kupietz@ids-mannheim.de> 1781171233 +0200

Add USE_INLINE_ANNOTATIONS_AS option

Allows using tokenization, sentence boundaries, and inline annotations
directly from the source XML files instead of running tei2korapxml's
internal tokenizer.

When USE_INLINE_ANNOTATIONS_AS is set to a foundry name (e.g. gingko),
it passes `--no-tokenizer --inline-tokens <foundry-name>` flags to
tei2korapxml instead of the default `-s -tk` flags.

Change-Id: Ife9a07b104d906b1e80fb29a936a5edead07f0ce