KorAP Ingestion

Converts TEI XML files to KorAP XML, annotates them with TreeTagger, Marmot, Malt, Spacy, CoreNLP, OpenNLP, indexes them and starts a KorAP instance.

Usage (TEI I5)

By default, place your .i5.xml files in the I5 directory in the root of the project:

make

Alternatively, you can specify a different source directory containing your .i5.xml files using the SRC_DIR variable:

make SRC_DIR=/path/to/your/files

Then open http://localhost:64543 in your browser.

Standard TEI P5 Support

Standard TEI P5 files (which typically contain one text per file) can be batch-converted together. By default, place your .xml files in the TEI directory in the root of the project:

make

All files in the TEI directory will be packaged into a single KorAP-XML zip archive.

You can specify a different source directory using the TEI_DIR variable:

make TEI_DIR=/path/to/your/tei/files

By default, texts are assigned automatic three-part KorAP/DeReKo sigles starting from:

--auto-textsigle 'TEI/XYZ.00001'

You can customize this or define a mapping from the xml:id of each text to a sigle. For example, if your XML files have IDs like this:

<?xml version="1.0" encoding="UTF-8"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0" xml:id="SK.UL.1981.1" version="3.4.0">
  <teiHeader>

You can extract the three-part sigle (e.g., SK/UL/19811) by overriding the TEI_FLAGS variable with a matching regular expression:

make TEI_FLAGS='--xmlid-to-textsigle '\''([A-Z]+)\.(.*)\.([0-9]+)\.*([0-9])@$$1/$$2/$$3$$4'\'''

Prerequisites

  • Java JRE 21 and
  • GNU Make
  • Docker with compose