Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / deliko
Clone this repo:

Branches

  1. 11abba5 Upgrade export limit to 25,000 by Marc Kupietz · 12 days ago master
  2. 64f17ce Remove Buchpreis anniversary announcement from landing page by Marc Kupietz · 12 days ago
  3. 251a6a3 Use KALAMAR_HINT_FOUNDRIES and KALAMAR_VC_HELPER_FIELDS in xl compose by Marc Kupietz · 12 days ago
  4. 2e9a826 EXPORT_VERSION now .in .env by Marc Kupietz · 12 days ago
  5. 947b8e7 KALAMAR_VERSION now in .env by Marc Kupietz · 12 days ago

EPub to KorAP (via TEI I5) conversion

Testing

Run TEI I5 conversion tests on local test data

make -j $(nproc) test

Build test index

make -j $(nproc) test index

Run local KorAP with test index

INDEX=./target/dnb.index docker compose -p korap4dnb --profile=lite -f korap4dnb-compose.yml up -d

xdg-open http://localhost:4000/?q=Test

Stop local KorAP

docker compose -p korap4dnb down

To generate Annotations

Install prerequisite korap/conllu2treetagger and korap/conllu2spacy docker images if not present:

docker image inspect korap/conllu2treetagger:latest || curl -Ls 'https://gitlab.ids-mannheim.de/KorAP/CoNLL-U-Treetagger/-/jobs/artifacts/master/raw/conllu2treetagger.xz?job=build-docker-image' | docker load

docker image inspect korap/conllu2spacy:latest || curl -Ls https://corpora.ids-mannheim.de/tools/conllu2spacy.tar.xz | docker load

Make annotations fro dnb20:

make -j $(nproc) target/dnb20.marmot-malt.zip target/dnb20.spacy.zip target/dnb20.tree_tagger.zip

Production

Build a new KorAP index

make -j $(( $(nproc) / 2 )) index

By default, as sources directories, all directories in ./DeLiKo@DNB are used. Note that (due to a bug in the Makefile), the nesting depth of the EPUB files must be exactly 2. You can check, what files will be converted, by running ls DeLiKo@DNB/*/*.epub.

The new index will be built as target/dnb.index.

Build new KorAP index, just with prize winners index

make clean && time make -j $(( $(nproc) / 2 )) index SRC_DIR=./Buchpreis

The index will be in target/dnb.index.

Run KorAP with DeLiKo-2025@DNB

and start the docker:

INDEX=./target/dnb.index docker compose -p deliko-2025 --profile=lite -f deliko-xl-compose.yml up -d

Stop KorAP

docker compose -p deliko-2025 down

Restart KorAP

docker compose -p deliko-2025 --profile=lite restart

Open KorAP in browser

xdg-open http://localhost:4000/?q=Test

httpd configuration

ProxyPass / http://localhost:4000
ProxyPassReverse / http://localhost:4000
ProxyPass /plugin/export http://localhost:7777 # export plugin
ProxyPassReverse /plugin/export http://localhost:7777