Bump Krill-Indexer to 0.64.7-beta

Change-Id: If69d5e069a6b30e8b26584e1ed8632798964b0dc
1 file changed
tree: 936703cc8f7e8400a81a886aa545e2b0fbc260a3
  1. bin/
  2. Buchpreis/
  3. data/
  4. html/
  5. lib/
  6. scripts/
  7. test/
  8. xslt/
  9. .gitignore
  10. .gitlab-ci.yml
  11. deliko-xl-compose.yml
  12. kalamar.conf
  13. korap4dnb-compose.yml
  14. krill-korap4dnb.cfg
  15. Makefile
  16. Readme.md
Readme.md

EPub to KorAP (via TEI I5) conversion

Testing

Run TEI I5 conversion tests on local test data

make -j $(nproc) test

Build test index

make -j $(nproc) test index

Run local KorAP with test index

INDEX=./target/dnb.index docker compose -p korap4dnb --profile=lite -f korap4dnb-compose.yml up -d

xdg-open http://localhost:4000/?q=Test

Stop local KorAP

docker compose -p korap4dnb down

To generate Annotations

Install prerequisite korap/conllu2treetagger and korap/conllu2spacy docker images if not present:

docker image inspect korap/conllu2treetagger:latest || curl -Ls 'https://gitlab.ids-mannheim.de/KorAP/CoNLL-U-Treetagger/-/jobs/artifacts/master/raw/conllu2treetagger.xz?job=build-docker-image' | docker load

docker image inspect korap/conllu2spacy:latest || curl -Ls https://corpora.ids-mannheim.de/tools/conllu2spacy.tar.xz | docker load

Make annotations fro dnb20:

make -j $(nproc) target/dnb20.marmot-malt.zip target/dnb20.spacy.zip target/dnb20.tree_tagger.zip

Production

Build a new KorAP index

make -j $(( $(nproc) / 2 )) index

By default, as sources directories, all directories in ./DeLiKo@DNB are used. Note that (due to a bug in the Makefile), the nesting depth of the EPUB files must be exactly 2. You can check, what files will be converted, by running ls DeLiKo@DNB/*/*.epub.

The new index will be built as target/dnb.index.

Build new KorAP index, just with prize winners index

make clean && time make -j $(( $(nproc) / 2 )) index SRC_DIR=./Buchpreis

The index will be in target/dnb.index.

Run KorAP with DeLiKo-2025@DNB

and start the docker:

INDEX=./target/dnb.index docker compose -p deliko-2025 --profile=lite -f deliko-xl-compose.yml up -d

Stop KorAP

docker compose -p deliko-2025 down

Restart KorAP

docker compose -p deliko-2025 --profile=lite restart

Open KorAP in browser

xdg-open http://localhost:4000/?q=Test

httpd configuration

ProxyPass / http://localhost:4000
ProxyPassReverse / http://localhost:4000
ProxyPass /plugin/export http://localhost:7777 # export plugin
ProxyPassReverse /plugin/export http://localhost:7777