tree 74636340364a7c7a21481a3c146347e194b548e0
parent 2cf94fd05270269460305405b3a58e6717d7c4d2
author Marc Kupietz <kupietz@ids-mannheim.de> 1784713928 +0200
committer Marc Kupietz <kupietz@ids-mannheim.de> 1784713928 +0200

Upgrade wiki-taxonomy to 1.1.1 and pass required --model-type

Version 1.1.1 requires a --model-type argument (distilbert or
embeddings). The embeddings model only pays off with fp16 acceleration,
so select it based on the tool's own tensor-core GPU whitelist
(FP16_FAST_GPUS in now_to_tei.py) matched against the first GPU's name;
unknown GPUs and CPU-only hosts fall back to distilbert. Both the
whitelist and the resulting model type are overridable via
WIKI_TAXONOMY_FP16_GPUS and WIKI_TAXONOMY_MODEL_TYPE.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Change-Id: I02db3fff9d7b8f862deb521a79de9ccaabc911d0