tree 581403242462af815fc44f1b2cb2cc3fe21ebc23
parent cff7522c7bee65defbc3f44efe5d7cd5d90548fc
author Marc Kupietz <kupietz@ids-mannheim.de> 1788598073 +0200
committer Marc Kupietz <kupietz@ids-mannheim.de> 1788945452 +0200

Parse KWIC snippets of any shape in collocation analysis

Affects only servers that do not deliver tokenized matches, where the
analysis falls back to parsing KWIC markup. Against a current KorAP
matches2FreqTable() is used instead.

The reported crash comes from findExample(), not from the regular
expression: after a failed request collectedMatches has no snippet
column, so the example was character(0) and assigning it aborted.

The expression was wrong as well, in three ways: it required the match
to be followed directly by the closing span, which a <span
class="cutted"> breaks, it required a non-empty left context, and it did
not expect a <span class="more"> in the right context. Counts stayed
correct - a guard skipped those snippets - but about 15 in every 100
hits of the query from the report were dropped silently. The two context
spans are now read one by one and stripped of whatever markup they
contain.

Also fixes both frequency table functions for their own default of an
empty stopword list, which used to leave the table without the column
the stopwords are joined on.

Resolves #14

Change-Id: I1cec847480ddb44fbf688042661019b9c5702a24
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>