tree 6ae8016583eaa565276b0a912e7ea6c01831e73c
parent 565274ef29a94438e63dffac72ac74c24a534c40
author Marc Kupietz <kupietz@ids-mannheim.de> 1788693449 +0200
committer Marc Kupietz <kupietz@ids-mannheim.de> 1788693449 +0200

Show the predictive score before the sigmoid

max(a) is sigmoid(z), and sigmoid is monotone, so it ranks the collocates
the way the raw score z does - but only in principle. It is read out of
expTable, whose index is (z + MAX_EXP) * (EXP_TABLE_SIZE / MAX_EXP / 2),
integer arithmetic that comes to 83: z is bucketed at 1/83 and everything
from MAX_EXP up lands in one value, 0.99741. Of the 1000 rows for
"König - Mann + Frau" only 264 have a distinct max(a), up to fifteen share
one, and Gemahlin, römisch-deutsche, ungekrönte and Co-Fürsten sit
together on the cap.

z was computed for every candidate at every window position and dropped at
that lookup, which is what the unused max_f and maxmax_f in
getCollocators once tracked. It is carried through now, per position in
collocator.raw and as the maximum over positions in collocator.max_raw,
and shown next to max(a) as max(z).

Nothing else changes: the threshold, the ordering inside a position's list
and the auto focus all still work on the activation. The column renders
three decimals but sorts on the unrounded value.

The info page entry says that the arithmetic covers the paradigmatic and
the predictive syntagmatic analysis, and about the latter that it used to
consider only the first word form and has gained the max(z) column. The
saturation change needs no notice of its own: of ten frequent single words
the highest max(z) is 5.981, so none reaches the cap of 6 and only
expressions get past it.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Change-Id: If26bd78b36e247a4250b63059114470c473fb6c5