)]}'
{
  "commit": "1d400f6a1c37ae095eb9ed3613236c766f191c93",
  "tree": "4c104f08038e061e3ff876691b6ca536be6d50b2",
  "parents": [
    "b6416be4b6192a6f498acca1e4fc3b05127c7dd6"
  ],
  "author": {
    "name": "Marc Kupietz",
    "email": "kupietz@ids-mannheim.de",
    "time": "Thu Sep 03 14:46:16 2026 +0200"
  },
  "committer": {
    "name": "Marc Kupietz",
    "email": "kupietz@ids-mannheim.de",
    "time": "Thu Sep 03 14:46:16 2026 +0200"
  },
  "message": "CA: drop collocates occurring less often than expected by default\n\ncollocationAnalysis() ranks and thresholds by logDice, which expresses\nhow salient a pair is rather than how surprising it is. A frequent word\ncan therefore appear among the top collocates although the node does not\nattract it at all: among the collocates of Grund in a 5+5 window,\n\"Berlin\" reaches a logDice of 3.84, close to \"triftiger\" at 3.96, while\nco-occurring 1.74 bits less often than expected.\n\nFiltering these out was documented as a recipe, dplyr::filter(O \u003e E),\nbut a default that quietly rewards frequent, unattracted collocates is a\ntrap for exactly those users who do not know the measure well enough to\napply the recipe. The new minObservedExpectedRatio parameter therefore\ndefaults to 1, keeping only collocates that occur at least as often as\nexpected, which corresponds to a non-negative pmi. It can be raised to\ndemand a stronger contrast, or set to 0 for the unfiltered result of\nearlier versions, e.g. in order to study repulsion.\n\nThe filter is applied wherever minOccur is, so it also governs which\ncollocates are recursed into, and it is passed on to the per virtual\ncorpus analyses. Rows without an expected frequency are kept rather than\nsilently dropped. collocationScoreQuery() is deliberately left alone:\nthere the pairs to score are given explicitly, so filtering them would\nthrow away the answer that was asked for.\n\nBeing collected from the call frame rather than from a list, the cacheAs\nparameter check picked the new parameter up by itself, so a cache file\nwritten with a different ratio is recomputed.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: I98328a8766847b4c95363211a939403b1912e9b7\n",
  "tree_diff": [
    {
      "type": "modify",
      "old_id": "7cccf7bf2702f9027040b5c87b48f1e1a8dc813e",
      "old_mode": 33188,
      "old_path": "NEWS.md",
      "new_id": "e1c4df8d0f3882dd5e6a41653e5b3fec0e9be468",
      "new_mode": 33188,
      "new_path": "NEWS.md"
    },
    {
      "type": "modify",
      "old_id": "7807c080b245649993abd7f53b95d545805fb4fc",
      "old_mode": 33188,
      "old_path": "R/association-scores.R",
      "new_id": "7c5b081a5ee56e3490bf24ec8b3351963e1173ef",
      "new_mode": 33188,
      "new_path": "R/association-scores.R"
    },
    {
      "type": "modify",
      "old_id": "34dc550de667033ea99b50147ffc19edd7aeca3c",
      "old_mode": 33188,
      "old_path": "R/collocationAnalysis.R",
      "new_id": "c9b8695b6d5f75c245d3a4a03c18dee7b831ec01",
      "new_mode": 33188,
      "new_path": "R/collocationAnalysis.R"
    },
    {
      "type": "modify",
      "old_id": "d7d2e9717c8970f736535cbc801187feceb0be01",
      "old_mode": 33188,
      "old_path": "Readme.md",
      "new_id": "166cb6c24137ac70191f29e667566c7cea562e6f",
      "new_mode": 33188,
      "new_path": "Readme.md"
    },
    {
      "type": "modify",
      "old_id": "ce83ef9886073d97536ee9d61256239083550ae8",
      "old_mode": 33188,
      "old_path": "man/association-score-functions.Rd",
      "new_id": "6e1afce57985e71068fa50db6312b3054b116040",
      "new_mode": 33188,
      "new_path": "man/association-score-functions.Rd"
    },
    {
      "type": "modify",
      "old_id": "5a0a43d780a1b55c2835bfdc2c859a2909be9c00",
      "old_mode": 33188,
      "old_path": "man/collocationAnalysis-KorAPConnection-method.Rd",
      "new_id": "ac7e7d9f511ad8c2dd40c16972eb8649e2e00d8a",
      "new_mode": 33188,
      "new_path": "man/collocationAnalysis-KorAPConnection-method.Rd"
    },
    {
      "type": "modify",
      "old_id": "3df08c7cfed38291936f9f0b74166e0f9df3344c",
      "old_mode": 33188,
      "old_path": "tests/testthat/test-association-score-functions.R",
      "new_id": "64f712f7b769be10bbdcabc8d269e0f27144c729",
      "new_mode": 33188,
      "new_path": "tests/testthat/test-association-score-functions.R"
    }
  ]
}