)]}' { "log": [ { "commit": "28f05d1e8639b16845d54ec9379fd116d5e66be3", "tree": "22995e21c0aae09003bb5d6caa6e000cc7300597", "parents": [ "e510854f04aac8099102172a39970471d8b369e0" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Sep 04 16:46:24 2026 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Sep 04 19:42:38 2026 +0200" }, "message": "Bump version to 1.8.0\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: Id42214ff37a03ba9a3454cb26edaf5b2b6b9753e\n" }, { "commit": "92f779d03ee09c543434432d222d4267fc286784", "tree": "c3b79029b701d5b71ca0fd271fa0f981142ba13b", "parents": [ "122ba3c50576182bff1bcc27a2e32a3e6d16e0f2" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 09 17:13:40 2026 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 09 17:13:40 2026 +0200" }, "message": "Bump version to 1.7.0\n\nChange-Id: I5e7a655e8af44f893905760b5fbd6fd70c2d48ea\n" }, { "commit": "d885c242e973e29c5604c04c08f07f58c6102cf0", "tree": "45b4c7a42c5d54aa2bcd60ee70d22c0d13ccc30c", "parents": [ "c949b3e8606395d7dc0445ccb67d9b8ab009f9f5" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 15:56:24 2026 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 15:56:24 2026 +0200" }, "message": "Stop when there is no rocksdb, and find its headers where it is\n\nWithout a rocksdb the build did not complain: the shared library was linked\nwith unresolved rocksdb symbols, which a linker permits, and the first thing\nthat linked it failed with a page of undefined references, blaming\ncollocatordb. It stops at the configure step now and says what to do.\n\nThe headers of the rocksdb that was found are used, instead of relying on the\ncompiler to look in the right place, and they are put before the other include\ndirectories. That way -DCMAKE_PREFIX_PATH\u003d\u003cprefix\u003e is enough for a rocksdb that\nwas built by hand, which is what Rocky Linux and RHEL need, as they do not\nnecessarily have a package. The README says how.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: I21f5cb5eb17c15c0fe77536027b112591c546e58\n" }, { "commit": "2f65bcf4181630bd55ddc8123579df3ea0c0afd5", "tree": "51a901b5519cd2bb84d621b9fcf119dd56e8935b", "parents": [ "1d76ed9ffa72aaffb0608b31651d793ea56dd51c" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 14:04:37 2026 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 14:04:37 2026 +0200" }, "message": "Do not lose increments\n\nIndexing threw counts away in two ways, both without a word.\n\nrocksdb was asked to write with low_pri and no_slowdown, which means \"cancel\nthis write when compaction is behind\" and \"do not wait, report it instead\", and\nthe reported status was discarded in both inc() overloads. Measured with 3\nmillion increments against small write buffers: 2,253,066 arrived, 746,934 were\ngone, a quarter of them. The writer no longer deprioritises itself and waits\nwhen it has to, and merge_one() repeats a cancelled write in any case. A\ncancelled write was not applied, so repeating it cannot count twice.\n\nThe second one is the end of a run. The database has no write ahead log, and\nnothing ever closed it, so everything still in a write buffer was lost when the\nindexer ended: of 2 million increments in a process that just exited, none were\nreadable afterwards. close_collocatordb() writes them and closes the database,\nand the destructor does the same.\n\nWhile testing this, two more:\n\n- get_collocators() and get_collocation_scores() finish a collocate when the\n next one starts, so the last one was never returned. Every word was missing\n a collocate, in the API and in the JSON.\n- the array both of them return was allocated with c.size() + sizeof c[0]\n instead of c.size() * sizeof c[0], far too small for more than one entry.\n Callers reading beyond the first entry read whatever was behind it. It is\n terminated with an empty entry now, so that they can tell where it ends.\n\nThe settings are aimed at what indexing does, a long stream of merge operands\nfor the same keys: bigger write buffers, several of them combined before they\nare written, which collapses the operands early, and compaction that is allowed\nto keep up. All of it can be set from the environment, to be able to tune a run\nof several days without recompiling. It also explains why more indexing threads\nstop helping: rocksdb inserts merge operands one writer at a time.\n\nThe test that found all of this is part of the suite now. The expectations of\nthe writing test were corrected, they described the missing collocate.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: I283b073b7f3fd36aa3ce960978e82105b1e44355\n" }, { "commit": "89c7b9f06c5c00819c30a92c9511533882468d80", "tree": "4708f1a863054f175d7b202b69c5a5f5a2513f30", "parents": [ "8fd499eccf7219809657ac32e41614ca48ca2282" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 07:38:44 2026 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 07:38:44 2026 +0200" }, "message": "Look for the shared library suffix of the platform\n\nOnly reached on platforms other than MacOS, which has its own branch, but the\nhard coded .so has no business there either.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: Ie092e28542768d1da90312cc0d9900b2f64fc7d2\n" }, { "commit": "8fd499eccf7219809657ac32e41614ca48ca2282", "tree": "531561a1a7f45c7ab3f657e2e1a3504fd8dd771e", "parents": [ "cd489a98386755106e90f44f2b664a604fb15455" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 07:32:43 2026 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Aug 02 07:32:43 2026 +0200" }, "message": "Use the real library directory for the install rpath\n\nThe rpath of the library was hard coded to \u003cprefix\u003e/lib and the one of the\ntools to \u003cprefix\u003e/lib64, so one of the two was wrong everywhere: the library\ngoes to lib64 on Fedora, Rocky Linux and RHEL, and to lib/\u003ctriplet\u003e on Debian\nand Ubuntu. CMAKE_INSTALL_FULL_LIBDIR is what GNUInstallDirs determined for the\nplatform.\n\nAn installation below /usr/local is in the search path of the loader on none of\nthese by default, so without a correct rpath the installed tools only start\nwith LD_LIBRARY_PATH set.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: I70d944fc512a10d74f267ac3afc88df270320788\n" }, { "commit": "cd489a98386755106e90f44f2b664a604fb15455", "tree": "579bc3ce6dab48d5452fd735ba3c2d21e574b8a4", "parents": [ "65d4479113439e58d8b53d9a1f2cfb14fcdfab81" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 15:33:16 2026 +0900" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 15:33:16 2026 +0900" }, "message": "Document the build against the rocksdb of the distribution\n\nThe README still asked for the rocksdb 5.11 fork, which is not needed anymore,\nand its build recipe did not work: the tests run the collocatordb_query tool,\nwhich is built with the rpath of its install location, so they only pass after\nmake install, and they find the tool and their data only when the build\ndirectory is build/ inside the sources.\n\nAlso documents when a static rocksdb is needed at all - only for linking a\nprogram completely statically, as dereko2vec does, which is worth about 10% on\ncollocator lookups, measured with rocksdb 7.8.3 which ships both variants.\nDebian and Ubuntu ship librocksdb.a, Fedora, Rocky Linux and RHEL do not, so\nthe README says how to build one without shadowing the packaged headers.\n\nThat shadowing is the trap behind the undefined references one gets when a\nhand installed rocksdb sits below /usr/local, so the build compares the version\nof the headers with the version of the library and stops with an explanation\ninstead of leaving that to the linker.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: Ie79c5a33bfd068a8c3915f368db7d0c45e8d20fb\n" }, { "commit": "65d4479113439e58d8b53d9a1f2cfb14fcdfab81", "tree": "0520bdabbd4a30f8018a39b8eb0182c70ad0543b", "parents": [ "023d4591630964633a5547c0f086109948e36927" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 09:46:34 2026 +0900" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 09:46:34 2026 +0900" }, "message": "Support rocksdb 11\n\nrocksdb 11 needs C++20 for its headers and hands the database back from\nDB::Open() and DB::OpenForReadOnly() as a unique_ptr instead of a raw pointer.\nThe newest standard the compiler knows is used now, and the two open calls go\nthrough a macro that adapts to the rocksdb version, so 7, 10 and 11 all build.\n\nVerified with rocksdb 7.8.3 (debian), 10.2.1 (fedora) and 11.0.4 (alpine,\nmusl): no warnings, ctest passes, and reading a database written by rocksdb\n5.11 still gives identical results for 251 word ids.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: If16e6aa2fbe8478f3260e358dce53b2dc5144d9d\n" }, { "commit": "18b230d3fbb5a2ff3350c85d8a9930a585cf5175", "tree": "24beffe0b20e21e1a7423ca80688fa0c9be63fec", "parents": [ "0ca88db4c985be898fd46afc5390c4f1629554f5" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 09:28:23 2026 +0900" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 09:28:23 2026 +0900" }, "message": "Bump version to 1.5.0\n\nSince 1.4.0 was set, get_corpus_size() and get_word_frequency() were added, the\ntwo leaks in the collocator lookup are fixed and the build no longer requires a\nrocksdb 5.11 built from source, but does require C++17. That is more than a\npatch release, so the minor version goes up.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: Ib410c11f8b773d4153c6be4e83bb3367fcf4193b\n" }, { "commit": "57047c3949447b57cba435ed79ecfd62eb793306", "tree": "b9d60d837c55094c5ced1a6213984048423d3f7c", "parents": [ "aa354d8fba290e526c084ff49a8a226aa260f9af" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 09:17:57 2026 +0900" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Jul 31 09:17:57 2026 +0900" }, "message": "Build against the rocksdb of the distribution\n\nThe build was pinned to librocksdb.so.5.11, so every consumer had to build that\none from source. The library itself needs no change for a current rocksdb, only\nC++17, which rocksdb requires since version 7. Verified against rocksdb 10.2.1.\n\nThe library is looked up without a version now. Only shared libraries are\nconsidered, as the static one is picked up separately as ROCKSDB_STATIC, and\ndistributions that package rocksdb usually ship no static library at all - the\nstatic collocatordb is linked against the shared rocksdb in that case.\n\nNote that the headers have to belong to the library that is found. A leftover\nrocksdb below /usr/local shadows the one of the distribution, because\n/usr/local/include comes first in the include path.\n\nExisting databases stay readable: reading a database written by rocksdb 5.11\nwith 10.2.1 returns identical results for 251 word ids and for collocation\nscore pairs, and the test suite passes.\n\nCo-Authored-By: Claude Opus 5 \u003cnoreply@anthropic.com\u003e\nChange-Id: I03c672d069be0aabeb16d8d1414986a78caae79f\n" }, { "commit": "fa73154586cd642ee019afd58e8a8eb67f9a444a", "tree": "d0eaa5097ab3539505a4effdd89a2883d1d528f7", "parents": [ "94ea77bb1bfa0b1a3cb98b0bc4652742640cb114" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sat Nov 23 12:35:14 2024 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sat Nov 23 12:35:14 2024 +0100" }, "message": "bump version to v1.4.0\n\nChange-Id: I8af6c4701d3f3f7cb0d360742cb8b0f3d6bbcd19\n" }, { "commit": "b9912e386a47251760e84d40fd3ad5c03d42c08b", "tree": "505df4dbfe53b0d6dd4ccf6f52749c738fdaf9a3", "parents": [ "62837a3c7433e4a660c6e6115577e052cc3416c4" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sat Nov 23 10:11:06 2024 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sat Nov 23 10:11:06 2024 +0100" }, "message": "Move cdb query from examples to tools and always build\n\nChange-Id: Ic55a00cd1d96dc76ec20c07b108cf0402b6108e3\n" }, { "commit": "b17122d37a9d10bb8c54cfd022e106fb3c5da0f2", "tree": "c703ca682006656b668f5100ac86ea61b0ec0af2", "parents": [ "75d35d27d07fc065d72cc8e85aef84f49f0852fd" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Thu Nov 21 14:32:29 2024 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Thu Nov 21 14:39:43 2024 +0100" }, "message": "Add make target \"examples\"\n\nChange-Id: Icfcf7b6994da80a89ecfeefbc262a4a119807f26\n" }, { "commit": "ce2d005b371bfdeca816c7797f48c509f3753df4", "tree": "970bbb433d119ceb3b1e568187f601be126c0036", "parents": [ "6208fd77e556fdc9219868002589b79b616e476e" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Nov 15 15:46:37 2024 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Nov 15 15:53:33 2024 +0100" }, "message": "Bump version to 1.3.2\n\nChange-Id: I01043ccbdb206de35fe946270fe8192aa85810e7\n" }, { "commit": "6208fd77e556fdc9219868002589b79b616e476e", "tree": "5bb582ff22617cd4babee90dc374e7a274bd46a9", "parents": [ "5ffc474b237885bf81026c63a9a89683691fd5d9" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Nov 15 15:46:19 2024 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Fri Nov 15 15:53:31 2024 +0100" }, "message": "add get_version function\n\nChange-Id: I7f294d3a0ce1acb961c49a8a9bee0f3e8e2824eb\n" }, { "commit": "0a3a09ad479b9aa06a9ac09c57b8896d46ee8f97", "tree": "5fa946da11f3b1d10bc85bf2ef9c9d8570e91b6c", "parents": [ "2441f7c09b781efd7393c7209103a2012796ffba" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Thu Nov 14 17:33:42 2024 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Thu Nov 14 17:35:03 2024 +0100" }, "message": "Bump version to v1.3.1\n\nChange-Id: Ib09fb39e241d670a1ed98f585c4055c550f7fc15\n" }, { "commit": "442292368bedc801988a57d2c60d0369f7066e26", "tree": "2e90ddad91d3fc7765de603c5fbad38387b8919d", "parents": [ "13f4f1b6446bc1bf0efe2a972b3b6db536a94810" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Aug 05 15:00:20 2024 +0200" }, "committer": { "name": "„feldmueller“", "email": "„feldmueller@posteo.de“", "time": "Thu Aug 08 10:20:50 2024 +0200" }, "message": "Improve MacOS support\n\nChange-Id: Id54a73c025d01ee37d2373a62506eb52a4f75d35\n" }, { "commit": "d15845c316e28eadab04c173a41d931ce3f83edc", "tree": "1480b0ffd053747bd7a5c84fdc6ca1f83b544ff3", "parents": [ "56ad919657b9621a065ddc4321355aaee1750d61" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Apr 11 22:28:11 2022 +0200" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Apr 11 22:50:17 2022 +0200" }, "message": "Specifiy static lib destination for cmake\n\nChange-Id: I1e4fc55d790889063bc24f253ada2fcf4d44cf8a\n" }, { "commit": "8f977cae31c950e889e3fae73df732d8b4574f18", "tree": "d5f0ffcdf2611343f4b8a4887af59a0507f1ca56", "parents": [ "3919b6354b850ae4f3c46af90fbffa4257e4829f" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Mar 22 17:52:52 2021 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Mar 22 17:52:52 2021 +0100" }, "message": "Fix missing installation of libcollocatordb_static\n\nChange-Id: I4ce807ef44e842e27b2e9961578ed3ca3a5e123a\n" }, { "commit": "3919b6354b850ae4f3c46af90fbffa4257e4829f", "tree": "37e020b93abf041bc3232cf8b8776620b8c17f9e", "parents": [ "15f56e7a7141a9783f8056348e81abf5143f0cb3" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Mar 15 15:03:48 2021 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Mar 15 15:03:48 2021 +0100" }, "message": "Bump version to v1.3.0\n\nChange-Id: Id38cf78eec34252f3bca9ee5297bfaea02e92cee\n" }, { "commit": "15f56e7a7141a9783f8056348e81abf5143f0cb3", "tree": "730c50e578b46f5599f482c8151e36d140b5e716", "parents": [ "3573bd0089d7f2944e12d9552c4828c1b383f49a" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Mar 15 14:58:13 2021 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Mon Mar 15 14:58:13 2021 +0100" }, "message": "Simplify CMakeLists.txt\n\nChange-Id: I11ee872c8bab3fc810d9f739eedbda6e263bd78a\n" }, { "commit": "673bd815dbc883b89fcc858e94c903c5f949eb06", "tree": "9ce490d5991729898610e0e7a49813fb8947299c", "parents": [ "1b09e4dec0b9edd0a04ef93f6d1d76aad1bb5261" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Mar 14 17:27:44 2021 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Mar 14 22:23:54 2021 +0100" }, "message": "Fix installation on CentOS 7\n\nChange-Id: I673e89d567a23376655320ce9edce0fefc0f2d8c\n" }, { "commit": "1b09e4dec0b9edd0a04ef93f6d1d76aad1bb5261", "tree": "aa9a7713bb1391c0f1bcdd6d3f13ac987ad8b7f8", "parents": [ "ed0bfcf605566e1374e446210cfce7b5f2cbe7b3" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Mar 14 15:20:19 2021 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Mar 14 15:20:19 2021 +0100" }, "message": "Add static library test\n\nChange-Id: Id5212457a331811808c5ecfa24ca08498183fd48\n" }, { "commit": "ed0bfcf605566e1374e446210cfce7b5f2cbe7b3", "tree": "5bb4a2f72c7c8a292be0c83e7924711ce218faa9", "parents": [ "6663f11ebcbc2b676eba5cf6060af959cdebc0bb" ], "author": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Mar 14 14:56:15 2021 +0100" }, "committer": { "name": "Marc Kupietz", "email": "kupietz@ids-mannheim.de", "time": "Sun Mar 14 14:56:15 2021 +0100" }, "message": "Switch to cmake\n\nChange-Id: I35cb8925d2bc8441e7635f518dbcfbe0285fd942\n" } ] }