Gitiles
Code Review Sign In
korap.ids-mannheim.de / IDS-Mannheim / totalngrams / 31574d915d1ed6ab02b1291fb817e14ee0401785
  1. 31574d9 Include shell scripts in artifacts by Marc Kupietz · 2 years, 1 month ago
  2. 9b6b845 Extend LinkedList<String> correctly by Marc Kupietz · 2 years, 1 month ago
  3. 097f35a Make groovy scripts available as executables by Marc Kupietz · 2 years, 1 month ago
  4. 48070d9 Update .gitlab-ci.yml file by Marc Kupietz · 2 years, 1 month ago
  5. 3253079 Update changelog by Marc Kupietz · 2 years, 1 month ago
  6. ab91cf0 Update pom by Marc Kupietz · 2 years, 1 month ago
  7. 24416b4 Add FilterKeys script and Readme by Marc Kupietz · 2 years, 1 month ago
  8. 8250c4b Make surefire-plugin fork and give it more heap by Marc Kupietz · 2 years, 1 month ago
  9. 47bd743 Drop failing stderr test by Marc Kupietz · 2 years, 1 month ago
  10. 869bfb9 Incorporate pseudonymization scripts into maven project by Marc Kupietz · 2 years, 1 month ago
  11. e582d9c Add groovy script for pseudonymizing ngram lists by Marc Kupietz · 2 years, 1 month ago
  12. 42e37e1 Add groovy script for generation pseudonym keys by Marc Kupietz · 2 years, 1 month ago
  13. 098c820 Handle tab-separated ints in numeric secondary sort by Marc Kupietz · 2 years, 1 month ago
  14. 7722b47 Simplify unsorted output by Marc Kupietz · 2 years, 1 month ago
  15. fa273a5 Bump version to 2.1.0 by Marc Kupietz · 2 years, 1 month ago
  16. 6a151fb Add artifacts to ci script by Marc Kupietz · 2 years, 1 month ago
  17. 0e72537 Add missing test resources by Marc Kupietz · 2 years, 1 month ago
  18. 118b7a5 Add CI tests and dependency scans by Marc Kupietz · 2 years, 1 month ago
  19. b6f4fab Upgrade dependencies by Marc Kupietz · 2 years, 1 month ago
  20. 014cfc5 Bump version to 2.0.1 by Marc Kupietz · 2 years, 1 month ago
  21. 983cfc1 Bump version to 2.0 by Marc Kupietz · 3 years, 2 months ago
  22. 4a64b9c Rename jar from nGrammFoldCount to totalngrams by Marc Kupietz · 3 years, 2 months ago
  23. c73be80 Let number of folds (-F) default to 1 by Marc Kupietz · 3 years, 2 months ago
  24. 04dd984 Unify name to totalngrams by Marc Kupietz · 3 years, 2 months ago
  25. 37197a8 Fix bug in simple test by Marc Kupietz · 3 years, 2 months ago
  26. be29959 Test simple text also without padding by Marc Kupietz · 3 years, 2 months ago
  27. e4adb69 Make sure that start and end tags for empty texts are counted by Marc Kupietz · 3 years, 2 months ago
  28. 5d56653 Add text end padding only if in target fold by Marc Kupietz · 3 years, 2 months ago
  29. a691041 Add --pad option to optionally add padding symbols at text edges by Marc Kupietz · 3 years, 2 months ago
  30. ead2a6f Improve null handling in tests by Marc Kupietz · 3 years, 2 months ago
  31. 03f9dc0 Add option -N to sort keys with same freq numerically by Marc Kupietz · 3 years, 2 months ago
  32. 1b717be Auto detect xz compression for input and output by Marc Kupietz · 3 years, 2 months ago
  33. f14c096 Bump version to 1.9.900 by Marc Kupietz · 3 years, 8 months ago
  34. 53623e0 Add --downcase/-d option to convert all token characters to lower case by Marc Kupietz · 3 years, 8 months ago
  35. bc8bd3d totalngrams: for .(freq|tsv)(.gz)? input files automatically cumulate frequencies by Marc Kupietz · 4 years ago
  36. 2a65aee totalngrams: use stringbuilder for building output lines by Marc Kupietz · 4 years ago
  37. c3c172d totalngrams add log for unsorted ouput by Marc Kupietz · 4 years, 2 months ago
  38. 97f00c4 totalngrams: make sure to assume unsigned ints in frequency prints by Marc Kupietz · 4 years, 2 months ago
  39. 85a17b0 totalngrams: add -S to turn off output sorting by Marc Kupietz · 4 years, 2 months ago
  40. 775c666 totalngrams: dev version by Marc Kupietz · 4 years, 2 months ago
  41. ca29d55 totalNGrams: Bump version to 1.7 (automatic XML unescaping) by Marc Kupietz · 4 years, 2 months ago
  42. c78b5a5 totalNGrams: unescape all XML entities (&, <, >, ") by Marc Kupietz · 4 years, 2 months ago
  43. aca0a8d n-grams: Assert proper tab separated CoNLL-U Format with 10 columns input by Marc Kupietz · 4 years, 2 months ago
  44. aaf46f1 totalngrams: fix main class name by Marc Kupietz · 4 years, 4 months ago
  45. cf6ec7d totalngrams: fix junit5 tests with old maven versions by Marc Kupietz · 4 years, 4 months ago
  46. 3db37c5 totalngrams: add unit test for almost the whole pipeline by Marc Kupietz · 4 years, 4 months ago
  47. b66b832 totalngrams: create call script by Marc Kupietz · 4 years, 4 months ago
  48. 8b1bfab totalngrams: default to cores - 2 threads by Marc Kupietz · 4 years, 4 months ago
  49. b5f4868 totalngrams: remove redundant returns and imports by Marc Kupietz · 4 years, 4 months ago
  50. 2ea60bd Use cryptogrphic Blake2b hash as determisitic fold random source by Marc Kupietz · 4 years, 4 months ago
  51. 8780be5 totalngrams: add console logger for > WARNING levels by Marc Kupietz · 4 years, 4 months ago
  52. 30c9a81 totalngrams: fix missing imports by Marc Kupietz · 4 years, 4 months ago
  53. d49801a totalngrams: sort input files by size by Marc Kupietz · 4 years, 4 months ago
  54. 3e8a38d totalngrams: add reading .conllu and conllu.gz files directly by Marc Kupietz · 4 years, 4 months ago
  55. 0337db6 totalngrams: add -l option to count <token>\t<lemma>\t<pos> by Marc Kupietz · 4 years, 4 months ago
  56. 6638bb2 totalngrams: start adding unit tests by Marc Kupietz · 4 years, 4 months ago
  57. 9c63b57 totalngrams: Calculate only one fold at a time by Marc Kupietz · 4 years, 4 months ago
  58. a363746 totalngrams: use tab as separator also between n-gram tokens by Marc Kupietz · 4 years, 4 months ago
  59. fcee606 Revert "totalngrams: use chronicle map for larger maps" by Marc Kupietz · 4 years, 4 months ago
  60. 12c0411 Revert "Try Ehcache" by Marc Kupietz · 4 years, 4 months ago
  61. d245822 Try Ehcache by Marc Kupietz · 4 years, 4 months ago
  62. 7f45175 totalngrams: use chronicle map for larger maps by Marc Kupietz · 4 years, 4 months ago
  63. ac44043 totalngrams: factor out file creation by Marc Kupietz · 4 years, 4 months ago
  64. e23b6cb totalngrams: update parallelzip to 1.0.5 by Marc Kupietz · 4 years, 4 months ago
  65. b9ff157 totalngrams: fix calculations with unsigned integers > 2^31 by Marc Kupietz · 4 years, 4 months ago
  66. 34bbca5 totalngrams: use buffered output streams by Marc Kupietz · 4 years, 4 months ago
  67. 251bbac totalngrams: bump version to 1.1 by Marc Kupietz · 4 years, 4 months ago
  68. 5dc9fa5 totalngrams: improve logging by Marc Kupietz · 4 years, 4 months ago
  69. ba7c757 totalngrams: support gzipped output by Marc Kupietz · 4 years, 4 months ago
  70. 0b95783 totalngrams: sanitize worker node pool by Marc Kupietz · 4 years, 4 months ago
  71. 010903e totalngrams: reuse slidingWindowQueue by Marc Kupietz · 4 years, 4 months ago
  72. e31c4e1 totalngrams: improve progressbar looks by Marc Kupietz · 4 years, 4 months ago
  73. 9d64cde Use unsigned integers instead of longs for counts by Marc Kupietz · 4 years, 4 months ago
  74. 68dc73d totalngrams: parallelize and fix alphabetical secondary sorting by Marc Kupietz · 4 years, 4 months ago
  75. bd62aa0 totalngrams: log warnings and retry on errors by Marc Kupietz · 4 years, 4 months ago
  76. cc77d67 totalngrams: sanitize progressbar by Marc Kupietz · 4 years, 4 months ago
  77. 4cd3389 totalngrams: allow using a worker node pool by Marc Kupietz · 4 years, 4 months ago
  78. 97713f3 totalngrams: detect early if output file can be written by Marc Kupietz · 4 years, 4 months ago
  79. 8fae582 totalngram: Use our own ETA printer by Marc Kupietz · 4 years, 4 months ago
  80. 1c06250 Revert "totalngram: compute marginals in parallel" by Marc Kupietz · 4 years, 4 months ago
  81. 88d50e2 totalngram: compute marginals in parallel by Marc Kupietz · 4 years, 4 months ago
  82. 962a978 Revert "totalngram: use CircularFifoQueue as sliding window base" by Marc Kupietz · 4 years, 4 months ago
  83. 0184f9c totalngram: use CircularFifoQueue as sliding window base by Marc Kupietz · 4 years, 4 months ago
  84. 81e85e2 totalngram: Support > 1-grams by Marc Kupietz · 4 years, 4 months ago
  85. a37cc9f Efficient folded ngram frequency adder by Marc Kupietz · 4 years, 4 months ago