- 04dd984 Unify name to totalngrams by Marc Kupietz · 3 years, 2 months ago
- 5d56653 Add text end padding only if in target fold by Marc Kupietz · 3 years, 2 months ago
- a691041 Add --pad option to optionally add padding symbols at text edges by Marc Kupietz · 3 years, 2 months ago
- 03f9dc0 Add option -N to sort keys with same freq numerically by Marc Kupietz · 3 years, 2 months ago
- 1b717be Auto detect xz compression for input and output by Marc Kupietz · 3 years, 2 months ago
- 53623e0 Add --downcase/-d option to convert all token characters to lower case by Marc Kupietz · 3 years, 8 months ago
- bc8bd3d totalngrams: for .(freq|tsv)(.gz)? input files automatically cumulate frequencies by Marc Kupietz · 4 years ago
- 2a65aee totalngrams: use stringbuilder for building output lines by Marc Kupietz · 4 years ago
- c3c172d totalngrams add log for unsorted ouput by Marc Kupietz · 4 years, 2 months ago
- 97f00c4 totalngrams: make sure to assume unsigned ints in frequency prints by Marc Kupietz · 4 years, 2 months ago
- 85a17b0 totalngrams: add -S to turn off output sorting by Marc Kupietz · 4 years, 2 months ago
- c78b5a5 totalNGrams: unescape all XML entities (&, <, >, ") by Marc Kupietz · 4 years, 2 months ago
- aca0a8d n-grams: Assert proper tab separated CoNLL-U Format with 10 columns input by Marc Kupietz · 4 years, 2 months ago
- aaf46f1 totalngrams: fix main class name by Marc Kupietz · 4 years, 4 months ago
- cf6ec7d totalngrams: fix junit5 tests with old maven versions by Marc Kupietz · 4 years, 4 months ago
- 8b1bfab totalngrams: default to cores - 2 threads by Marc Kupietz · 4 years, 4 months ago
- b5f4868 totalngrams: remove redundant returns and imports by Marc Kupietz · 4 years, 4 months ago
- 2ea60bd Use cryptogrphic Blake2b hash as determisitic fold random source by Marc Kupietz · 4 years, 4 months ago
- 8780be5 totalngrams: add console logger for > WARNING levels by Marc Kupietz · 4 years, 4 months ago
- 30c9a81 totalngrams: fix missing imports by Marc Kupietz · 4 years, 4 months ago
- d49801a totalngrams: sort input files by size by Marc Kupietz · 4 years, 4 months ago
- 3e8a38d totalngrams: add reading .conllu and conllu.gz files directly by Marc Kupietz · 4 years, 4 months ago
- 0337db6 totalngrams: add -l option to count <token>\t<lemma>\t<pos> by Marc Kupietz · 4 years, 4 months ago
- 9c63b57 totalngrams: Calculate only one fold at a time by Marc Kupietz · 4 years, 4 months ago
- a363746 totalngrams: use tab as separator also between n-gram tokens by Marc Kupietz · 4 years, 4 months ago
- fcee606 Revert "totalngrams: use chronicle map for larger maps" by Marc Kupietz · 4 years, 4 months ago
- 12c0411 Revert "Try Ehcache" by Marc Kupietz · 4 years, 4 months ago
- d245822 Try Ehcache by Marc Kupietz · 4 years, 4 months ago
- 7f45175 totalngrams: use chronicle map for larger maps by Marc Kupietz · 4 years, 4 months ago
- ac44043 totalngrams: factor out file creation by Marc Kupietz · 4 years, 4 months ago
- b9ff157 totalngrams: fix calculations with unsigned integers > 2^31 by Marc Kupietz · 4 years, 4 months ago
- 34bbca5 totalngrams: use buffered output streams by Marc Kupietz · 4 years, 4 months ago
- 5dc9fa5 totalngrams: improve logging by Marc Kupietz · 4 years, 4 months ago
- ba7c757 totalngrams: support gzipped output by Marc Kupietz · 4 years, 4 months ago
- 0b95783 totalngrams: sanitize worker node pool by Marc Kupietz · 4 years, 4 months ago
- 010903e totalngrams: reuse slidingWindowQueue by Marc Kupietz · 4 years, 4 months ago
- e31c4e1 totalngrams: improve progressbar looks by Marc Kupietz · 4 years, 4 months ago
- 9d64cde Use unsigned integers instead of longs for counts by Marc Kupietz · 4 years, 4 months ago
- 68dc73d totalngrams: parallelize and fix alphabetical secondary sorting by Marc Kupietz · 4 years, 4 months ago
- bd62aa0 totalngrams: log warnings and retry on errors by Marc Kupietz · 4 years, 4 months ago
- cc77d67 totalngrams: sanitize progressbar by Marc Kupietz · 4 years, 4 months ago
- 4cd3389 totalngrams: allow using a worker node pool by Marc Kupietz · 4 years, 4 months ago
- 97713f3 totalngrams: detect early if output file can be written by Marc Kupietz · 4 years, 4 months ago
- 8fae582 totalngram: Use our own ETA printer by Marc Kupietz · 4 years, 4 months ago
- 1c06250 Revert "totalngram: compute marginals in parallel" by Marc Kupietz · 4 years, 4 months ago
- 88d50e2 totalngram: compute marginals in parallel by Marc Kupietz · 4 years, 4 months ago
- 962a978 Revert "totalngram: use CircularFifoQueue as sliding window base" by Marc Kupietz · 4 years, 4 months ago
- 0184f9c totalngram: use CircularFifoQueue as sliding window base by Marc Kupietz · 4 years, 4 months ago
- 81e85e2 totalngram: Support > 1-grams by Marc Kupietz · 4 years, 4 months ago
- a37cc9f Efficient folded ngram frequency adder by Marc Kupietz · 4 years, 4 months ago