tree 83eb21aa0d47920a7c1fcd225601249c1dc4108c
parent de949deb083c43f4e0fed3713617aed768c000aa
author Marc Kupietz <kupietz@ids-mannheim.de> 1600348886 +0200
committer Akron <nils@diewald-online.de> 1600443846 +0200

Add new command line options using picocli and sanitize code

Usage: koraptokenizer [-hnpsV] [--force] [-ktt] [--[no-]tokens]
                      [-o=<output_fillename>] [<inputFiles>...]
Tokenizes (and sentence splits) text input.
      [<inputFiles>...]   input files
      --force             Force overwrite (default: false)
  -h, --help              Show this help message and exit.
      -ktt                Deprecated. For internal use only. (default: false)
  -n, --normalize         Normalize tokens (default: false)
      --[no-]tokens       Print tokens (default: true)
  -o, --output-file=<output_fillename>
                          Output file (default: -)
  -p, --positions         Print token start and end positions as character
                            offsets (default: false)
  -s, --sentence-boundaries
                          Print sentence boundary positions (default: false)
  -V, --version           Print version information and exit.

Change-Id: Ib92678c832a2d95799a8f503c3e86dd4da2b4d73