| commit | 3479082d7eb20d3f120a89344667aa59a335c2b9 | [log] [tgz] |
|---|---|---|
| author | Akron <nils@diewald-online.de> | Tue Jul 07 15:32:50 2020 +0200 |
| committer | Peter Harders <harders@ids-mannheim.de> | Thu Jul 09 14:07:25 2020 +0200 |
| tree | 2badaeaee75b583d82ffb82c6b46777317e6c52f | |
| parent | 510a88cfddf2901fac4c9353b8dbfb73d4fb7c64 [diff] |
Simplify conservative tokenization code Change-Id: I957c21064ef17691b74de3d57361df62197350ef