Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-Tokenizer
/
1f90daf87e6c1f8db9864fdbb0efca67c35d5bbb
/
src
/
test
/
resources
6d28ed1
Separate apostrophe marked contractions and clitics for en and fr
by Marc Kupietz
· 3 years, 7 months ago
96bd87c
Improve systematicity of options -p, -s, --[no-]tokens
by Marc Kupietz
· 4 years ago
f5a7e04
Add French tokenizer (-l fr)
by Marc Kupietz
· 4 years, 4 months ago
74141b3
Add -l command line option to choose language
by Marc Kupietz
· 4 years, 5 months ago
8e197f3
Allow setting input encoding explicitely whith -e <encoding>
by Marc Kupietz
· 4 years, 4 months ago
571c194
Empty text (<EOT><EOT>) -> empty output line
by Marc Kupietz
· 4 years, 5 months ago
793f85d
Add first tests for IPC invocation scenario
by Marc Kupietz
· 4 years, 5 months ago
3367773
Initial import from private/Ingestion
by Marc Kupietz
· 4 years, 6 months ago