Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-Tokenizer
/
ad22e2ce7f253650d96373bb1fd6472f091075a9
/
src
/
test
751868b
Make tokenizer implementation exchangeable
by Marc Kupietz
· 4 years, 10 months ago
b9f45e0
Rename tokenizer class to KorAPDFATokenizer
by Marc Kupietz
· 4 years, 10 months ago
c419d5b
Add new command line options using picocli and sanitize code
by Marc Kupietz
· 4 years, 10 months ago
783e2a2
Ignore quoted email names like "John Doe"@xx.com
by Marc Kupietz
· 4 years, 11 months ago
571c194
Empty text (<EOT><EOT>) -> empty output line
by Marc Kupietz
· 4 years, 11 months ago
793f85d
Add first tests for IPC invocation scenario
by Marc Kupietz
· 4 years, 11 months ago
b2666fc
Implement sentence splitter
by Marc Kupietz
· 4 years, 11 months ago
07d9714
Move tests to proper location
by Marc Kupietz
· 4 years, 11 months ago
478632e
Clean up code
by Marc Kupietz
· 4 years, 11 months ago
3367773
Initial import from private/Ingestion
by Marc Kupietz
· 5 years ago