Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-Tokenizer
/
571c194376e9bfc928da5a4eb765e59eceae096d
/
src
571c194
Empty text (<EOT><EOT>) -> empty output line
by Marc Kupietz
· 4 years, 4 months ago
6afd121
Use standard EOT/EOF character x04 instead of magic escape \n\x03\n
by Marc Kupietz
· 4 years, 4 months ago
793f85d
Add first tests for IPC invocation scenario
by Marc Kupietz
· 4 years, 4 months ago
b2666fc
Implement sentence splitter
by Marc Kupietz
· 4 years, 4 months ago
07d9714
Move tests to proper location
by Marc Kupietz
· 4 years, 4 months ago
8192509
Use original Span class and implement Tokenizer interface from OpenNLP
by Marc Kupietz
· 4 years, 4 months ago
478632e
Clean up code
by Marc Kupietz
· 4 years, 4 months ago
45dc0fe
Add Apache copyright NOTICE
by Marc Kupietz
· 4 years, 4 months ago
3367773
Initial import from private/Ingestion
by Marc Kupietz
· 4 years, 4 months ago