Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-XML-TEI
/
ed0505f2687936c3a9131a7e903d7f9c8b6b299e
/
t
/
tokenization-external.t
52dc21b
Send <EOT>\n to external tokenizer for separating texts
by Marc Kupietz
· 4 years, 3 months ago
57c884e
remove temp. files from tests per default
by Peter Harders
· 4 years, 4 months ago
8b511f9
Establish tokenizer object for external base tokenization
by Akron
· 4 years, 5 months ago