Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-XML-TEI
/
42e18a6f8b9e189d15934f59ce0fac1c5050e9cc
/
t
/
cmd
/
tokenizer.pl
b122717
clean up intern tokenization
by Peter Harders
· 4 years, 4 months ago
8b511f9
Establish tokenizer object for external base tokenization
by Akron
· 4 years, 5 months ago