Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
Datok
/
d8d889583ab446a0799ecb2d9c68310ed918fe90
/
src
/
de
/
tokenizer.xfst
d8d8895
Introduce hyphenated abreviations in german tokenizer
by Akron
· 4 weeks ago
6dcb6ce
Add arrows
by Akron
· 3 years, 11 months ago
78f6714
Split tokenizer rules into language-specific and language-dependent
by Akron
· 3 years, 11 months ago