Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
Datok
/
094a4e89970471e07041754152e72314ea02f6a2
/
src
/
tokenizer.xfst
4c2a1ad
Introduce XML tests
by Akron
· 3 years, 3 months ago
3de361e
Improved newline and abbreviation handling
by Akron
· 3 years, 3 months ago
57d0161
Add known terms with special characters
by Akron
· 3 years, 3 months ago
e8837b5
Add file scheme
by Akron
· 3 years, 3 months ago
fd92d7e
Update abbreviations according to KorAP-Tokenizer
by Akron
· 3 years, 3 months ago
a0bded5
Add ordinals
by Akron
· 3 years, 3 months ago
4af79f1
Added support for streetnames
by Akron
· 3 years, 3 months ago
310905f
Add foma sources
by Akron
· 3 years, 3 months ago