Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
Datok
/
0630be5878075f7b9d7f497ebafa0f8c58fbbe44
/
testdata
/
tokenizer.fst
235ea12
Update generated tokenizers
by Akron
· 3 years, 3 months ago
e184a91
Add new generated automata
by Akron
· 3 years, 3 months ago
03c92fe
Support for tokenend MCS symbol
by Akron
· 3 years, 4 months ago
b4bbb47
Added sentence splitter capabilities
by Akron
· 3 years, 4 months ago
c9d84a6
Sort alphabet prior to xCheck
by Akron
· 3 years, 4 months ago