Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
Datok
/
d66a926e18fe86f9bd750f99dc011b9675512843
/
datokenizer_test.go
d66a926
Add load factor
by Akron
· 3 years, 4 months ago
f2120ca
Split Tokenizer and DaTokenizer
by Akron
· 3 years, 4 months ago
c9d84a6
Sort alphabet prior to xCheck
by Akron
· 3 years, 4 months ago
740f3d7
Cleanup code
by Akron
· 3 years, 4 months ago
49d27ee
Fix epsilon handling in match operation
by Akron
· 3 years, 4 months ago
465a099
Add support for epsilon symbols
by Akron
· 3 years, 4 months ago
730a79c
Support unknown and identity symbols
by Akron
· 3 years, 4 months ago
75ebe7f
Fix foma format parser
by Akron
· 3 years, 4 months ago
8ef408b
Initial commit
by Akron
· 3 years, 4 months ago