Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-XML-TEI
/
8b511f932a7e0f5d3869525b69006466b82c488d
/
lib
8b511f9
Establish tokenizer object for external base tokenization
by Akron
· 4 years, 5 months ago
d962747
Establish tokenizer objects for aggressive and conservative base tokenization
by Akron
· 4 years, 5 months ago
8571751
Create Zip-Factory for simpler handling of Zip streams
by Akron
· 4 years, 5 months ago
3479082
Simplify conservative tokenization code
by Akron
· 4 years, 5 months ago
510a88c
Minor speedup in tokenization by merging array pushes
by Akron
· 4 years, 5 months ago
eac374d
Separate dummy tokenization from main script with minimal changes
by Akron
· 4 years, 5 months ago
7fab93b
Replace recursion and non-essential regexes with index/substr
by Akron
· 4 years, 5 months ago
2d547bc
Fix a bug in delHTMLcom where comments were left open
by Akron
· 4 years, 5 months ago
4f67cd4
Atomize and test comment stripping
by Akron
· 4 years, 5 months ago