Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-XML-TEI
/
854a11503d3c0e9d22f322c26572d2e032192fc0
/
lib
854a115
bugfixing Conservative.pm
by Peter Harders
· 4 years, 10 months ago
5fb5e8d
Simplify and centralize temporary file creation
by Akron
· 4 years, 10 months ago
b122717
clean up intern tokenization
by Peter Harders
· 4 years, 10 months ago
95bc98a
Rename delHTMLcom to be in line with other naming conventions and make the function exportable
by Akron
· 4 years, 11 months ago
8b511f9
Establish tokenizer object for external base tokenization
by Akron
· 4 years, 11 months ago
d962747
Establish tokenizer objects for aggressive and conservative base tokenization
by Akron
· 4 years, 11 months ago
8571751
Create Zip-Factory for simpler handling of Zip streams
by Akron
· 5 years ago
3479082
Simplify conservative tokenization code
by Akron
· 5 years ago
510a88c
Minor speedup in tokenization by merging array pushes
by Akron
· 5 years ago
eac374d
Separate dummy tokenization from main script with minimal changes
by Akron
· 5 years ago
7fab93b
Replace recursion and non-essential regexes with index/substr
by Akron
· 5 years ago
2d547bc
Fix a bug in delHTMLcom where comments were left open
by Akron
· 5 years ago
4f67cd4
Atomize and test comment stripping
by Akron
· 5 years ago