Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
KorAP-XML-TEI
/
7b8dbb5aa5f855a36117d54befa4707a27a812ab
/
t
/
script.t
8ab6832
Handle tokenizer crashes more gracefully
by Marc Kupietz
· 6 months ago
ff061ef
Fix parser error when closing body and text tags are on the same line
by Marc Kupietz
· 7 months ago
6b1f26b
Add support for inline dependency structures (fixes #7)
by Akron
· 2 years ago
132bdeb
Introducing --output parameter
by Akron
· 2 years, 4 months ago
ec50325
Accept line-breaks as whitespace in text-only lines
by Akron
· 3 years, 5 months ago
72f4a88
Allow closing elements to start with "text"
by Akron
· 3 years, 7 months ago
fcff734
Fix Java-dependent test for release
by Akron
· 3 years, 8 months ago
v2.4.1
b93fabb
Introduce --no-tokenizer parameter
by Akron
· 3 years, 8 months ago
a671ae5
Enable conversion of (some) standard TEI P5
by Marc Kupietz
· 3 years, 9 months ago
2520a34
Check version of KorAP-Tokenizer when requested
by Akron
· 4 years, 6 months ago
a2cb281
Support single dash for STDIN
by Akron
· 5 years ago
5986da3
Improve handling of broken data
by Akron
· 5 years ago
692d17d
Introduce --skip-inline-token-annotations parameter in favor of KORAPXMLTEI_INLINE
by Akron
· 6 years ago
54c3ff1
Introduce --skip-inline-tags parameter
by Akron
· 6 years ago
75d6314
Introduce --skip-inline-tokens parameter
by Akron
· 6 years ago
91705d7
Introduce --tokens-file parameter
by Akron
· 6 years ago
9157792
Remove mentioning main() (that doesn't exist anymore)
by Akron
· 6 years ago
26a7152
Introduce --base-foundry, --data-file, and --header-file parameters
by Akron
· 6 years ago
dd0be8f
Support --inline-structures parameter
by Akron
· 6 years ago
1a5271a
Introduce --inline-tokens parameter
by Akron
· 6 years ago
eed4cb1
Fix possible IO deadlocks with KorAP tokenizer
by Marc Kupietz
· 6 years ago
8a954e5
Automatically replace entities with their corresponding characters
by Marc Kupietz
· 6 years ago
985da0c
Add -s option to use sentence boundaries provided by KorAP tokenizer
by Marc Kupietz
· 6 years ago
f7084c4
Improve test suite to work without warnings in recent versions of mojo
by Akron
· 6 years ago
44b1f25
Fix handling of utf-characters in sigles
by Marc Kupietz
· 6 years ago
eaa9623
Switch input encoding based on XML processing instruction
by Akron
· 6 years ago
b364947
Introduce KORAPXMLTEI_DEBUG and document environment variables
by Akron
· 6 years ago
417ed2f
Add proper test for 3384
by Akron
· 6 years ago
fd0e6a9
Do not escape double quoutes inside raw_text elements
by Marc Kupietz
· 6 years ago
3378dfd
Use Log::Any script-wide and support log level parameter
by Akron
· 6 years ago
c57625b
Added regression test for structure handling
by Akron
· 6 years ago
044bd92
Introduce test object and simplified script testing
by Akron
· 6 years ago
54e363c
Improve i5 template testing
by Akron
· 6 years ago
09e0b2c
Establish collection object for token annotations
by Akron
· 6 years ago
e68ec0c
Test and benchmark conversion of inline annotations
by Akron
· 6 years ago
1c5ce15
change utf8_encode and utf8_decode
by Peter Harders
· 6 years ago
42e18a6
allow to specify both tokenizations (extern and intern)
by Peter Harders
· 6 years ago
5fb5e8d
Simplify and centralize temporary file creation
by Akron
· 6 years ago
f9c5124
parametrize internal tokenization
by Peter Harders
· 6 years ago
b122717
clean up intern tokenization
by Peter Harders
· 6 years ago
4c6ff5b
Merge "Bugfix: intern tokenization"
by Peter Harders
· 6 years ago
57c884e
remove temp. files from tests per default
by Peter Harders
· 6 years ago
71f072b
Bugfix: intern tokenization
by Peter Harders
· 6 years ago
8b511f9
Establish tokenizer object for external base tokenization
by Akron
· 6 years ago
8571751
Create Zip-Factory for simpler handling of Zip streams
by Akron
· 6 years ago
eac374d
Separate dummy tokenization from main script with minimal changes
by Akron
· 6 years ago
7c2505d
Use Test::XML::Loy instead of Test::XML::Simple for performance reasons
by Akron
· 6 years ago
d949e18
Introduce POD documentation and add license file
by Akron
· 7 years ago
d89ef82
Use Test::XML::Loy instead of Test::XML::Simple for performance reasons
by Akron
· 7 years ago
6896608
Added processing tests for example corpus
by Akron
· 7 years ago
2a60c53
Added processing tests for example corpus
by Akron
· 7 years ago
797e807
Added initial script test
by Akron
· 7 years ago