Gitiles
Code Review
Sign In
korap.ids-mannheim.de
/
KorAP
/
Tokenizer-Evaluation
/
1448b11568319a11fc3933f6ac9f8bbc996a8189
/
.
/
benchmarks
/
cleanup
/
tokenize_simple.pl
blob: cad174913df1638495e9217dcaae5d1afbb371b5 [
file
] [
log
] [
blame
]
Akron
049e526
2022-03-18 09:59:34 +0100
[
diff
] [
blame
]
1
#!/usr/bin/env perl
2
use
strict
;
3
use
warnings
;
4
5
foreach
(<>)
{
6
s
/[
\s\n\t
]+//
g
;
7
print
$_
,
"\n"
;
8
};