Support non-word-tokens (fixes #5)
Change-Id: I6867745afd7c0fb865722bcd62a0724aaa9a6ccb
diff --git a/Readme.pod b/Readme.pod
index 9b80513..3b3ef8d 100644
--- a/Readme.pod
+++ b/Readme.pod
@@ -178,6 +178,13 @@
This is I<deprecated>.
+=item B<--non-word-tokens|-nwt>
+
+Tokenize non-word tokens like word tokens (defined as matching
+C</[\d\w]/>). Useful to treat punctuations as tokens.
+
+ Defaults to unset.
+
=item B<--jobs|-j>
Define the number of concurrent jobs in seperated forks
@@ -343,6 +350,9 @@
Glemm
#Morpho
+ HNC
+ #Morpho
+
LWC
#Dependency
@@ -389,7 +399,7 @@
=head1 COPYRIGHT AND LICENSE
-Copyright (C) 2015-2018, L<IDS Mannheim|http://www.ids-mannheim.de/>
+Copyright (C) 2015-2019, L<IDS Mannheim|http://www.ids-mannheim.de/>
Author: L<Nils Diewald|http://nils-diewald.de/>