| commit | a2f952f3883d14cfdd09e1d18c4dc7e7596de855 | [log] [tgz] |
|---|---|---|
| author | Akron <nils@diewald-online.de> | Wed Feb 04 09:51:51 2026 +0100 |
| committer | Akron <nils@diewald-online.de> | Wed Feb 04 09:51:51 2026 +0100 |
| tree | 8b8f6a2c6e9396da45dc4d58a971c7e67a1db1ff | |
| parent | d8d889583ab446a0799ecb2d9c68310ed918fe90 [diff] |
Support Wikipedia templates Change-Id: Iad7777c54b30c2131e6bac09786807a62e1cac07
diff --git a/src/de/tokenizer.xfst b/src/de/tokenizer.xfst index ce4bec3..aa2092b 100644 --- a/src/de/tokenizer.xfst +++ b/src/de/tokenizer.xfst
@@ -75,7 +75,7 @@ Email @-> ... NLout, File @-> ... NLout, Domain @-> ... NLout, - [Emoticons|Arrows] @-> ... NLout + [Emoticons|Arrows|Wikitemplate] @-> ... NLout ]; source all/allsentencesplit.xfst