tree 907711b536979f8a39dd63a8f05364fd9f524331
parent 61948ef87b5c0e556439fff72a270ac1f5ca9bc7
author Akron <nils@diewald-online.de> 1649506244 +0200
committer Akron <nils@diewald-online.de> 1649506244 +0200

Split tokenizer rules into language-specific and language-dependent

Change-Id: I6e5eeabe9a306ce9fc3e62340ba7b948ecc4fa0f