| commit | e184a91e0f383272d4bd043b95fb0aba1120beb9 | [log] [tgz] |
|---|---|---|
| author | Akron <nils@diewald-online.de> | Wed Aug 11 18:23:41 2021 +0200 |
| committer | Akron <nils@diewald-online.de> | Wed Aug 11 18:23:41 2021 +0200 |
| tree | 0fed2517a12d694fa92317c06526abb2162b3acc | |
| parent | ec835ad35dc990a68299db6790eedb1eb7aeeb30 [diff] |
Add new generated automata
diff --git a/testdata/tokenizer.datok b/testdata/tokenizer.datok index 933dde9..5dac53e 100644 --- a/testdata/tokenizer.datok +++ b/testdata/tokenizer.datok Binary files differ
diff --git a/testdata/tokenizer.fst b/testdata/tokenizer.fst index 98c9e38..615fe00 100644 --- a/testdata/tokenizer.fst +++ b/testdata/tokenizer.fst Binary files differ