| commit | 78f6714529aea5209c4363edf94570a4f5686d19 | [log] [tgz] |
|---|---|---|
| author | Akron <nils@diewald-online.de> | Sat Apr 09 14:10:44 2022 +0200 |
| committer | Akron <nils@diewald-online.de> | Sat Apr 09 14:10:44 2022 +0200 |
| tree | 907711b536979f8a39dd63a8f05364fd9f524331 | |
| parent | 61948ef87b5c0e556439fff72a270ac1f5ca9bc7 [diff] [blame] |
Split tokenizer rules into language-specific and language-dependent Change-Id: I6e5eeabe9a306ce9fc3e62340ba7b948ecc4fa0f
diff --git a/Makefile b/Makefile index 297bfb8..7fb0073 100644 --- a/Makefile +++ b/Makefile
@@ -3,7 +3,7 @@ buildfoma: cd src && \ - foma -e "source tokenizer.xfst" \ + foma -e "source de/tokenizer.xfst" \ -e "save stack ../testdata/tokenizer.fst" -q -s && \ cd ..