Added sentence splitter capabilities
4 files changed
tree: 4850fb8f1d0d61743f6c2e44ecb217a4d5f1c9bd
  1. testdata/
  2. .gitignore
  3. datokenizer.go
  4. datokenizer_test.go
  5. go.mod
  6. go.sum