tree 27e01e776ecff1f81414911125f9812e998b6884
parent 2e42b9754c7d98339115843953fd067f3be3a5ec
author Marc Kupietz <kupietz@ids-mannheim.de> 1769604373 +0100
committer Marc Kupietz <kupietz@ids-mannheim.de> 1769604373 +0100

Don't treat soft hyphens (U+00AD) as token boundaries

Resolves #131

Change-Id: Ia62f5ff91d82ef22830d8fd31afb701c9b703c26