Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / KorAP-XML-Krill / 7b84722d244757b43e6e668e61c334e0c44e86c8 / lib / KorAP / Tokenizer
  1. 7b84722 Added text marker, added sentences from multiple foundries, changed paragraphs to base/para some tests, some bugfixes by Nils Diewald · 11 years ago
  2. 3cf08c7 Fixed primary data problems, speedup using moar C and now provide layer info by Nils Diewald · 11 years ago
  3. 38b3b5a Made indexer a bit more robust by Nils Diewald · 11 years ago
  4. 3ece630 Fixed tiny offset issue for documents ending with non-tokens by Nils Diewald · 11 years ago
  5. aba4710 Made the indexer more robust and ignore s**t my parser says by Nils Diewald · 11 years ago
  6. 092178e Fix dealing with no-span layers|Improve error messages for bughunting by Nils Diewald · 11 years ago
  7. 37478a8 Bugfixed right offset of spans by Nils Diewald · 11 years ago
  8. ded8e83 Small bugfix regarding single span documents by Nils Diewald · 11 years ago
  9. 7364d1f Indexation script finished by Nils Diewald · 11 years ago
  10. 2db9ad0 Lucene field indexer written in perl by Nils Diewald · 11 years ago