Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / conllu-cmc-docker / b5d80b3c1f2a4626514981936ba70520b09a8a85
commitb5d80b3c1f2a4626514981936ba70520b09a8a85[log] [tgz]
authorMarc Kupietz <kupietz@ids-mannheim.de>Thu Dec 11 15:48:09 2025 +0100
committerMarc Kupietz <kupietz@ids-mannheim.de>Thu Dec 11 15:48:09 2025 +0100
treecf8aff9f74d0f4bbb32ad981d5374542993a1024
parent7497fc4a0f99ebee1cb93a9af21a82a2037a9550 [diff]
Add test for emoji modifiers and ZWJ
1 file changed
tree: cf8aff9f74d0f4bbb32ad981d5374542993a1024
  1. src/
  2. test/
  3. .gitignore
  4. .gitlab-ci.yml
  5. package-lock.json
  6. package.json
  7. Readme.md
Readme.md

conllu2cmc

Reads CoNLL-U format from stdin and annotates emojis, emoticons, hashtags, URLs, email addresses, action words, @names, and Wikipedia emoji templates with their corresponding STTS-IBK POS tag (Beißwenger/Bartsch/Evert/Würzner 2016). Writes CoNLL-U format to stdout.

Usage

korapxml2conllu kyc.zip | conllu2cmc

Generate KorAP-XML zip with CMC annotations

korapxml2conllu kyc.zip | conllu2cmc -s | conllu2korapxml > kyc.cmc.zip

Installation

npm install 'git+https://gitlab.ids-mannheim.de/KorAP/korap-conllu-cmc.git'

Build from source

npm install

Build standalone

npm run pkg-linux

References

Beißwenger, Michael/Bartsch, Sabine/Evert, Stefan/Würzner, Kay-Michael (2016): EmpiriST 2015: A Shared Task on the Automatic Linguistic Annotation of Computer-Mediated Communication and Web Corpora. In: Proceedings of the 10th Web as Corpus Workshop. Berlin: Association for Computational Linguistics, S. 44–56. https://doi.org/10.18653/v1/W16-2606.