Gitiles
Code Review Sign In
korap.ids-mannheim.de / KorAP / conllu-cmc-docker / 187bcdc918f76307d7d84bc57241274c84abded5
commit187bcdc918f76307d7d84bc57241274c84abded5[log] [tgz]
authorMarc Kupietz <kupietz@ids-mannheim.de>Thu Dec 18 11:43:26 2025 +0100
committerMarc Kupietz <kupietz@ids-mannheim.de>Thu Dec 18 11:43:26 2025 +0100
treee2e99e0ed03dabb307ca8277a2d48917297694c8
parent30634ffea896eb0efb4b0730678e2aedc6e3e697 [diff]
Do not populate UPOS column

mismerge...

Change-Id: I035803460abe4eadb43bdabcf2cdb0161e2d45fb
2 files changed
tree: e2e99e0ed03dabb307ca8277a2d48917297694c8
  1. scripts/
  2. src/
  3. test/
  4. .gitignore
  5. .gitlab-ci.yml
  6. docker-entrypoint.sh
  7. Dockerfile
  8. package-lock.json
  9. package.json
  10. Readme.md
Readme.md

conllu-cmc

Docker

Reads CoNLL-U format from stdin and annotates emojis, emoticons, hashtags, URLs, email addresses, action words, @names, and Wikipedia emoji templates with their corresponding STTS-IBK POS tag (Beißwenger/Bartsch/Evert/Würzner 2016). Writes CoNLL-U format to stdout.

Docker Usage

# Annotate CoNLL-U input
korapxml2conllu kyc.zip | docker run --rm -i korap/conllu-cmc

# With sparse output (only annotated lines)
korapxml2conllu kyc.zip | docker run --rm -i korap/conllu-cmc -s

# Generate KorAP-XML zip with CMC annotations
korapxml2conllu kyc.zip | docker run --rm -i korap/conllu-cmc -s | conllu2korapxml > kyc.cmc.zip

# Show help
docker run --rm korap/conllu-cmc --help

Local Usage

korapxml2conllu kyc.zip | conllu-cmc

Generate KorAP-XML zip with CMC annotations

korapxml2conllu kyc.zip | conllu-cmc -s | conllu2korapxml > kyc.cmc.zip

Installation

Docker (recommended)

docker pull korap/conllu-cmc

npm

npm install 'git+https://gitlab.ids-mannheim.de/KorAP/conllu-cmc-docker.git'

Build from source

npm install

Build standalone

npm run pkg-linux

References

Beißwenger, Michael/Bartsch, Sabine/Evert, Stefan/Würzner, Kay-Michael (2016): EmpiriST 2015: A Shared Task on the Automatic Linguistic Annotation of Computer-Mediated Communication and Web Corpora. In: Proceedings of the 10th Web as Corpus Workshop. Berlin: Association for Computational Linguistics, S. 44–56. https://doi.org/10.18653/v1/W16-2606.