Challenges in the Management of Large Corpora — programme posted

The programme of the 3rd meeting of the workshop on Challenges in the Management of Large Corpora (CMLC-3) has been posted, with the open-content publication of the proceedings volume scheduled for the beginning of July at the latest.

The workshop is going to be held on the 20th of July as part of the Corpus Linguistics 2015 (CL2015) conference.

Kalamar – User Frontend released on GitHub!

Mojolicious-based Frontend to KorAP

We are happy to announce the open source release of Kalamar, the Mojolicious-based frontend for KorAP!

Kalamar is written in Perl and JavaScript, acts as a proof-of-concept for the KorAP API, and provides, among other features, …

  • aligned KWIC views,
  • multiple highlighting,
  • table views of morphological annotations,
  • tree views of hierarchical annotations,
  • localization,
  • a language-independent query helper for multiple tag sets,
  • and an embedded and interactive documentation!

Screenshots

Expect more features to come! You can already use Kalamar and download the sources from GitHub.

KoralQuery at the QueryVis Workshop in Vilnius

KoralQuery, the general Corpus Query Protocol used for inter-component communication in KorAP, was presented on May 11th at the workhop on Innovative Corpus Query and Visualization Tools (QueryVis). The workshop was part of the 20th Nordic Conference of Computational Linguistics (Nodalida) in Vilnius, Lithuania. Proceedings are already available.

We would like to thank the reviewers and organizers for a great workshop!

Please cite this work as:
Joachim Bingel, Nils Diewald (2015). KoralQuery – a General Corpus Query Protocol, Proceedings of the Workshop on Innovative Corpus Query and Visualization Tools at NODALIDA 2015, May 11-13, 2015, Vilnius, Lithuania.

Krill – Lucene-based Search Backend released on GitHub!

A Corpusdata Retrieval Index using Lucene for Look-Ups

We are happy to announce the open source release of Krill, the Lucene-based search backend for KorAP! Krill is the reference implementation for KoralQuery, covering most of the protocols features, including …

  • Fulltext search
  • Token-based annotation search
  • Span-based annotation search
  • Distance search
  • Positional search
  • Nested queries

… and many more!

You can download Krill on GitHub – feedback and contributions are very welcome!

‘Koral’ query serializer released!

We are happy to announce the release of Koral, the module which KorAP uses to translate queries from its supported query languages into KoralQuery, a general protocol for queries to corpus analysis systems. Taking a query string as its input, Koral generates a corresponding KoralQuery instance which represents that query independently of the source query language, such that the system may work in a query language-agnostic fashion. Besides the actual linguistic query, KoralQuery also has facilities to represent virtual collection definitions as well as error and warning messages that may arise during query processing.

You can access and download the Koral sources from the KorAP GitHub repository. Please note that the current version 0.1.0 is not a final version and subject to work in progress, which will result in further releases in the not-so-far future.

DeReKo transformation and KorAP development

In the current stage of development, several corpus archives of the current release candidate of DeReKo (2014-II), prepared by Marc Kupietz, have been transformed and annotated to work with the next release of the search engines of KorAP.

  • Wikipedia (2013 release)
  • Goethes Werke
  • Bonner Zeitungskorpus

Further archives are in planning and progress.

New versions of KorAP’s backend and frontend application have been made accessible for users connecting from within the IDS network.

Service version: 1.51
Frontend version: 1.083

Updates include several stability bug fixes as well as a further integration with a second search engine option to generate KWIC results, developed by Piotr Pęzik based on Neo4j. This feature is currently only available via API access, but will be made available via the user interface in the next release of the frontend version.

ChangeLog v1.082 GUI, v1.50 Rest Service

New versions of KorAP’s backend and frontend application have been made accessible for users connecting from within the IDS network.

Service version: 1.50
Frontend version: 1.082

Apart from layout changes for definition of virtual collections, changes also include minor CSS updates, service bug fixes, as well as a new API release of version 0.1.

The example queries, accessible via the User Query menu at several points in the user interface, now include better descriptions and updates for Poliqarp, CQL and COSMAS2 queries.

Layout changes:

  • scrolling bar flickering during loading,
  • simplification to a framed panel view for definition of virtual collection,
  • page status preserved during browser refresh.

Bug fixes:

  • bug fix where cache entry overrides existing virtual collections,
  • unsearchable virtual collections in the demo mode (Queries could not be posted on Virtual collections that the user defined during a demo session of KorAP),
  • False API endpoint use in the frontend for deletion of virtual collections

General updates:

  • performance improvements for database access,
  • API update to v0.1.
  • Access KorAP via a secure connection (SSL)