Croatian and Serbian part of speech (POS) and morphosyntactic (MSD) tagger [legacy]

Written by

admin

in

, , , , ,

This tool is considered a legacy tool as the NLP pipeline achieves better results on the same task, but is not available as a web service yet.

A tool for automatic annotation on the morphosyntactic level. It is capable of tagging both Croatian and Serbian as models for both languages are present in the tool.
The tagger is based on the CRF algorithm trained on a 500,000-token Croatian training corpus and the hrLex/srLex lexicons for each respective language.

The set of morphosyntactic tags used in the corpus follows the revised MULTEXT-East V5 tagset for Croatian and Serbian, available here.

Accuracies calculated on test sets for each language:
  • Croatian: 92.53%
  • Serbian: 92.33%
Author
Nikola Ljubešić
Availability
The tagger is freely available in three forms:
  1. For local use, the code and models of the tagger can be downloaded from this GitHub repository.
  2. The tagger web service can be used online, via our web interface that can be found here.
  3. Our web service can be accessed from of our Python library, which can also be downloaded from the CLARIN.SI GitHub repository. Instructions on how to install the ReLDI library from GitHub can be found here (in Serbian). Alternatively, the easiest way to install it is through PyPI from the command line interface. (Detailed instructions also on GitHub.)

The third option, i.e. using the ReLDI Python library, is most recommended for handling larger amounts of data.

Publications
The tagger and its construction process have been described in detail in the following paper:
Nikola Ljubešić, Filip Klubička, Željko Agić, Ivo-Pavao Jazbec (2016). New Inflectional Lexicons and Training Corpora for Improved Morphosyntactic Annotation of Croatian and Serbian. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16). Portorož, Slovenia. [Link] [.bib]

More posts