The SentiComments.SR dataset includes the following three corpora:
- The main SentiComments.SR corpus, consisting of 3490 movie-related comments
- The movie verification corpus, consisting of 464 movie-related comments
- The book verification corpus, consisting of 173 book-related comments
The main SentiComments.SR corpus was constructed out of the comments written by visitors on the kakavfilm.com movie review website in Serbian. The movie verification corpus comments were sourced from two other Serbian movie review websites – gledajme.rs and happynovisad.com. The book verification corpus comments were also sourced from the happynovisad.com website. Comments containing more than a predefined upper bound for token count (using basic whitespace tokenization), were discarded, as were the comments not written in Serbian.
Six sentiment labels were used in dataset annotation: +1, -1, +M, -M, +NS, and -NS, with the addition of an ‘s’ label suffix denoting the presence of sarcasm. The annotation principles used to assign sentiment labels to items in SentiComments.SR are described in the papers listed in the Publications section. The main SentiComments.SR corpus was annotated by two annotators working together, and therefore contains a single, unified sentiment label for each comment. The verification corpora were used to evaluate the quality, efficiency, and cost-effectiveness of the annotation framework, which is why they contain separate sentiment labels for six annotators.