Monitor corpus ONLINE1 (1st generation) strives to map the dynamic content of the Czech web, i.e. internet journalism, discussions, forums and social networks. The span of the corpus is since 2017 till March 2021. It has been created at the CNC with the help of the data kindly provided by the Dataweps company. ONLINE1 is no longer being updated, following time period is covered by the 2nd generation: ONLINE2.
Name | ONLINE1 | |
---|---|---|
Size | Number of tokens | 7.053 billion |
Number of sentences <s> | 563 million | |
Additional information | Reference | NO |
Representative | NO | |
Period covered | 1/2017 – 3/2021 | |
Year of publication | 2020 |
Compared to the SYN-series corpora of written Czech, the ONLINE1 corpus has several specific features. The data come from several sources (cf. the source
attribute):
These sources differ also in their processing. The internet news from one day are joined together into a single document (<doc>
structure) based on their original web-portal (resource
attribute). Within this structure, the individual articles are divided into separate structures (<text>
). For instance, all the articles issued in one day at the zatecky.denik.cz portal are joined together into a single <doc>
structure while keeping them in separate <text>
structures.
All other sources are structured differently. All-day content of the whole source constitutes a single document (<doc>
), i.e. one <doc>
for discussions, one for forums and one for every social network. The individual contributions within these documents have separate <text>
structure.
The text classification of the ONLINE corpora is based on the classification designed for SYN2015, while enriching it with some additional attributes. Common attributes: txtype_group, txtype, genre_group, genre, medium, pubyear (publication year). Additional attributes are: date (when published), source, resource, resource_url, media_type and subject (text title).
Source of the data – general classification that distinguishes news from discussions and social networks (see above).
More detailed specification of the source, typically a web portal (concrete URL is given in resource_url
that is available as an attribute of the text
structures). The value of resource
depends on the source
:
<doc>
): original web portal or its part, e.g. blesk-cz, seznamzpravy etc.<text>
): author (possibly a username) of the indiviual post or comment<text>
): original news portal of the discussion, e.g. novinky, zpravy.aktualne-cz<text>
): original web forum, e.g. diskuze.modnipeklo-cz, emimino
The media_type
attribute is relevant only for the web news (source: news
) and it gives their classification based on the typology elaborated by the team of J. Šlerka within the Media map project. The classification is based on the readers' preferences by joining together news portals with similar audience (see detailed description of the method). For the ONLINE corpus, the original classification has been enriched by some rather marginal categories and it distinguishes the following types:
The corpus is annotated using standard tools for the morphological analysis and lemmatization of the SYN-series corpora. The annotation is thus comparable e.g. with the SYN2015 corpus.
Cvrček, V. – Procházka, P.: ONLINE1: monitoring corpus of online Czech. Ústav Českého národního korpusu FF UK, Praha 2020. Available from: http://www.korpus.cz