en:cnk:online:gen2 - Příručka ČNK

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
~~NOTOC~~
====== ONLINE2 (2nd generation) ======

ONLINE2_NOW and ONLINE2_ARCHIVE are two corpora which together create a monitor corpus ([[en:cnk:online|ONLINE]]) of the dynamic content of the Czech web, i.e. internet journalism. The span of the corpus is since April 2021 till the present. It has been created at the CNC with the help of the data kindly provided by the [[https://monitora.cz/|Mopnitora]] company.

Both corpora differ in their extent and periodicity of updates:
  * **ONLINE2_NOW** -- contains daily updates from the current month plus 6 preceding months; updated daily
  * **ONLINE2_ARCHIVE** -- contains data since April 2021 until the date when ONLINE_NOW begins; updated every month

<WRAP right 35%>
^ <fs medium>Name</fs> ^^ <fs medium>ONLINE2</fs> ^
^ Size (as of Dec 2022) ^ Number of tokens |  866 million |  
^ ::: ^ Number of sentences <s> |  52.2 million |
^ Additional information ^ Reference |  NO |  
^ ::: ^ Representative |  NO |  
^ ::: ^ Period covered |  since April 2021 |
^ ::: ^ Year of publication |  2020 |
</WRAP>

The ONLINE_NOW and ONLINE_ARCHIVE corpora (as well as the [[en:cnk:online:gen1|ONLINE1]]) are disjunctive, i.e. there is no intersection. Therefore, for searching in the whole time period since 2017, the results of queries on both corpora can simply be joined together, no manual corrections are needed. As both corpora are identical in their structure and annotation, the following description does not distinguish between them.

==== Updates ====

The key feature of the ONLINE corpora are regular updates. This means that their contents **change continually**, and it is thus not possible to get back to previous versions of the corpora. Given that the input data (sources) can change, there is no guarantee that the structure as well as the annotation of the ONLINE corpus will remain the same. If you need an invariable reference corpus for the research of the specifics of internet communication, you can make use of the [[en:cnk:net|korpus NET]] corpus.

Updates of the ONLINE2_NOW corpus take place **daily in the morning**, when the data from the previous day is added and published. The amount of the updates varies (depending on the size of the downloaded material) from 0.8 to 1.5 million tokens. On the first day of every month, the oldest month of the ONLINE2_NOW corpus is moved to ONLINE2_ARCHIVE.

Updates of the ONLINE2_ARCHIVE corpus thus takes place **every month**, when there is a whole month removed from ONLINE2_NOW and added to ONLINE2_ARCHIVE (it is always the month that us actually a half year old).

For instance, on Aug 25, ONLINE_NOW contains data from Feb 1 until Aug 24 (inclusive), i.e. all the days of the current month except for the current day + 6 whole preceding months. ONLINE_ARCHIVE contains all the older data up until Jan 31, i.e. by the date when ONLINE_NOW begins. A change will come on Sep 2, when the data from the whole February will be moved from ONLINE_NOW to ONLINE_ARCHIVE, and subsequently, the updated ONLINE_NOW corpus will contain data from Mar 1 until Sep 1 (inclusive).



===== Corpus structure =====

Compared to the [[en:cnk:syn|SYN-series]] corpora of written Czech, the ONLINE2 corpus has several specific features. For backward compatibility with the previous generation, we keep the ''source'' attribute in the data, which indicates what type of internet data it is. The second generation of the corpus consists solely of online journalism therefore the value of this attribute is always **news**.

Texts from one day are joined together into a single document (''<doc>'' structure) based on their original web-portal (''resource'' attribute). Within this structure, the individual articles are divided into separate structures (''<text>''). For instance, all the articles issued in one day at the [[https://burzovnisvet.cz/|burzovnisvet.cz]] portal are joined together into a single ''<doc>'' structure while keeping them in separate ''<text>'' structures.



===== Text classification =====

The text classification of the ONLINE corpora is based on [[en:cnk:klasifikace_textu_syn2015|the classification designed for SYN2015]], while enriching it with some additional attributes. Common attributes: [[en:seznamy:txtype_group|txtype_group]], [[en:seznamy:txtype|txtype]], [[en:seznamy:genre_group|genre_group]], [[en:seznamy:genre|genre]], [[en:seznamy:med|medium]], pubyear (publication year). Additional attributes are: date (when published), source, resource, resource_url, media_type and subject (text title).


==== resource ====

More detailed specification of the source, typically a web portal, a concrete URL is given in ''text_url'' that is available as an attribute of the ''text'' structures. 


==== media_type ====

The ''media_type'' attribute is relevant only for the web news (source: ''news'') and it gives their classification based on the typology elaborated by the team of J. Šlerka within the [[http://www.mapamedii.cz|Media map]] project. The classification is based on the readers' preferences by joining together news portals with similar audience. For the ONLINE corpus, the original classification has been enriched by some rather marginal categories and it distinguishes the following types:

  * Analyticko-investigativní (analytical-investigative)
  * Antisystémové weby (anti-system media)
  * Bulvární media (tabloid media)
  * Hlavní proud (mainstream)
  * Market-driven media (market-driven media)
  * Názorové deníky (opinion-based media)
  * Ostatní (other)
  * Politický bulvár (political tabloids)
  * Stranické weby (party sites)
  * Web instituce (institution sites)

==== duplicate ====

Atribut ''text.duplicate'' (dostupný pouze v 2. generaci) udává, zda je text duplikátem jiného textu v korpusu. Taková situace se u dat tohoto typu stává poměrně často v důsledku přejímání zpráv mezi tiskovými agenturami a jednotlivými tituly. Pokud se chceme vyhnout zkreslení, které je dáno takovýmito textovými duplicitami, můžeme použít dotaz s podmínkou [[pojmy:within|within]], která zaručí, že se ve výsledku objeví duplicitní texty jenom v jednou. 




===== Annotation =====

The corpus is annotated using standard tools for the [[en:pojmy:morfologicka_analyza|morphological analysis]] and [[en:pojmy:lemma|lemmatization]] of the SYN-series corpora. The annotation is thus comparable e.g. with the [[en:cnk:syn2015|SYN2015]] corpus.

====== How to cite ONLINE ======

<WRAP round tip 70%>
Cvrček, V. – Jeziorský, T. – Henyš, J.: //ONLINE2_NOW: monitoring corpus of online Czech//. Ústav Českého národního korpusu FF UK, Praha 2022 [cit. YYYY-MM-DD((Concrete day in the year-month-day format, e.g. 2020-10-02.))]. Available from: http://www.korpus.cz

Cvrček, V. – Jeziorský, T. – Henyš, J.: //ONLINE2_ARCHIVE: monitoring corpus of online Czech//. Ústav Českého národního korpusu FF UK, Praha 2022 [accessed YYYY-MM-DD]. Available from: http://www.korpus.cz
</WRAP>
Trace: • prototypicnost • precision • referencni • syntakticka_analyza • klasifikace_textu_syn2015 • regularni_vyrazy • zobrazeni_dotazu • bundles • archivhlasek • verze13ud