AplikaceAplikace
Nastavení

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
en:cnk:syn:verze9 [2021/12/06 16:25] – [Corpus SYN version 8] michalkrenen:cnk:syn:verze9 [2022/06/09 13:35] (current) – jankrivan
Line 1: Line 1:
 ~~NOTOC~~ ~~NOTOC~~
-====== Corpus SYN version 8 ======+====== SYN version 9 ======
  
 <WRAP right 35%> <WRAP right 35%>
 ^ <fs medium>Name</fs> ^^ <fs medium>SYN version 9</fs> ^ ^ <fs medium>Name</fs> ^^ <fs medium>SYN version 9</fs> ^
-^ [[pojmy:atributy_pozicni|Position]] ^ Number of tokens |  5 692 857 521 |  +^ [[pojmy:atributy_pozicni|Position]] ^ Number of tokens |  5 692 729 712 |  
 ^ ::: ^ Number of tokens without punctuation  |  4 719 008 171 |   ^ ::: ^ Number of tokens without punctuation  |  4 719 008 171 |  
-^ ::: ^ Number of [[en:pojmy:word|word forms]]  |  10 844 050 |  +^ ::: ^ Number of [[en:pojmy:word|word forms]]  |  10 843 867 |  
 ^ ::: ^ Number of [[en:pojmy:lemma|lemmas]] |  7 375 002 | ^ ::: ^ Number of [[en:pojmy:lemma|lemmas]] |  7 375 002 |
 ^ [[en:pojmy:atributy_strukturni|Structures]] ^ Number of [[en:pojmy:doc|documents]] |  124 247 | ^ [[en:pojmy:atributy_strukturni|Structures]] ^ Number of [[en:pojmy:doc|documents]] |  124 247 |
Line 20: Line 20:
 The SYN corpus is not [[en:pojmy:reprezentativnost|representative]]; the dominant component is journalism, which is the result of the predominance of journalistic corpora [[en:cnk:syn2006pub|SYN2006PUB]], [[en:cnk:syn2009pub|SYN2009PUB]], [[en:cnk:syn2013pub|SYN2013PUB]] and the journalistic component from the years 2010--2019. The SYN corpus is not [[en:pojmy:reprezentativnost|representative]]; the dominant component is journalism, which is the result of the predominance of journalistic corpora [[en:cnk:syn2006pub|SYN2006PUB]], [[en:cnk:syn2009pub|SYN2009PUB]], [[en:cnk:syn2013pub|SYN2013PUB]] and the journalistic component from the years 2010--2019.
  
-Continuous annual updates of journalistic texts in the SYN-series corpora also had a side effect: many issues of newspapers and magazines that had previously been included into some of the SYN-series corpora versions 5 to 8 had to be re-used also in SYN2020. As a consequence of the non-empty intersection of SYN2020 with older SYN-series corpora, SYN version 9 cannot be a disjunctive unification of all its components. However, all the journalistic texts included into both SYN2020 and some other SYN-series corpora are included only once in SYN version 9.+Continuous annual updates of journalistic texts in the SYN-series corpora also had a side effect: many issues of newspapers and magazines that had previously been included into some of the SYN-series corpora (versions 5 to 8) had to be re-used also in SYN2020. As a consequence of this non-empty intersection of SYN2020 with older SYN-series corpora, SYN version 9 cannot be a disjunctive unification of all its components. However, all the journalistic texts included into both SYN2020 and some other SYN-series corpora are included only once in SYN version 9.
  
 The SYN version 9 corpus is [[en:pojmy:referencni|referential]], and will remain accessible to users even after newer versions have been published. It is however necessary to keep in mind that the linguistic information will become outdated, as a natural result of the referential nature of the corpus. Individual versions of the corpus SYN will continue to be published regularly every year with the addition of current journalistic data, and every new addition will be given the attribute value ''<doc syn>'' equal to the version of the SYN corpus in which the given text first appeared; for example a [[en:pojmy:subkorpus|subcorpus]] corresponding to the above mentioned (as yet unpublished) journalistic component can be [[en:manualy:kontext:subkorpus#vytvoreni_noveho_subkorpusu|created]] from the SYN version 9 with the help of the condition ''syn=<nowiki>"</nowiki>v9<nowiki>"</nowiki>''((Texts from the intersection of SYN2020 with older SYN-series corpora are marked as coming from SYN2020 in this attribute.)). The SYN version 9 corpus is [[en:pojmy:referencni|referential]], and will remain accessible to users even after newer versions have been published. It is however necessary to keep in mind that the linguistic information will become outdated, as a natural result of the referential nature of the corpus. Individual versions of the corpus SYN will continue to be published regularly every year with the addition of current journalistic data, and every new addition will be given the attribute value ''<doc syn>'' equal to the version of the SYN corpus in which the given text first appeared; for example a [[en:pojmy:subkorpus|subcorpus]] corresponding to the above mentioned (as yet unpublished) journalistic component can be [[en:manualy:kontext:subkorpus#vytvoreni_noveho_subkorpusu|created]] from the SYN version 9 with the help of the condition ''syn=<nowiki>"</nowiki>v9<nowiki>"</nowiki>''((Texts from the intersection of SYN2020 with older SYN-series corpora are marked as coming from SYN2020 in this attribute.)).
  
-===== Composition of the corpus SYN version 8 =====+===== Composition of the corpus SYN version 9 =====
  
 ^ <fs medium>Referential written language corpora (synchronic and general) ordered by date of creation</fs> ^^^^^^ ^ <fs medium>Referential written language corpora (synchronic and general) ordered by date of creation</fs> ^^^^^^
 ^ corpus ^ size (words) ^ [[en:pojmy:lemma|lemmatization]] ^ [[en:pojmy:tag|morphological tags]] ^ publication year ^ corpus description ^ ^ corpus ^ size (words) ^ [[en:pojmy:lemma|lemmatization]] ^ [[en:pojmy:tag|morphological tags]] ^ publication year ^ corpus description ^
 +^ [[en:cnk:syn2015|SYN2020]] |  100M  |  ✓  |  ✓  |  2020  | representative corpus, mainly texts from the years 2015–2019 |
 ^ [[en:cnk:syn2015|SYN2015]] |  100M  |  ✓  |  ✓  |  2015  | representative corpus, mainly texts from the years 2010–2014 | ^ [[en:cnk:syn2015|SYN2015]] |  100M  |  ✓  |  ✓  |  2015  | representative corpus, mainly texts from the years 2010–2014 |
 ^ [[en:cnk:syn2013PUB|SYN2013PUB]] |  935M  |  ✓  |  ✓  |  2013  | corpus of journalistic texts from the years 2005–2009 | ^ [[en:cnk:syn2013PUB|SYN2013PUB]] |  935M  |  ✓  |  ✓  |  2013  | corpus of journalistic texts from the years 2005–2009 |
Line 36: Line 37:
 ^ [[en:cnk:syn2000|SYN2000]] |  100M  |  ✓  |  ✓  |  2000  | representative corpus, mainly texts from the years 1990–1999 | ^ [[en:cnk:syn2000|SYN2000]] |  100M  |  ✓  |  ✓  |  2000  | representative corpus, mainly texts from the years 1990–1999 |
  
-==== Journalism in SYN version 8 ====+==== Journalism in SYN version 9 ====
  
-The composition of the journalistic part of the corpus SYN version 8 covers the production of most of the national daily newspapers  (//Mladá fronta DNES, Lidové noviny, Právo, Hospodářské noviny, Blesk, Sport//), regional daily newspapers (chiefly //Deníky Bohemia// and //Moravia// published by Vltava Labe Media) and non-specialized magazines (//Reflex, Respekt, Týden//) from the years 1998--2018; the total number of journalistic titles is almost 200. The following graphs show the composition of the SYN corpus based on the [[en:pojmy:txtype_group|main text types]] over the years and offer a closer look at the composition of the journalistic section. +The composition of the journalistic part of the corpus SYN version 9 covers the production of most of the national daily newspapers  (//Mladá fronta DNES, Lidové noviny, Právo, Hospodářské noviny, Blesk, Sport//), regional daily newspapers (chiefly //Deníky Bohemia// and //Moravia// published by Vltava Labe Media) and non-specialized magazines (//Reflex, Respekt, Týden//) from the years 1998--2019; the total number of journalistic titles is almost 200. The following graphs show the composition of the SYN corpus based on the [[en:pojmy:txtype_group|main text types]] over the years and offer a closer look at the composition of the journalistic section. 
  
-[{{:cnk:syn:slozeni_syn_v8.png?400|Composition of the corpus SYN version 8}}]+[{{:cnk:syn:slozeni_syn_v9.png?400|Composition of the corpus SYN version 9}}]
  
-[{{:cnk:syn:slozeni_syn_v8_pub.png?400|Composition of the journalistic part of the corpus SYN version 8}}]+[{{:cnk:syn:slozeni_syn_v9_pub.png?400|Composition of the journalistic part of the corpus SYN version 9}}]
  
-====== Structure and annotation of the new SYN corpus (v8) ======+====== Structure and annotation of SYN version 9 ====== 
 + 
 +Generally speaking, structure and annotation of SYN version 9 are based on that of the SYN2020 corpus. In particular, hierarchy of structural tags for SYN version 9 has been taken over from SYN2020, as well as the [[en:cnk:syn2020#annotation_of_syn2020changes_compared_to_other_corpora_of_the_syn_series|lemmatization and morphological tagging]]. Please note that **SYN version 9 differs in this from its predecessor, [[en:cnk:syn:verze8|SYN version 8]]**. 
 + 
 +This correspondence of structure and annotation between SYN version 9 and [[en:cnk:syn2020|SYN2020]] only has the following exceptions:
  
-SYN v8 is identical to its predecessors ([[en:cnk:syn:verze7|version 7]], [[en:cnk:syn:verze6|version 6]], [[en:cnk:syn:verze5|version 5]] and [[en:cnk:syn:verze4|version 4]]) as regards its structure and annotation of texts, i.e. it is based on the [[en:cnk:syn2015#struktura_korpusu_a_strukturni_znacky|hierarchy of structural tags]] and their attributes (e.g. ''<opus name>'' was replaced by ''<doc title>''), and also on the [[en:cnk:klasifikace_textu_syn2015|classification of texts]] from [[en:cnk:syn2015|SYN2015]], with these two exceptions: 
   * introducing the additional attribute ''<doc syn>'' for the [[en:cnk:syn#reference_corpora_as_subcorpora_in_syn|creation of subcorpora corresponding to the original reference corpora]];   * introducing the additional attribute ''<doc syn>'' for the [[en:cnk:syn#reference_corpora_as_subcorpora_in_syn|creation of subcorpora corresponding to the original reference corpora]];
-  * replacing [[en:pojmy:syntakticka_analyza|syntactic annotation]] in the corpus SYN2015 with a pilot version of **[[en:seznamy:frazemy|phraseme annotation]]**.+  * replacing [[en:pojmy:syntakticka_analyza|syntactic annotation]] in the SYN2020 corpus with a pilot version of **[[en:seznamy:frazemy|phraseme annotation]]**.
  
-====== How to cite SYN version 8 ======+====== How to cite SYN version 9 ======
  
 <WRAP round tip 70%> <WRAP round tip 70%>
-Křen, M. – Cvrček, V. – Čapka, T. – Čermáková, A. – Hnátková, M. – Chlumská, L. – Jelínek, T. – Kováříková, D. – Petkevič, V. – Procházka, P. – Skoumalová, H. – Škrabal, M. – Truneček, P. – Vondřička, P. – Zasina, A.: //Corpus SYN, version 8 from 12. 12. 2019//. Ústav Českého národního korpusu FF UK, Praha 2019. Available online: http://www.korpus.cz.+Křen, M. – Cvrček, V. – Henyš, J. – Hnátková, M. – Jelínek, T. – Kocek, J. – Kováříková, D. – Křivan, J. – Milička, J. – Petkevič, V. – Procházka, P. – Skoumalová, H. – Šindlerová, J. – Škrabal, M.: //Corpus SYN, version 9 from 5. 12. 2021//. Ústav Českého národního korpusu FF UK, Praha 2021. Available online: https://www.korpus.cz.
  
  
 Hnátková, M. – Křen, M. – Procházka, P. – Skoumalová, H. (2014): [[http://www.lrec-conf.org/proceedings/lrec2014/pdf/294_Paper.pdf|The SYN-series corpora of written Czech]]. In //Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)//, 160–164. Reykjavík: ELRA. ISBN 978-2-9517408-8-4.  Hnátková, M. – Křen, M. – Procházka, P. – Skoumalová, H. (2014): [[http://www.lrec-conf.org/proceedings/lrec2014/pdf/294_Paper.pdf|The SYN-series corpora of written Czech]]. In //Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)//, 160–164. Reykjavík: ELRA. ISBN 978-2-9517408-8-4. 
 +
 +Jelínek, T. – Křivan, J. – Petkevič, V. – Skoumalová, H. – Šindlerová, J. (2021): [[https://doi.org/10.1007/978-3-030-83527-9_4|SYN2020: A new corpus of Czech with an innovated annotation]]. In: K. Ekštein – F. Pártl – M. Konopík (eds.), //Text, Speech, and Dialogue.// TSD 2021. Lecture Notes in Computer Science, vol. 12848. Cham: Springer, 48–59.
 +
 +Křivan, J. – Šindlerová, J. (2022): [[http://sas.ujc.cas.cz/archiv.php?lang=en&art=4508|Změny v morfologické anotaci korpusů řady SYN: nové možnosti zkoumání české gramatiky a lexikonu]]. //Slovo a slovesnost//, 83, 2/2022, 122–145.
 +
 </WRAP> </WRAP>
  
Line 64: Line 73:
 ====== Related links ====== ====== Related links ======
 <WRAP round box 50%> <WRAP round box 50%>
-[[en:cnk:syn|SYN]] • [[en:cnk:syn:verze4|SYN version 5]] • [[en:cnk:syn:verze4|SYN version 4]] • [[en:cnk:syn:verze3|SYN version 3]] • [[en:cnk:syn2000|SYN2000]] • [[en:cnk:syn2005|SYN2005]] • [[en:cnk:syn2006pub|SYN2006PUB]] • [[en:cnk:syn2009pub|SYN2009PUB]] • [[en:cnk:syn2010|SYN2010]] • [[en:cnk:SYN2013PUB|SYN2013PUB]] • [[en:cnk:syn2015|SYN2015]]+[[en:cnk:syn|SYN]] • [[en:cnk:syn:verze9|SYN version 9]] • [[en:cnk:syn:verze8|SYN version 8]] • [[en:cnk:syn:verze7|SYN version 7]] • [[en:cnk:syn:verze6|SYN version 6]] • [[en:cnk:syn:verze5|SYN version 5]] • [[en:cnk:syn:verze4|SYN version 4]] • [[en:cnk:syn:verze3|SYN version 3]] • [[en:cnk:syn2000|SYN2000]] • [[en:cnk:syn2005|SYN2005]] • [[en:cnk:syn2006pub|SYN2006PUB]] • [[en:cnk:syn2009pub|SYN2009PUB]] • [[en:cnk:syn2010|SYN2010]] • [[en:cnk:SYN2013PUB|SYN2013PUB]] • [[en:cnk:syn2015|SYN2015]] • [[en:cnk:syn2020|SYN2020]]
  
 </WRAP> </WRAP>
  

Trace: