AplikaceAplikace
Nastavení

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
en:cnk:syn:verze5 [2017/04/25 18:14] – [Corpus SYN version 5] Michal Křenen:cnk:syn:verze5 [2017/04/26 16:33] (current) – [Composition of the corpus SYN version 5] Michal Křen
Line 5: Line 5:
 ^ <fs medium>Name</fs> ^^ <fs medium>SYN version 4</fs> ^ ^ <fs medium>Name</fs> ^^ <fs medium>SYN version 4</fs> ^
 ^ [[pojmy:atributy_pozicni|Position]] ^ Number of tokens |  4 599 643 984 |   ^ [[pojmy:atributy_pozicni|Position]] ^ Number of tokens |  4 599 643 984 |  
-^ ::: ^ Number of tokens without punctuation  |  3 626 417 275 FIXME |  +^ ::: ^ Number of tokens without punctuation  |  3 836 208 873 |  
 ^ ::: ^ Number of [[en:pojmy:word|word forms]]  |  10 925 890 |   ^ ::: ^ Number of [[en:pojmy:word|word forms]]  |  10 925 890 |  
 ^ ::: ^ Number of [[en:pojmy:lemma|lemmas]] |  7 770 263 | ^ ::: ^ Number of [[en:pojmy:lemma|lemmas]] |  7 770 263 |
Line 16: Line 16:
 </WRAP> </WRAP>
  
-Every **SYN corpus** contains all the [[en:pojmy:synchronni|synchronic]] [[en:pojmy:psany|written]] corpora of the [[en:cnk:syn|SYN]] series published up until the time of the given version's publication. The corpus SYN version 5 therefore contains the corpora  [[en:cnk:syn2000|SYN2000]], [[en:cnk:syn2005|SYN2005]], [[en:cnk:syn2006pub|SYN2006PUB]], [[en:cnk:syn2009pub|SYN2009PUB]], [[en:cnk:syn2010|SYN2010]],[[en:cnk:syn2013pub|SYN2013PUB]] and [[cnk:syn2015|SYN2015]]; additionally, it contains a journalistic component predominantly from the years 2010–2014 (already included into [[en:cnk:syn:verze4|SYN version 4]]) and **previously unpublished journalistic texts from 2015** in yearly volume exceeding 200 mil. words.+Every **SYN corpus** contains all the [[en:pojmy:synchronni|synchronic]] [[en:pojmy:psany|written]] corpora of the [[en:cnk:syn|SYN]] series published up until the time of the given version's publication. The corpus SYN version 5 therefore contains the corpora  [[en:cnk:syn2000|SYN2000]], [[en:cnk:syn2005|SYN2005]], [[en:cnk:syn2006pub|SYN2006PUB]], [[en:cnk:syn2009pub|SYN2009PUB]], [[en:cnk:syn2010|SYN2010]],[[en:cnk:syn2013pub|SYN2013PUB]] and [[cnk:syn2015|SYN2015]]; additionally, it contains a journalistic component predominantly from the years 2010–2014 (already included into [[en:cnk:syn:verze4|SYN version 4]]) and as yet **unpublished journalistic texts from 2015** in yearly volume exceeding 200 mil. words.
  
-Because all of these corpora are **disjunctive** (i.e. they do not contain the same texts), the total size of the SYN version 5 is given by their sum, which makes 3,626 FIXME billion words ([[en:pojmy:token|tokens]] without punctuation). The SYN corpus is not [[en:pojmy:reprezentativnost|representative]]; the dominant component is journalism, which is the result of the predominance of journalistic corpora [[en:cnk:syn2006pub|SYN2006PUB]], [[en:cnk:syn2009pub|SYN2009PUB]], [[en:cnk:syn2013pub|SYN2013PUB]] and the journalistic component from the years 2010–2015.+Because all of these corpora are **disjunctive** (i.e. they do not contain the same texts), the total size of the SYN version 5 is given by their sum, which makes 3,836 billion words ([[en:pojmy:token|tokens]] without punctuation). The SYN corpus is not [[en:pojmy:reprezentativnost|representative]]; the dominant component is journalism, which is the result of the predominance of journalistic corpora [[en:cnk:syn2006pub|SYN2006PUB]], [[en:cnk:syn2009pub|SYN2009PUB]], [[en:cnk:syn2013pub|SYN2013PUB]] and the journalistic component from the years 2010–2015.
  
 The SYN version 5 corpus is [[en:pojmy:referencni|referential]], and will remain accessible to users even after newer versions have been published. It is however necessary to keep in mind that the linguistic information will become outdated, as a natural result of the referential nature of the corpus. Individual versions of the corpus SYN will continue to be published regularly every year with the addition of current journalistic data, and every new addition will be given the attribute value ''<doc syn>'' equal to the version of the SYN corpus in which the given text first appeared; for example a [[en:pojmy:subkorpus|subcorpus]] corresponding to the above mentioned (as yet unpublished) journalistic component can be [[en:manualy:kontext:subkorpus#vytvoreni_noveho_subkorpusu|created]] from the SYN version 5 with the help of the condition ''syn=<nowiki>"</nowiki>v5<nowiki>"</nowiki>''. The SYN version 5 corpus is [[en:pojmy:referencni|referential]], and will remain accessible to users even after newer versions have been published. It is however necessary to keep in mind that the linguistic information will become outdated, as a natural result of the referential nature of the corpus. Individual versions of the corpus SYN will continue to be published regularly every year with the addition of current journalistic data, and every new addition will be given the attribute value ''<doc syn>'' equal to the version of the SYN corpus in which the given text first appeared; for example a [[en:pojmy:subkorpus|subcorpus]] corresponding to the above mentioned (as yet unpublished) journalistic component can be [[en:manualy:kontext:subkorpus#vytvoreni_noveho_subkorpusu|created]] from the SYN version 5 with the help of the condition ''syn=<nowiki>"</nowiki>v5<nowiki>"</nowiki>''.
Line 26: Line 26:
 ^ <fs medium>Referential written language corpora (synchronic and general) ordered by date of creation</fs> ^^^^^^ ^ <fs medium>Referential written language corpora (synchronic and general) ordered by date of creation</fs> ^^^^^^
 ^ corpus ^ size (words) ^ [[en:pojmy:lemma|lemmatization]] ^ [[en:pojmy:tag|morphological tags]] ^ publication year ^ corpus description ^ ^ corpus ^ size (words) ^ [[en:pojmy:lemma|lemmatization]] ^ [[en:pojmy:tag|morphological tags]] ^ publication year ^ corpus description ^
-^ ??? FIXME | 100M FIXME |  ✓  |  ✓  |  2017  | corpus of journalistic texts from the year 2015 | +^ [[en:cnk:syn2015|SYN2015]] |  100M  |  ✓  |  ✓  |  2015  | representative corpus, mainly texts from the years 2010–2014 | 
-^ [[en:cnk:syn2015|SYN2015]] | 100M |  ✓  |  ✓  |  2015  | representative corpus, mainly texts from the years 2010–2014 | +^ [[en:cnk:syn2013PUB|SYN2013PUB]] |  935M  |  ✓  |  ✓  |  2013  | corpus of journalistic texts from the years 2005–2009 | 
-^ [[en:cnk:syn2013PUB|SYN2013PUB]] | 935M |  ✓  |  ✓  |  2013  | corpus of journalistic texts from the years 2005–2009 | +^ [[en:cnk:syn2010|SYN2010]] |  100M  |  ✓  |  ✓  |  2010  | representative corpus, mainly texts from the years 2005–2009| 
-^ [[en:cnk:syn2010|SYN2010]] | 100M |  ✓  |  ✓  |  2010  | representative corpus, mainly texts from the years 2005–2009| +^ [[en:cnk:syn2009PUB|SYN2009PUB]] |  700M  |  ✓  |  ✓  |  2010  | corpus of journalistic texts from the years 1995–2007 | 
-^ [[en:cnk:syn2009PUB|SYN2009PUB]] | 700M |  ✓  |  ✓  |  2010  | corpus of journalistic texts from the years 1995–2007 | +^ [[en:cnk:syn2006PUB|SYN2006PUB]] |  300M  |  ✓  |  ✓  |  2006  | corpus of journalistic texts from the years 1989–2004 | 
-^ [[en:cnk:syn2006PUB|SYN2006PUB]] | 300M |  ✓  |  ✓  |  2006  | corpus of journalistic texts from the years 1989–2004 | +^ [[en:cnk:syn2005|SYN2005]] |  100M  |  ✓  |  ✓  |  2005  | representative corpus, mainly texts from the years  2000–2004 | 
-^ [[en:cnk:syn2005|SYN2005]] | 100M |  ✓  |  ✓  |  2005  | representative corpus, mainly texts from the years  2000–2004 | +^ [[en:cnk:syn2000|SYN2000]] |  100M  |  ✓  |  ✓  |  2000  | representative corpus, mainly texts from the years 1990–1999 |
-^ [[en:cnk:syn2000|SYN2000]] | 100M |  ✓  |  ✓  |  2000  | representative corpus, mainly texts from the years 1990–1999 |+
  
 ==== Journalism in SYN version 5 ==== ==== Journalism in SYN version 5 ====
  
  
-The composition of the journalistic part of the corpus SYN version 5 covers the production of most of the national daily newspapers  (//Mladá fronta DNES, Lidové noviny, Právo, Hospodářské noviny, Blesk, Sport//), regional daily newspapers (chiefly //Deníky Bohemia// and //Moravia// published by Vltava Labe Media) and non-specialized magazines (//Reflex, Respekt, Týden//) from the years 1998--2014; the total number of journalistic titles is 176 FIXME. The following graphs show the composition of the SYN corpus based on the [[en:pojmy:txtype_group|main text types]] over the years and offer a closer look at the composition of the journalistic section. +The composition of the journalistic part of the corpus SYN version 5 covers the production of most of the national daily newspapers  (//Mladá fronta DNES, Lidové noviny, Právo, Hospodářské noviny, Blesk, Sport//), regional daily newspapers (chiefly //Deníky Bohemia// and //Moravia// published by Vltava Labe Media) and non-specialized magazines (//Reflex, Respekt, Týden//) from the years 1998--2014; the total number of journalistic titles is 176. The following graphs show the composition of the SYN corpus based on the [[en:pojmy:txtype_group|main text types]] over the years and offer a closer look at the composition of the journalistic section. 
  
-[{{:cnk:slozeni_syn_v4.png?400|Composition of the corpus SYN version 5}}]+[{{:cnk:slozeni_syn_v5.png?400|Composition of the corpus SYN version 5}}]
  
-[{{:cnk:slozeni_syn_v4_pub.png?400|Composition of the journalistic part of the corpus SYN version 5}}] +[{{:cnk:slozeni_syn_v5_pub.png?400|Composition of the journalistic part of the corpus SYN version 5}}]
- +
-FIXME+
  
 ====== Structure and annotation of the corpus SYN version 5 ====== ====== Structure and annotation of the corpus SYN version 5 ======
Line 57: Line 54:
  
 <WRAP round tip 70%> <WRAP round tip 70%>
-Křen, M. – Cvrček, V. – Čapka, T. – Čermáková, A. – Hnátková, M. – Chlumská, L. – Jelínek, T. – Kováříková, D. – Petkevič, V. – Procházka, P. – Skoumalová, H. – Škrabal, M. – Truneček, P. – Vondřička, P. – Zasina, A.: Corpus SYN, verze 5 z 24. 4. 2017. Ústav Českého národního korpusu FF UK, Praha 2016. Available online: http://www.korpus.cz.+Křen, M. – Cvrček, V. – Čapka, T. – Čermáková, A. – Hnátková, M. – Chlumská, L. – Jelínek, T. – Kováříková, D. – Petkevič, V. – Procházka, P. – Skoumalová, H. – Škrabal, M. – Truneček, P. – Vondřička, P. – Zasina, A.: Corpus SYN, version 5 from 24. 4. 2017. Ústav Českého národního korpusu FF UK, Praha 2017. Available online: http://www.korpus.cz.
  
  
 Hnátková, M. – Křen, M. – Procházka, P. – Skoumalová, H. (2014): [[http://www.lrec-conf.org/proceedings/lrec2014/pdf/294_Paper.pdf|The SYN-series corpora of written Czech]]. In //Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)//, 160–164. Reykjavík: ELRA. ISBN 978-2-9517408-8-4.  Hnátková, M. – Křen, M. – Procházka, P. – Skoumalová, H. (2014): [[http://www.lrec-conf.org/proceedings/lrec2014/pdf/294_Paper.pdf|The SYN-series corpora of written Czech]]. In //Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)//, 160–164. Reykjavík: ELRA. ISBN 978-2-9517408-8-4. 
- 
-FIXME nechat, též podle cz verze? 
 </WRAP> </WRAP>
- 
  
  
Line 71: Line 65:
 ====== Related links ====== ====== Related links ======
 <WRAP round box 50%> <WRAP round box 50%>
-[[en:cnk:syn|SYN]] • [[en:cnk:syn:verze3|SYN version 3]] • [[en:cnk:syn2000|SYN2000]] • [[en:cnk:syn2005|SYN2005]] • [[en:cnk:syn2006pub|SYN2006PUB]] • [[en:cnk:syn2009pub|SYN2009PUB]] • [[en:cnk:syn2010|SYN2010]] • [[en:cnk:SYN2013PUB|SYN2013PUB]] • [[en:cnk:syn2015|SYN2015]]+[[en:cnk:syn|SYN]] • [[en:cnk:syn:verze4|SYN version 4]] • [[en:cnk:syn:verze3|SYN version 3]] • [[en:cnk:syn2000|SYN2000]] • [[en:cnk:syn2005|SYN2005]] • [[en:cnk:syn2006pub|SYN2006PUB]] • [[en:cnk:syn2009pub|SYN2009PUB]] • [[en:cnk:syn2010|SYN2010]] • [[en:cnk:SYN2013PUB|SYN2013PUB]] • [[en:cnk:syn2015|SYN2015]]
  
 </WRAP> </WRAP>
  

Trace: