AplikaceAplikace
Nastavení

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
en:cnk:intercorp:historie [2026/09/29 23:16] – [Release 17ud] rosenen:cnk:intercorp:historie [2026/09/30 21:14] (current) – [Release 17ud] rosen
Line 1: Line 1:
-====== InterCorp: Version history ======+======= InterCorp: Version history =======
  
 ===== Release 17ud ===== ===== Release 17ud =====
  
-released on 9 September 2026 (pilot version)+  * Released on 9 September 2026 (pilot version) 
 +  * [[https://wiki.korpus.cz/doku.php/en:cnk:intercorp:verze17ud|Information about the corpus]]
  
 == Data: == == Data: ==
  
   * **New books** in the Core: 40 new Czech titles (1852 in total), 214 new titles across all languages (6669 in total)   * **New books** in the Core: 40 new Czech titles (1852 in total), 214 new titles across all languages (6669 in total)
-  * The new [[https://jakobson.korpus.cz/~rosen/INTERCORP/ICv17ud/intercorp-tools-static/index.html|InterCorp Tools]] serve as a **guide to InterCorp**, providing a wide range of information about the corpus and replacing the tables and charts included in the documentation of previous versions; they also include a Hall of Fame listing everyone who contributed to the preparation of new texts for the InterCorp Core in version 17ud+  * The new [[https://jakobson.korpus.cz/~rosen/INTERCORP/ICv17ud/intercorp-tools-static/index.html|InterCorp Tools]] serve as a **guide to InterCorp**, providing a wide range of information about the corpus and replacing the tables and charts included in the documentation of previous versions; they also include a Hall of Fame listing everyone who contributed to the preparation of new texts for the InterCorp Core release 17ud
   * New language: **Kashubian** (code ''cb'', currently 2 books in the Core)   * New language: **Kashubian** (code ''cb'', currently 2 books in the Core)
   * New text collection: **[[https://www.ted.com|TED Talks]]** -- 1383 talk transcripts in Czech, i.e. 2.4 million positions; 39,374 transcripts across all languages, i.e. 28.9 million positions   * New text collection: **[[https://www.ted.com|TED Talks]]** -- 1383 talk transcripts in Czech, i.e. 2.4 million positions; 39,374 transcripts across all languages, i.e. 28.9 million positions
Line 16: Line 17:
 == Annotation: == == Annotation: ==
  
-  * This is the first version available exclusively with linguistic annotation based on **Universal Dependencies**+  * This is the first release available exclusively with linguistic annotation based on **Universal Dependencies**
   * In Slavic and Romance languages, multiword verb forms are now also annotated using the positional attribute ''cw_feats'' – **content-word features** ([[pojmy:content-word features|cw_feats]])   * In Slavic and Romance languages, multiword verb forms are now also annotated using the positional attribute ''cw_feats'' – **content-word features** ([[pojmy:content-word features|cw_feats]])
-  * In the Core, **authors** are now also identified by a name that is consistent across languages (text attribute ''rf_author'')+  * In the Core, **authors** are now also identified by a name that is consistent across languages (attribute ''text.rf_author'')
   * The positional attributes useful for navigating syntactic structure have been extended with references to the **word form of the head**: ''p_word'' (parent word form) and ''e_word'' (effective parent word form)   * The positional attributes useful for navigating syntactic structure have been extended with references to the **word form of the head**: ''p_word'' (parent word form) and ''e_word'' (effective parent word form)
   * **Literature for children and young adults**, previously identified as ''text.txtype=children's lit.'', is now identified as ''text.audience=jun''; for other texts, this attribute has the value ''gen''; the ''text.txtype'' attribute can thus be used to distinguish text types (''fiction'', ''poetry'', ''drama'', ''non-fiction'')   * **Literature for children and young adults**, previously identified as ''text.txtype=children's lit.'', is now identified as ''text.audience=jun''; for other texts, this attribute has the value ''gen''; the ''text.txtype'' attribute can thus be used to distinguish text types (''fiction'', ''poetry'', ''drama'', ''non-fiction'')
-  * **Newer language models** from [[https://lindat.mff.cuni.cz/services/udpipe/|UDPipe]] (ud-2.17) were used for linguistic annotation; Chinese alone is annotated using [[https://trankit.readthedocs.io/|Trankit]] for better results (thanks to Benjamin David Reeves and Pavel Straňák, ÚFAL MFF UK)+  * **Newer language models** from [[https://lindat.mff.cuni.cz/services/udpipe/|UDPipe]] (ud-2.17) were used for linguistic annotation; Chinese alone is annotated using [[https://trankit.readthedocs.io/|Trankit]] for better results (thanks to [[https://cz.linkedin.com/in/benjamin-reeves-|Benjamin David Reeves]] and [[https://ufal.mff.cuni.cz/pavel-stranak|Pavel Straňák]])
   * New **segmentation and alignment tools** were used to prepare the TED Talks collection ([[https://github.com/thompsonb/vecalign|Vecalign]])   * New **segmentation and alignment tools** were used to prepare the TED Talks collection ([[https://github.com/thompsonb/vecalign|Vecalign]])
  
Line 31: Line 32:
 == Bug fixes: == == Bug fixes: ==
  
-  * **Author names** were not given consistently for some texts within the same language (text attribute ''author'')+  * **Author names** were not given consistently for some texts within the same language (attribute ''text.author'')
   * In languages written in **Cyrillic**, characters visually identical to Latin characters were sometimes incorrectly encoded as Latin; we have managed to eliminate most of these errors   * In languages written in **Cyrillic**, characters visually identical to Latin characters were sometimes incorrectly encoded as Latin; we have managed to eliminate most of these errors
-  * A number of texts were not identified as **literature for children and young adults**; this has been corrected in connection with moving this information to the new ''audience'' attribute; the number of texts identified as such has increased from 5 to 122+  * A number of texts were not identified as **literature for children and young adults**; this has been corrected in connection with moving this information to the new ''text.audience'' attribute; the number of texts identified as such has increased from 5 to 122
   * Due to minor corrections in the way **syntactic complexity and lexical diversity** are aggregated for individual texts, text types and languages, the aggregate values of these measures may in some cases differ slightly from the previous version even when the corpus content has not changed   * Due to minor corrections in the way **syntactic complexity and lexical diversity** are aggregated for individual texts, text types and languages, the aggregate values of these measures may in some cases differ slightly from the previous version even when the corpus content has not changed
  

Trace: • atributy_pozicni • calc • asociacni_miry • arf • eparent • akalex • frazem • meet • idiom • korpusdb