AplikaceAplikace
Nastavení

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
en:cnk:intercorp:historie [2026/09/29 23:26] – [Release 17ud] rosenen:cnk:intercorp:historie [2026/09/30 21:14] (current) – [Release 17ud] rosen
Line 1: Line 1:
-====== InterCorp: Version history ======+======= InterCorp: Version history =======
  
 ===== Release 17ud ===== ===== Release 17ud =====
  
-released on 9 September 2026 (pilot version)+  * Released on 9 September 2026 (pilot version) 
 +  * [[https://wiki.korpus.cz/doku.php/en:cnk:intercorp:verze17ud|Information about the corpus]]
  
 == Data: == == Data: ==
Line 16: Line 17:
 == Annotation: == == Annotation: ==
  
-  * This is the first version available exclusively with linguistic annotation based on **Universal Dependencies**+  * This is the first release available exclusively with linguistic annotation based on **Universal Dependencies**
   * In Slavic and Romance languages, multiword verb forms are now also annotated using the positional attribute ''cw_feats'' – **content-word features** ([[pojmy:content-word features|cw_feats]])   * In Slavic and Romance languages, multiword verb forms are now also annotated using the positional attribute ''cw_feats'' – **content-word features** ([[pojmy:content-word features|cw_feats]])
-  * In the Core, **authors** are now also identified by a name that is consistent across languages (text attribute ''rf_author'')+  * In the Core, **authors** are now also identified by a name that is consistent across languages (attribute ''text.rf_author'')
   * The positional attributes useful for navigating syntactic structure have been extended with references to the **word form of the head**: ''p_word'' (parent word form) and ''e_word'' (effective parent word form)   * The positional attributes useful for navigating syntactic structure have been extended with references to the **word form of the head**: ''p_word'' (parent word form) and ''e_word'' (effective parent word form)
   * **Literature for children and young adults**, previously identified as ''text.txtype=children's lit.'', is now identified as ''text.audience=jun''; for other texts, this attribute has the value ''gen''; the ''text.txtype'' attribute can thus be used to distinguish text types (''fiction'', ''poetry'', ''drama'', ''non-fiction'')   * **Literature for children and young adults**, previously identified as ''text.txtype=children's lit.'', is now identified as ''text.audience=jun''; for other texts, this attribute has the value ''gen''; the ''text.txtype'' attribute can thus be used to distinguish text types (''fiction'', ''poetry'', ''drama'', ''non-fiction'')
-  * **Newer language models** from [[https://lindat.mff.cuni.cz/services/udpipe/|UDPipe]] (ud-2.17) were used for linguistic annotation; Chinese alone is annotated using [[https://trankit.readthedocs.io/|Trankit]] for better results (thanks to Benjamin David Reeves and Pavel Straňák, ÚFAL MFF UK)+  * **Newer language models** from [[https://lindat.mff.cuni.cz/services/udpipe/|UDPipe]] (ud-2.17) were used for linguistic annotation; Chinese alone is annotated using [[https://trankit.readthedocs.io/|Trankit]] for better results (thanks to [[https://cz.linkedin.com/in/benjamin-reeves-|Benjamin David Reeves]] and [[https://ufal.mff.cuni.cz/pavel-stranak|Pavel Straňák]])
   * New **segmentation and alignment tools** were used to prepare the TED Talks collection ([[https://github.com/thompsonb/vecalign|Vecalign]])   * New **segmentation and alignment tools** were used to prepare the TED Talks collection ([[https://github.com/thompsonb/vecalign|Vecalign]])
  
Line 31: Line 32:
 == Bug fixes: == == Bug fixes: ==
  
-  * **Author names** were not given consistently for some texts within the same language (text attribute ''author'')+  * **Author names** were not given consistently for some texts within the same language (attribute ''text.author'')
   * In languages written in **Cyrillic**, characters visually identical to Latin characters were sometimes incorrectly encoded as Latin; we have managed to eliminate most of these errors   * In languages written in **Cyrillic**, characters visually identical to Latin characters were sometimes incorrectly encoded as Latin; we have managed to eliminate most of these errors
-  * A number of texts were not identified as **literature for children and young adults**; this has been corrected in connection with moving this information to the new ''audience'' attribute; the number of texts identified as such has increased from 5 to 122+  * A number of texts were not identified as **literature for children and young adults**; this has been corrected in connection with moving this information to the new ''text.audience'' attribute; the number of texts identified as such has increased from 5 to 122
   * Due to minor corrections in the way **syntactic complexity and lexical diversity** are aggregated for individual texts, text types and languages, the aggregate values of these measures may in some cases differ slightly from the previous version even when the corpus content has not changed   * Due to minor corrections in the way **syntactic complexity and lexical diversity** are aggregated for individual texts, text types and languages, the aggregate values of these measures may in some cases differ slightly from the previous version even when the corpus content has not changed
  

Trace: • calc • asociacni_miry • arf • eparent • akalex • frazem • meet • idiom • korpusdb • historie