InterCorp: Version history

• Released on 9 September 2026 (pilot version)
• Information about the corpus

• New books in the Core: 40 new Czech titles (1852 in total), 214 new titles across all languages (6669 in total)
• The new InterCorp Tools serve as a guide to InterCorp, providing a wide range of information about the corpus and replacing the tables and charts included in the documentation of previous versions; they also include a Hall of Fame listing everyone who contributed to the preparation of new texts for the InterCorp Core release 17ud
• New language: Kashubian (code cb, currently 2 books in the Core)
• New text collection: TED Talks – 1383 talk transcripts in Czech, i.e. 2.4 million positions; 39,374 transcripts across all languages, i.e. 28.9 million positions
• Additions to the Project Syndicate collection from 2021–2025
• The Bible is now also available in Spanish and Upper Sorbian

• This is the first release available exclusively with linguistic annotation based on Universal Dependencies
• In Slavic and Romance languages, multiword verb forms are now also annotated using the positional attribute cw_feats – content-word features (cw_feats)
• In the Core, authors are now also identified by a name that is consistent across languages (attribute text.rf_author)
• The positional attributes useful for navigating syntactic structure have been extended with references to the word form of the head: p_word (parent word form) and e_word (effective parent word form)
• Literature for children and young adults, previously identified as text.txtype=children's lit., is now identified as text.audience=jun; for other texts, this attribute has the value gen; the text.txtype attribute can thus be used to distinguish text types (fiction, poetry, drama, non-fiction)
• Newer language models from UDPipe (ud-2.17) were used for linguistic annotation; Chinese alone is annotated using Trankit for better results (thanks to Benjamin David Reeves and Pavel Straňák)
• New segmentation and alignment tools were used to prepare the TED Talks collection (Vecalign)

• The value of the positional attribute deprel (the syntactic function of a word) can be specified in Advanced Query in the same way as the values of upos and feats, by selecting it from the Insert tag menu
• Clicking any word in the concordance in one language highlights its most likely translation equivalent in the other language or languages (this feature also works with earlier versions of InterCorp)

• Author names were not given consistently for some texts within the same language (attribute text.author)
• In languages written in Cyrillic, characters visually identical to Latin characters were sometimes incorrectly encoded as Latin; we have managed to eliminate most of these errors
• A number of texts were not identified as literature for children and young adults; this has been corrected in connection with moving this information to the new text.audience attribute; the number of texts identified as such has increased from 5 to 122
• Due to minor corrections in the way syntactic complexity and lexical diversity are aggregated for individual texts, text types and languages, the aggregate values of these measures may in some cases differ slightly from the previous version even when the corpus content has not changed

• In French, Tense=Past and Tense=Pres are no longer specified in the feats attribute for participles (VerbForm=Part), so past and present participles cannot be distinguished in the InterCorp annotation. This is due to a change in the French data used to train the UDPipe language model. The maintainers of the GSD treebank moved this information from the FEATS field to the MISC field, which is not included in the model. (For the data format, see CoNLL-U; for the reasons behind the change, see the discussion UD_French-GSD: Tense removed from FEATS.)

Published 17 September 2024

• Contains the same texts as release 16
• Mainly differs in the unified linguistic annotation of all languages according to the Universal Dependencies standard (cf. Release 13ud)
• Metadata for each sentence and text now include measures of syntactic complexity, for each text also measures of lexical diversity
• Information about the corpus

Published 12 October 2023

• The core now contains all texts planned and approved for 2022 and submitted by the deadline for this version
• The number of words in all languages and text types has tripled from 1 798 million to 5 290 million
• This is mainly due to the update of the Subtitles package, which now contains 4 001 million words
• 20 new languages were added to Subtitles and thus to the corpus as a whole - the corpus now contains 62 languages (including Czech)
• The number of words in all languages except Czech is 4 893 million, of which 387 million represents the core and 4 506 million the collections
• The total number of words in Czech texts is 398 million, including 125 million core and 273 million collection
• Information about the corpus

Published 11 November 2022

• Total number of word forms in foreign language texts: 1 588 mil., including 362 mil. core and 1 226 mil. collections
• Total number of word forms in Czech texts: 210 mil., including 120 mil. core and 90 mil. collections
• The Project Syndicate collection was extended by texts published in 2019–2021; Arabic and Chinese texts were included for the first time
• Instead of a national tagger for Norwegian, the UDPipe tagger is used starting this release, including tokenization and tagset according to the Universal Dependencies standard (same as for Belarusian and Ukrainian)
• Information about the corpus

Published 31 January 2022

• Total number of word forms in foreign language texts: 1 572 mil., including 349 mil. core and 1 223 mil. collections
• Total number of word forms in Czech texts: 207 mil., including 118 mil. core and 90 mil. collections
• Upper Sorbian (abbreviated as hs) was added as a new language.
• Information about the corpus

Published 22 December 2021

Differences between releases 13 and 13ud

Published 1 November 2020

• Total number of word forms in foreign language texts: 1,550 mil., including 327 mil. core and 1,223 mil. collections
• Total number of word forms in Czech texts: 203 mil., including 113 mil. core and 90 mil. collections
• Chinese is now represented also in the Core part
• The ReLDI tagger is now used also for tagging Slovene
• Information about the corpus

Published 12 December 2019

• Total number of word forms in foreign language texts: 1,534 mil., including 311 mil. core and 1,223 mil. collections
• Total number of word forms in Czech texts: 200 mil., including 111 mil. core and 90 mil. collections
• New language: Chinese (only in the collections)
• Information about the corpus

Published 19 October 2018

• Total number of word forms in foreign language texts: 1,508 mil., including 283 mil. core and 1,225 mil. collections
• Total number of word forms in Czech texts: 196 mil., including 107 mil. core and 89 mil. collections
• Japanese is now represented also in the Core
• Newly tagged and lemmatized languages: Belarusian, Japanese, Ukrainian
• Information about the corpus

Published 1 December 2017

• Total number of word forms in foreign language texts: 1,483 mil., including 258 mil. core and 1,225 mil. collections
• Total number of word forms in Czech texts: 192 mil., including 102 mil. core and 89 mil. collections
• A new collection: translations of the Bible (Old and New Testament) in 18 languages
• Update of the Project Syndicate collection by new texts published in the previous two years
• More reliable linguistic annotation for many languages (taggers process text without formatting and other markup)
• Removing texts in languages other than specified from the Acquis collection
• Catalan is now annotated with tags and lemmas
• Bulgarian and Dutch is now annotated also with lemmas
• Hungarian is now tagged by RFTagger (formerly by HunPOS)
• For technical issues with the tagger, Lithuanian is not annotated with tags and lemmas; it was not annotated starting with release 7 – we apologise about the misleading info in the previous releases
• Information about the corpus

Search Interface:

• Concordances can now be selected and labelled
• A subcorpus for a language can now be built from parts aligned with a set of specified languages
• Release 2 of treq (the database of equivalents) now offers English in addition to Czech as the second language, search of multi-word expressions and queries using regular expressions

Published 9 September 2016

Data:

• Total number of word forms in foreign language texts: 1460 mil., including 232 mil. core and 1229 mil. collections
• Total number of word forms in Czech texts: 187 mil., including 97 mil. core and 90 mil. collections
• A new language: Romani
• Morphological tags and lemmas are now available also in Croatian, Serbian and Latvian
• Serbian Cyrillic texts were converted into Latin alphabet
• A more balanced share of languages and text types due to a newly introduced acquisition planning
• Names of authors and translators were unified within a single language
• Information about the corpus

Search Interface:

• A number of minor improvements and bug fixes
• Description of the tagset for a given language is available from KonText interface

published 4.6.2015

Data:

• Total number of tokens in foreign language texts: 1423 mil., including 194 mil. core and 1229 mil. collections
• Total number of tokens in Czech texts: 174 mil., including 84 mil. core and 89 mil. collections
• Collections Project Syndicate and PressEurop/VoxEurop have been extended by new texts published in 2013–2014
• Metadata on hundreds of texts from the core have been corrected and missing items added.
• Information about the corpus

Search Interface:

• The Park and NoSketch Engine search interfaces are no longer available. Please use KonText instead.
• KonText is continuously developed, featuring new options, such as flagging selected concordances for further processing.

published 19.12.2014

Data:

• Total number of tokens in foreign language texts: 1390 mil., including 173 mil. core and 1217 mil. collections
• Total number of tokens in Czech texts: 165 mil., including 77 mil. core and 85 mil. collections
• Number of foreign languages: 38 – new: Albanian, Hebrew, Icelandic, Japanese, Malay, Turkish and Vietnamese
• An additional new collection: film subtitles from the Open Subtitles database
• Czech texts are now tagged in the same way as other Czech texts in the Czech National Corpus, i.e. including verbal aspect at position 16 and without unspecific codes, e.g. Y or Z at position 3.
• Morphological tags and lemmas are now available also in Finnish, Icelandic and Swedish texts
• German texts are now tagged by a better tool, resulting in a more reliable and detailed annotation. The tagset remains the same.
• Incorrect alignments of some texts from the ASPAC corpus have been emended.
• Some collections (Syndicate, Presseurop and Europarl) have received additional data, missing in the original source, such as language of the original and author.
• Information about the corpus

Search Interface:

• In addition to Park and NoSketch Engine, KonText, a new search interface, is now available. Please note that Park and NoSketch Engine will probably be discontinued by the end of March 2015.
• Starting from release 7, KonText and NoSketch Engine now support searching in previous releases of InterCorp.
• While filtering texts, i.e., when specifying a query according to meta-information or creating a subcorpus, KonText now shows the extent of the selection by listing the selected titles; just click on the “highlight selection structure” button to see the list in the “div.title” column
• In KonText, concordance lines are shuffled by default. Search results can be displayed faster with default shuffling switched off in the menu: View – General concordance view options

published 8.4.2013

Data:

• number of words in foreign language texts: 138,779,000 - core, 728,508,000 - collections
• number of foreign languages: 31 – new: Arabic, Catalan, Hindi, Ukrainian
• new fiction texts from ASPAC – Amsterdam Slavic Parallel Aligned Corpus – with special thanks to Adrian Barentsen
• new collection of texts from the EuroParl corpus (proceedings of the European Parliament)
• Syndicate a Presseurop extended by texts from the two past years
• Information about the corpus

Search interface:

• a new search interface: NoSketch Engine in addition to Park
• Park: an option to search in the previous version of the corpus

published 14.6.2012

Data:

• separation of core texts and collections texts
• number of words in foreign language texts: 91 529 000 core, 451 112 000 in collections
• number of foreign language texts: 1 287 + Syndicate, Presseurop and Acquis
• number of foreign languages: 27
• number of tagged / lemmatized foreign languages: 17 / 14
• inclusion of automatically aligned texts from Acquis Communautaire
• Information about corpus

Park:

• possibility to filter texts based on bibliografical information
• separation of core texts and collections texts
• possibility to create a random sample of concordances
• better interface languages support

published 19.9.2011

Data:

• number of words in foreign language texts: 92 290 000 (including Syndicate and Presseurop)
• number of foreign language texts: 1 045 + Syndicate and Presseurop
• number of foreign languages: 22
• number of tagged / lemmatized foreign languages: 13 / 10
• inclusion of automatically aligned texts from Presseurop
• inclusion of another group of texts from Project Syndicate
• addition of another structural attributes (origyear, srclang, txtype)
• Information about corpus

Park: unchanged

published 18.5.2011

Data: unchanged

Park:

• multi-level filtering of query results
• improved cookies support
• another export format

published 21.2.2011

Data:

• number of words in foreign language texts: 72 280 000 (including Syndicate)
• number of foreign language texts: 943 + Syndicate
• number of foreign languages: 22
• number of tagged / lemmatized foreign languages: 13 / 10
• implementation of the stand-off alignment
• Information about corpus

Park:

• one-level filtering of query results
• possibility to display selected result page
• implementation of the stand-off alignment

published 16.10.2009

Data:

• number of words in foreign language texts: 49 293 000 (including Syndicate)
• number of foreign language texts: 572 + Syndicate
• number of foreign languages: 21
• number of tagged / lemmatized foreign languages: 10 / 7
• inclusion of automatically aligned texts from Project Syndicate

Corpus access:

• monolingual corpora of individual languages made accessible next to Park

published 29.4.2009

Data:

• number of words in foreign language texts: 34 464 000
• number of foreign language texts: 505
• number of foreign languages: 20
• number of tagged / lemmatized foreign languages: 10 / 7
• lemmatization and morphological tagging of some languages

Park:

• displaying subcorpus size

published 19.11.2008

Data:

• number of words in foreign language texts: 25 mil.
• number of foreign languages: 19
• number of tagged / lemmatized foreign languages: 0 / 0

Park:

• first stable version

Last update: 14 January 2022