en:cnk:intercorp:verze5 - Příručka ČNK

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
~~NOTOC~~
====== InterCorp: Release 5 ======

InterCorp is a large parallel synchronic corpus covering a number of languages. The corpus is compiled mostly by teachers and students of the Faculty of Arts, Charles University in Prague, and by other collaborators of the ICNC.

After registration [[http://korpus.cz/english/prohlaseni-aj.php|here]] the corpus can be searched using a web interface. The registration is valid for all ICNC corpora with public access. If you already have a user name and password for the Czech part of the Czech National Corpus, you do not need to register for the parallel corpus.

There are several aspects that make InterCorp special among the corpora published by ICNC:

  * InterCorp is accessible through [[http://www.korpus.cz/Park/|Park]], a purpose-built interface, using the corpus manager Manatee by Pavel Rychlý; a brief Park user manual is available [[en:park:navod|here]]; Park was written by Michal Štourač.
  * [[http://www.korpus.cz/corpora/intercorp/|Non-parallel]] versions of all InterCorp bitexts are available through a web-based version of the interface Bonito, so that its search and processing features (filter, sort, collocations, frequency distribution, random sampling, etc.) can be used also with texts from the parallel corpus. Czech texts included in the parallel corpus can also be used this way.
  * InterCorp is unique in yet another aspect. Unlike most other ICNC corpora which are static (unchanged in time), InterCorp is incremental with its size and the number of languages growing.


===== Texts in the corpus =====

The **core** of InterCorp consists mostly of fiction, manually aligned. Intercorp offers also a selection of fully automatically processed texts, so-called **collections**. The current choice includes political commentaries published by [[http://www.project-syndicate.org/|Project Syndicate]] and [[http://www.presseurop.eu/|Presseurop]], and a package of legal texts [[http://langtech.jrc.it/JRC-Acquis.html|Acquis Communautaire]]. These texts have been aligned automatically: search results may include a higher number of misaligned segments.

Each text has a Czech counterpart. As a result, Czech is the pivot language: for every text there is a single Czech version (original or translation), aligned with one or more foreign-language versions. The total size of the available part of InterCorp in release 5 (see [[en:cnk:intercorp:historie|Version history]]) is 91,529,000 words in the aligned foreign language texts in the core part and 451,112,000 in the collections. The share of the core and the collections in the corpus can be seen in the following chart. The size is shown in millions of words.

[{{:en:cnk:intercorp:intercorp_wordcounts2_v5.png|Setup of the parallel corpus – the core}}]

[{{:en:cnk:intercorp:intercorp_wordcounts3_v5.png|Setup of the parallel corpus – collections}}]


==== Corpus size in thousands of words =====

^ Language ^ Core ^ Syndicate ^ Presseurop ^ Acquis ^ Total ^
| be | 67 | 0 | 0 | 0 | 67 |
| bg | 1 415 | 0 | 0 | 13 816 | 15 231 |
| da | 189 | 0 | 0 | 21 680 | 21 869 |
| de | 12 004 | 2 567 | 752 | 21 723 | 37 048 |
| el | 0 | 0 | 0 | 25 069 | 25 069 |
| en | 5 914 | 2 567 | 799 | 24 207 | 33 489 |
| es | 11 811 | 2 896 | 860 | 27 001 | 42 570 |
| et | 0 | 0 | 0 | 15 962 | 15 962 |
| fi | 2 081 | 0 | 0 | 16 667 | 18 748 |
| fr | 3 217 | 2 969 | 874 | 27 351 | 34 414 |
| hr | 8 103 | 0 | 0 | 0 | 8 103 |
| hu | 1 122 | 0 | 0 | 19 167 | 20 290 |
| it | 3 484 | 80 | 793 | 24 849 | 29 207 |
| lt | 352 | 0 | 0 | 18 432 | 18 785 |
| lv | 1 085 | 0 | 0 | 18 744 | 19 830 |
| mk | 32 | 0 | 0 | 0 | 32 |
| mt | 0 | 0 | 0 | 14 133 | 14 133 |
| nl | 6 486 | 0 | 899 | 24 746 | 32 132 |
| no | 2 301 | 0 | 0 | 0 | 2 301 |
| pl | 8 396 | 0 | 710 | 20 464 | 29 571 |
| pt | 2 127 | 0 | 913 | 28 599 | 31 640 |
| ro | 1 370 | 0 | 819 | 8 199 | 10 389 |
| ru | 1 664 | 2 304 | 0 | 0 | 3 969 |
| sk | 7 257 | 0 | 0 | 19 221 | 26 479 |
| sl | 991 | 0 | 0 | 19 645 | 20 636 |
| sr | 4 295 | 0 | 0 | 0 | 4 295 |
| sv | 5 754 | 0 | 0 | 20 615 | 26 369 |
| **Total** | **91 528** | **13 385** | **7 425** | **430 300** | **542 640** |
| cs | 52 651 | 2 285 | 704 | 20 285 | 75 926 |

*) Each Czech text is counted only once, even though it may have more than one foreign counterpart.


===== Morphosyntactic annotation =====

Texts in the following languages have received some morphosyntactic annotation.

^ language ^ tags ^ lemmas ^ brief description ^ detailed description ^ tool ^
| Bulgarian | ✔ | [[http://www.bultreebank.org/TechRep/BTB-TR03.pdf|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Czech | ✔ | ✔ | [[http://korpus.cz/bonito/znacky.php|in Czech]] [[http://ufal.mff.cuni.cz/pdt/Morphology_and_Tagging/Doc/hmptagqr.html|in English]]((There is a helper application to assist you with queries including Czech morphological tags. Click [[http://utkl.ff.cuni.cz/~skoumal/morfo/?lang=en|here]].)) | [[http://ufal.mff.cuni.cz/pdt/Morphology_and_Tagging/Doc/docc0pos.ps|in English]] | [[http://ufal.mff.cuni.cz/morce/|Morče]] |
| Dutch | ✔ | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| English | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/projekte/CorpusWorkbench/CQP-HTMLDemo/PennTreebankTS.html|in English]] | [[http://utkl.ff.cuni.cz/%7Erosen/public/Penn-Treebank-Tagset.pdf|in English]] [[http://utkl.ff.cuni.cz/%7Erosen/public/PennTagAdd.html|+ additions]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Estonian | ✔ | ✔ | [[http://www.cl.ut.ee/korpused/morfliides/seletus|Estonian and English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| French | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/%7Eschmid/french-tagset.html|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| German | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TagSets/stts-table.html|in German]] | [[http://utkl.ff.cuni.cz/%7Erosen/public/stts_guide.pdf|in German]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Hungarian | ✔ | [[http://utkl.ff.cuni.cz/%7Erosen/public/kr_for_ldc.pdf|in English]] | [[http://code.google.com/p/hunpos/|HunPos]] |
| Italian | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/ftp/pub/corpora/italian-tagset.txt|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Lithuanian | ✔ | ✔ | [[http://utkl.ff.cuni.cz/~skoumal/CZ-LT-CORP/tags.html|in Czech and English]] | [[http://donelaitis.vdu.lt/~vidas/|Vidas Daudaravičius]] |
| Norwegian | ✔ | ✔ | [[http://tekstlab.uio.no/obt-ny/english/tagset.html|in English]] [[http://tekstlab.uio.no/obt-ny/index.html|in Norwegian]] | [[http://maximos.aksis.uib.no/Aksis-wiki/Oslo-Bergen_Tagger|analyzer]], [[http://omilia.uio.no/obt/|tagger]] |
| Polish | ✔ | ✔ | [[http://korpus.pl/en/cheatsheet/node2.html|in English]] [[http://korpus.pl/pl/cheatsheet/node2.html|in Polish]] | [[http://nlp.ipipan.waw.pl/%7Eadamp/Papers/2003-eacl-ws12/|in English]] | [[http://sgjp.pl/morfeusz/|Morfeusz]], [[http://nlp.pwr.wroc.pl/takipi/|TaKIPI]] |
| Portuguese | ✔ | ✔ | [[http://utkl.ff.cuni.cz/%7Erosen/public/ETIQUETAS_EAGLES_REDUCIDAS.webarchive|Spanish]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Russian | ✔ | ✔ | [[http://corpus.leeds.ac.uk/mocky/ru-table.tab|in English]] | [[http://nl.ijs.si/ME/V4/msd/html/msd-ru.html|in English]]((Tags in the corpus do not always correspond to those listed in the detailed description. Some morphological categories are omitted in the corpus tags, e.g. pronouns are always tagged only as "P-". All tags, as used in ther corpus, are listed in the brief description.)) | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Slovak | ✔ | ✔ | [[http://korpus.sk/morpho.html/|in Slovak]] | [[http://korpus.sk/files/tagset-www.pdf |in Slovak]] | [[http://conference.ui.sav.sk/wikt2010/papers/01_garabik_f.pdf|Radovan Garabík, Morče]] |
| Slovene | ✔ | ✔ | [[http://nl.ijs.si/ME/V3/msd/html/msd.html#SECTION05600000000000000000|English]] | [[http://nl2.ijs.si/analyze/|totale]] |
| Spanish | ✔ | ✔ | [[ftp://ftp.ims.uni-stuttgart.de/pub/corpora/spanish-tagset.txt|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |

See [[en:park:navod|Park Manual]] for advice on the use of tags in queries.

===== Please note: work in progress =====

The search interface Park is under continuous development. It is therefore likely that you will encounter inconveniences of various sorts or will miss features available in monolingual concordancers. Your error reports, reminders and suggestions are welcome at:

<HTML>&#109;&#097;&#114;&#116;&#105;&#110;&#046;&#118;&#097;&#118;&#114;&#105;&#110;&#064;&#102;&#102;&#046;&#099;&#117;&#110;&#105;&#046;&#099;&#122;</HTML>

===== Acknowledgements =====

We are grateful for the possibility to use the following software and data:

==== Pre-processing ====

  * Sentence splitter for Czech by Pavel Květoň
  * Sentence splitter for Norwegian by Jarle Ebeling and Pavel Vondřička
  * Sentence splitter Punkt for all other languages from [[http://www.nltk.org/|Natural Language Toolkit]] 
  * Aligner [[http://mokk.bme.hu/resources/hunalign|Hunalign]]
	
==== Taggers/lemmatizers: ====

  * [[http://ufal.mff.cuni.cz/morce/|Morče]] for Czech
  * [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] for Bulgarian, Dutch, English, Estonian (thanks to Helmut Schmid), French, German, Italian, Portuguese (thanks to Pablo Gamallo), Russian and Spanish 
  * [[http://sgjp.pl/morfeusz/|Morfeusz]] and [[http://nlp.pwr.wroc.pl/takipi/|TaKIPI]] for Polish
  * [[http://code.google.com/p/hunpos/|HunPOS]] for Hungarian
  * [[http://conference.ui.sav.sk/wikt2010/papers/01_garabik_f.pdf|Tagger for Slovak]] (thanks to Radovan Garabík)
  * [[http://donelaitis.vdu.lt/~vidas/|Tagger for Lithuanian]] (thanks to Hanka Skoumalová) 
  * [[http://maximos.aksis.uib.no/Aksis-wiki/Oslo-Bergen_Tagger|Analyzer]] and [[http://omilia.uio.no/obt/|tagger]] for Norwegian (thanks to Pavel Vondřička)
  * [[http://nl2.ijs.si/analyze/|totale]] for Slovene (thanks to Tomaž Erjavec)
	
==== Corpus Query Engine: ====

  * [[http://www.textforge.cz/products|Manatee]]
	
==== Data: ====

  * Newspaper articles in a number of languages from the site [[http://www.project-syndicate.org/|Project Syndicate]]
  * Slovak-Czech concordances from the [[http://korpus.juls.savba.sk/|Slovak National Corpus]] 
  * Short stories in a number of languages [[http://www.goethe.de/ins/cz/prj/m89/csindex.htm|My 1989]] from [[http://www.goethe.de/ins/cz/pra/|Goethe Institut]] 
  * A number of texts in the Czech-Lithuanian section of the corpus from Patrick Corness
  * George Orwell's novel //1984// in a number of languages from the [[http://nl.ijs.si/ME/|Multext-East]] corpus 
  * Ukrainian and Polish texts from the [[http://www.domeczek.pl/~polukr/|PolUkr]] corpus (in prep.) 
  * Newspaper texts from the [[http://www.presseurop.eu|Presseurop]] server
  * Legal texts in EU languages from the [[http://wt.jrc.it/lt/Acquis/|JRC-ACQUIS]] corpus
  * Norwegian texts from the publishers [[http://www.aschehoug.no/|Aschehoug & co.]], [[http://www.cappelendamm.no/|Cappelen Forlag]] and [[http://www.oktober.no/|Forlaget Oktober]]

{{:cnk:intercorp:projectsyndicate.png?direct&319}}

Last update: //20 July 2012//


===== See also =====

<WRAP round box 50%>
[[en:cnk:intercorp|InterCorp]] • [[en:cnk:intercorp:verze7|Release 7]] • [[en:cnk:intercorp:verze6|Release 6]] • [[en:cnk:intercorp:verze4|Release 4]] • [[en:cnk:intercorp:verze3|Release 3]] • [[en:cnk:intercorp:historie|Version history]]
</WRAP>
Trace: • lists • navigation_en • dotko • verze5
Search

Navigation

Print/export

Tools

Languages

Licence
