en:cnk:intercorp:verze3 - Příručka ČNK

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
~~NOTOC~~
====== InterCorp: Release 3 ======

InterCorp is a large parallel synchronic corpus covering a number of languages. The corpus is compiled mostly by teachers and students of the Faculty of Arts, Charles University in Prague, and by other collaborators of the ICNC.

After registration [[http://korpus.cz/english/prohlaseni-aj.php|here]] the corpus can be searched using a web interface. The registration is valid for all ICNC corpora with public access. If you already have a user name and password for the Czech part of the Czech National Corpus, you do not need to register for the parallel corpus.

There are several aspects that make InterCorp special among the corpora published by ICNC:

  * InterCorp is accessible through [[http://www.korpus.cz/Park/|Park]], a purpose-built interface, using the corpus manager Manatee by Pavel Rychlý; a brief Park user manual is available [[en:park:navod|here]]; Park was written by Michal Štourač.
  * [[http://www.korpus.cz/corpora/intercorp/|Non-parallel]] versions of all InterCorp bitexts are available through a web-based version of the interface Bonito, so that its search and processing features (filter, sort, collocations, frequency distribution, random sampling, etc.) can be used also with texts from the parallel corpus. Czech texts included in the parallel corpus can also be used this way.
  * InterCorp is unique in yet another aspect. Unlike most other ICNC corpora which are static (unchanged in time), InterCorp is incremental with its size and the number of languages growing.

===== Texts in the corpus =====

The bulk of InterCorp consists of fiction in Czech and other languages, semi-automatically aligned, and a selection of political commentaries published by [[http://www.project-syndicate.org/|Project Syndicate]]. The currently available Czech, English, French, German, Russian and Spanish issues, dated 2000-2008, will be followed by more recent texts in future releases of the corpus. These texts have been aligned automatically: search results may include more misaligned segments.

Each texts has a Czech counterpart. As a result, Czech is the pivot language: for every text there is a single Czech version (original or translation), aligned with one or more foreign-language versions. The size of InterCorp for all languages is given in the following table, the Project Syndicate data being included in the counts with their size of approximately 1,5 - 2 million words for a given language (as of February 2011, in InterCorp v. 3, see [[http://www.korpus.cz/intercorp/?req=page:releaseNotes&lang=en|Version history]]).

| **language** | **number of  words
(in thousands)** | **number of texts** |
| Bulgarian | 1,135 | 15 |
| Croatian | 6,735 | 96 |
| Danish | 190 | 5 |
| Dutch | 3,914 | 58 |
| English | 5,695 | Syndicate + 49 |
| Finnish | 1,247 | 19 |
| French | 3,141 | Syndicate + 21 |
| German | 8,846 | Syndicate + 100 |
| Hungarian | 1,123 | 17 |
| Italian | 2,817 | 28 |
| Latvian | 1,085 | 33 |
| Lithuanian | 353 | 17 |
| Norwegian | 2,158 | 21 |
| Polish | 4,716 | 80 |
| Portuguese | 1,312 | 18 |
| Romanian | 671 | 5 |
| Russian | 2,951 | Syndicate + 25 |
| Serbian | 1,724 | 27 |
| Slovak | 6,899 | 138 |
| Slovene | 992 | 16 |
| Spanish | 10,905 | Syndicate + 108 |
| Swedish | 3,673 | 47 |
| **TOTAL** | **72,280** | **943** |

Each Czech text is counted only once, even though it may have more than one foreign counterpart.

| **Language** | **number of words (in thousands)** | **number of texts** |
| Czech | 41,340 | Syndicate + 652 |

===== Morphosyntactic annotation =====

Texts in the following languages have received some morphosyntactic annotation.

| **language** | **tags** | **lemmas** | **brief description** | **detailed description** | **tool** |
| English | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/projekte/CorpusWorkbench/CQP-HTMLDemo/PennTreebankTS.html|in English]] | [[http://utkl.ff.cuni.cz/%7Erosen/public/Penn-Treebank-Tagset.pdf|in English]] [[http://utkl.ff.cuni.cz/%7Erosen/public/PennTagAdd.html|+ additions]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Bulgarian | ✔ | [[http://www.bultreebank.org/TechRep/BTB-TR03.pdf|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Czech | ✔ | ✔ | [[http://korpus.cz/bonito/znacky.php|in Czech]] [[http://ufal.mff.cuni.cz/pdt/Morphology_and_Tagging/Doc/hmptagqr.html|in English]]((There is a helper application to assist you with queries including Czech morphological tags. Click [[http://utkl.ff.cuni.cz/~skoumal/morfo/?lang=en|here]].)) | [[http://ufal.mff.cuni.cz/pdt/Morphology_and_Tagging/Doc/docc0pos.ps|in English]] | [[http://ufal.mff.cuni.cz/morce/|Morče]] |
| French | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/%7Eschmid/french-tagset.html|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Italian | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/ftp/pub/corpora/italian-tagset.txt|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Lithuanian | ✔ | ✔ | [[http://utkl.ff.cuni.cz/~skoumal/CZ-LT-CORP/tags.html|in Czech and English]] | [[http://donelaitis.vdu.lt/~vidas/|Vidas Daudaravičius]] |
| Hungarian | ✔ | [[http://utkl.ff.cuni.cz/%7Erosen/public/kr_for_ldc.pdf|in English]] | [[http://code.google.com/p/hunpos/|HunPos]] |
| German | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TagSets/stts-table.html|in German]] | [[http://utkl.ff.cuni.cz/%7Erosen/public/stts_guide.pdf|in German]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Dutch | ✔ | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Norwegian | ✔ | ✔ | [[http://maximos.aksis.uib.no/Aksis-wiki/Oslo-Bergen_Tagger|analyzer]], [[http://omilia.uio.no/obt/|tagger]] |
| Polish | ✔ | ✔ | [[http://korpus.pl/en/cheatsheet/node2.html|in English]] [[http://korpus.pl/pl/cheatsheet/node2.html|in Polish]] | [[http://nlp.ipipan.waw.pl/%7Eadamp/Papers/2003-eacl-ws12/|in English]] | [[http://sgjp.pl/morfeusz/|Morfeusz]], [[http://nlp.pwr.wroc.pl/takipi/|TaKIPI]] |
| Russian | ✔ | ✔ | [[http://corpus.leeds.ac.uk/mocky/ru-table.tab|in English]] | [[http://nl.ijs.si/ME/V4/msd/html/msd-ru.html|in English]]((Tags in the corpus do not always correspond to those listed in the detailed description. Some morphological categories are omitted in the corpus tags, e.g. pronouns are always tagged only as "P-". All tags, as used in ther corpus, are listed in the brief description.)) | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |
| Slovak | ✔ | ✔ | [[http://korpus.sk/morpho.html/|in Slovak]] | [[http://korpus.sk/files/tagset-www.pdf |in Slovak]] | [[http://conference.ui.sav.sk/wikt2010/papers/01_garabik_f.pdf|Radovan Garabík, Morče]] |
| Spanish | ✔ | ✔ | [[http://www.ims.uni-stuttgart.de/ftp/pub/corpora/spanish-tagset.txt|in English]] | [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] |

See [[en:park:navod|Park Manual]] for advice on the use of tags in queries.

===== Please note: work in progress =====

The search interface Park is under continuous development. It is therefore likely that you will encounter inconveniences of various sorts or will miss features available in monolingual concordancers. Your error reports, reminders and suggestions are welcome at:

<HTML>&#109;&#097;&#114;&#116;&#105;&#110;&#046;&#118;&#097;&#118;&#114;&#105;&#110;&#064;&#102;&#102;&#046;&#099;&#117;&#110;&#105;&#046;&#099;&#122;</HTML>

===== Acknowledgements =====

We are grateful for the possibility to use the following software and data:

==== Pre-processing ====

  * Sentence splitter for Czech by Pavel Květoň
  * Sentence splitter for Norwegian by Jarle Ebeling and Pavel Vondřička
  * Sentence splitter Punkt for all other languages from [[http://www.nltk.org/|Natural Language Toolkit]]
  * Aligner [[http://mokk.bme.hu/resources/hunalign|Hunalign]]

==== Taggers/lemmatizers: ====

  * [[http://ufal.mff.cuni.cz/morce/|Morče]] for Czech
  * [[http://www.ims.uni-stuttgart.de/projekte/corplex/TreeTagger/|TreeTagger]] for English, German, French, Italian, Dutch, Spanish, Bulgarian and Russian
  * [[http://sgjp.pl/morfeusz/|Morfeusz]] and [[http://nlp.pwr.wroc.pl/takipi/|TaKIPI]] for Polish
  * [[http://code.google.com/p/hunpos/|HunPOS]] for Hungarian
  * [[http://conference.ui.sav.sk/wikt2010/papers/01_garabik_f.pdf|Tagger for Slovak]]
  * [[http://donelaitis.vdu.lt/~vidas/|Tagger for Lithuanian]]
  * [[http://maximos.aksis.uib.no/Aksis-wiki/Oslo-Bergen_Tagger|Analyzer]] and [[http://omilia.uio.no/obt/|tagger]] for Norwegian

==== Corpus Query Engine: ====

  * [[http://www.textforge.cz/products|Manatee]]

==== Data: ====

  * Newspaper articles in a number of languages from the site [[http://www.project-syndicate.org/|Project Syndicate]]
  * Slovak-Czech concordances from the [[http://korpus.juls.savba.sk/|Slovak National Corpus]]
  * Short stories in a number of languages [[http://www.goethe.de/ins/cz/prj/m89/csindex.htm|My 1989]] from [[http://www.goethe.de/ins/cz/pra/|Goethe Institut]]
  * A number of texts in the Czech-Lithuanian section of the corpus from Patrick Corness
  * George Orwell's novel //1984// in a number of languages from the [[http://nl.ijs.si/ME/|Multext-East]] corpus
  * Ukrainian and Polish texts from the [[http://www.domeczek.pl/~polukr/|PolUkr]] corpus (in prep.)
  * Texts in a number of languages from the [[http://www-korpus.uni-r.de/ParaSol/|ParaSol]] corpus (in prep.)
  * Newspaper texts from the [[http://www.presseurop.eu|PressEurope]] server (in prep.)
  * Legal texts in EU languages from the [[http://wt.jrc.it/lt/Acquis/|JRC-ACQUIS]] corpus (in prep.)
  * Norwegian texts from the publishers [[http://www.aschehoug.no/|Aschehoug & co.]], [[http://www.cappelendamm.no/|Cappelen Forlag]] and [[http://www.oktober.no/|Forlaget Oktober]]

{{:cnk:intercorp:projectsyndicate.png?direct&319}}

Last update: //24 February 2011//

===== See also =====

<WRAP round box 50%>
[[en:cnk:intercorp|InterCorp]] • [[en:cnk:intercorp:verze5|Release 5]] • [[en:cnk:intercorp:verze4|Release 4]] • [[en:cnk:intercorp:historie|Version history]]
</WRAP>
Trace: • struktura_oral • vyhodnoceni_dotazu • lemtag_mluv • verze10 • txtype_group • gramatikat • historie • verze8 • reprezentativnost • syn2010