en:cnk:ortofon - Příručka ČNK

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Corpus of informal spoken Czech with multi-tier transcription: ORTOFON ======

The ORTOFON corpus captures spontaneous spoken language used in informal situations between speakers who know each other. It follows the [[en:cnk:oral|ORAL]] series of informal spoken Czech corpora in its data collection design. The recordings are transcribed in two tiers - orthographic and phonetic. Together with the [[en:cnk:dialekt|DIALEKT]] corpus, these are the first two spoken Czech corpora to have multi-tier transcription. Similar to the [[en:cnk:oral2013|ORAL2013]] corpus, speakers come from all over the Czech Republic and selected sociological information is collected about them. The corpus is lemmatized and morphologically tagged. The transcription is linked to the audio track and the audio can be played back in the KonText corpus interface. 

The ORTOFON corpus allows us to explore various aspects of spoken language, i.e. lexis, morphology, syntax, pragmatics, dialogue construction. The corpus is not primarily intended for dialectological ((The [[en:cnk:dialekt|DIALEKT]] corpus is intended for this kind of research.)) or phonetic research, even though a simplified phonetic transcription allows us to verify the existence of pronunciation or regional variants, or phenomena related to pronunciation.

The publication of ORTOFON in connection with the [[en:cnk:oral|ORAL]] corpus presents users the chance to explore informal spoken Czech in the most extensive data complex to date, covering a period of fifteen years (2002-2020).

<WRAP 45%>
^ <fs medium>Name</fs> | <fs medium>[[en:cnk:ortofon|ORTOFON]]•v1</fs> | <fs medium>[[cnk:ortofon|ORTOFON]]•v2</fs> | <fs medium>[[cnk:ortofon|ORTOFON]]•v3</fs> |
^ Number of [[en:pojmy:token|positions (tokens)]] |  1 236 508 |  2 560 590 |  XXX |
^ Number of [[en:pojmy:token|positions (tokens)]] without puctuation, hesitations and interjections |  1 014 786 |  2 101 214 |  XXX |
^ Number of [[en:pojmy:word|word forms (words)]] |  65 294 |  101 502 |  XXX |  
^ Number of [[en:pojmy:atributy_strukturni#struktura_korpusu_mluvene_cestiny|conversations recorded]] |  332 |  615 |  XXX |
^ Number of [[en:pojmy:atributy_strukturni#struktura_korpusu_mluvene_cestiny|utterances]] |  172 736 |  360 248 |  XXX |
^ Number of unique (different) speakers |  624 |  960 |  XXX |  
^ Length of recordings [hh:mm:ss.ms] |  102:41:14.247 |  210:09:35.155 |  XXX:XX:XX.XXX |  
</WRAP>

===== Data collection  =====

The corpus captures only informal, spontaneous and natural situations. The material was collected in accordance with the [[en:cnk:oral2013#slozeni_korpusu_a_sber_dat|criteria]] concerning the corpora of the ORAL series:

  * physical presence of all speakers in one place (exceptions are telephone conversations on speakerphone, or Skype or Zoom communications, where all participating speakers are recorded throughout the conversation);
  * dialogicality of speeches (two or more speakers talking);
  * close relationship between the speakers;
  * unpreparedness, spontaneity of speech;
  * non-public and informal communication situations.

Due to the presence of the phonetic transcription tier, a greater emphasis was placed on the sound quality of recordings. Selected sociological data about the situation and the speakers were recorded. The recordings capture adult native speakers of the Czech language from all parts of the Czech Republic. The maximum possible degree of authenticity of the individual recordings was achieved by the fact that the speakers were mostly not informed about the recording in advance, but only after it had been completed. All recorded speakers agreed to the use of the recordings for the purposes of the CNK.
===== Structural attributes of the ORTOFON corpus =====

The structures and structural attribute of the ORTOFON corpus are described on a  [[seznamy:strukturni_atributy_mluvene#strukturni_atributy_korpusu_ortofon_a_spojeneho_korpusu_oral|separate page]] (in Czech only).
===== Morphological tagging of the ORTOFON corpus =====

The ORTOFON v3 corpus is automatically [[en:pojmy:tag|annotated]] with [[en:cnk:syn2020#morphological_tagging|a new morphological tag]] according to the SYN2020 standard. It recognizes [[en:cnk:syn2020#multiple_lemmatization_and_tagging_aggregate|aggregates]] (e.g., //vidělas//, //zač//), uses [[en:cnk:syn2020|double-level lemmatization]], and has a verb tag ([[en:cnk:syn2020#verb_tagging_verbtag|verbtag]]). 

Substandard variants and forms typical of dialects and spontaneous speech are also tagged in the corpus. Special variants of words are distinguished by their own sublemma (e.g. //poslúchat// under the lemma //poslouchat//), special forms tagged only in the spoken corpus have the number 9 in the last tag position (e.g. the form //jezdijó// has the tag  ''%%VB-P---3P-AAI-9%%''). 

The following specific tags are used in the first tag position (word type):

^  Tag  ^  Meaning  ^
|  E	| fragments (incomplete words) |
|  H    | nonverbal sounds (e.g. hezitation) |
|  M	| comments by transcribers (in round brackets) |
|  W	| anonymised sections (mainly names) | 

Note: The anonymised sections are specified on a basic level ''%%word%%'': NP – surname, NJ – first name, NN – nickname, NM – place name, NO – other proper names, NT – last two digits of the telephone number.

The ORAL v1, ORTOFON v1 and ORTOFON v2 corpora are tagged with the prior morphological tagset used until 2020. Detailed information on the annotation of these previously published corpora can be found on a [[en:cnk:lemtag_mluv|separate page]].
===== Differences between the ORAL and ORTOFON corpora =====

  * **Multi-tier transcription**: The transcription of spoken language in the ORTOFON corpus was carried out on two tiers: **orthographic** and **phonetic**. The orthographic tier serves primarily to ease the understanding of and orientation in the recorded conversation, whereas the phonetic tier captures the actual realization of the utterance with the aid of a phonetic transcription. These two tiers are supplemented by an additional **metalanguage** tier, which captures the accompanying sounds produced by the speakers (e.g. laughter, coughing) or the present surroundings with a possible influence on the conversation (e.g. the sound of a telephone ringtone can lead to an interruption of the conversation).
  * **Pause punctuation based on pause length**: A section of the [[en:cnk:oral|ORAL]] corpus, specifically ORAL2013 and ORAL-Z, contains a pause punctuation based on the intuitive distinction between shorter and longer pauses based on the speech rate of the specific speaker. In the ORTOFON corpus, three types of pauses are distinguished based on temporal criteria: divides (less than 120 ms), pauses (120 ms - 2 s), long pauses (longer than 2 s).
  * **Full balance**:  In the ORTOFON corpus, each combination of the four sociolinguistic variables is represented by a group of the same size (cf. [[en:cnk:oral2013#co_ma_oral2013_s_korpusy_oral2006_a_oral2008_spolecneho|ORAL2013]]).
  * **Varied representation of speakers from all over the Czech Republic**: The demarcation of the individual dialectal regions is based on the dialect divisions used in [[http://cja.ujc.cas.cz/cja.html|Czech language atlas]], however, the borders have been further refined (see [[en:cnk:dialekt#mapa_narecnich_oblasti_cr| the map of dialectal regions]]). During the process of data collection, care was taken to achieve the variability of both the speakers and the municipalities from which they come.
  * **Extended segment for listening**: The segment of each separate transcript can be as long as 25 words, which improves the experience of listening to the audio segment.
  * **Alternative way of marking overlaps**: Overlaps in the transcript are marked with square brackets and are not divided in the audio so that they can be heard better (cf. [[en:cnk:oral2013|ORAL2013]]).
  * **Availability of audio**: The entire ORTOFON corpus is linked with audio tracks, so it is possible to listen to the given concordance (for the corpus [[en:cnk:oral|ORAL]] this only applies to the ORAL-Z and ORAL2013 sections).
  * **New metainformation**: The scope of meta information collected regarding the recording and the individual speakers has been extended.

===== ORTOFON v1 (2017) =====

In its first version, published in 2017, the ORTOFON corpus was the first corpus that was fully balanced across all basic sociolinguistic categories of speakers (gender, age group, level of education, and the dialectal region of childhood residence).\\
The ORTOFON v1 corpus is composed of 332 recordings from the years 2012–2017 and contains 1 014 786 orthographic words, i.e. a total of 1 236 508 positions; a total of 624 different speakers appear in the probes. The recordings were acquired in Bohemia, Moravia, and Silesia, and their total length measures almost 103 hours. More quantitative data can be found on the page dedicated to the [[cnk:struktura_ortofon|composition of the corpus]] (in Czech only).
===== ORTOFON v1 - corpus balance =====

From the very beginning of data collection, special care was taken to achieve the maximum possible speaker variability with regard to dialectal regions. Over the course of the collection process, the material was adjusted in order to achieve a balanced corpus within the four basic sociolinguistic categories: gender, age, level of education and the dialectal region in which the speaker spent the majority of the first 15 years of his life. The first three categories, i.e. gender, age, education, were assigned binary values (see picture), while the fourth category was divided into ten groups i.e. ten dialectal regions. The following picture displays the distribution of the binary categories within one dialectal region. Each region should, therefore, contain the same number of words from men and women, from speakers of ages 18-34 years and those over 35 years, and from speakers with a high school education and those with a university education.

[{{:cnk:ortofon-vysece.png?400 | The distribution of binary sociolinguistic categories for one dialectal region. }}]

The basic concept was the idea of the same proportional representation of the sociolinguistic categories listed above, applied to the collection of material for all of the ČNK spoken corpora. Taking into account the target corpus size (1 000 000 words), the target for every category presented by the combination of four variables - gender(2) × age(2) × education (2) × dialectal region of residence up to the age of 15 years (10) - was set at 12 500 words.
In the effort to achieve the highest possible speaker variability withing the scope of each category, a minimum of five different speakers was set ((Feagin, C. (2002). Entering the community: Fieldwork. Chambers, J. K., Trudgill, P. and Schilling-Estes, N., editors, //The Handbook of Language Variation and Change//, 20–39. Blackwell Publishing, Malden, MA.)). The aim of this provision to limit the influence of idiolect. 

===== ORTOFON v2 (2020) =====

In 2020, a new version of the corpus was published, featuring recordings from 2012 to 2019. Unlike the original version, this new one is **not balanced** in any way. Its purpose is to provide access to as much of the collected material as possible. While collection of informal dialogues is ongoing, and some of the older material is still being processed for publication, this new version still contains twice as much data as the previous one. Apart from this, version 2 features many small improvements in the consistency of the transcription and in the annotation of the corpus.

===== ORTOFON v3 (2024) =====

The 3rd version of the ORTOFON corpus was published in 2024. It contains 110 127 words and captures 1 121 speakers from all over the Czech Republic in 697 recordings, made between 2012 and 2020, totaling 243 hours. It also includes data from both previous versions of the corpus. The transcription at the orthographic and phonetic level as well as the corresponding audio recording are available in the KonText corpus interface. For this version, a number of inconsistencies in the transcription have been removed and a number of corrections have been made.

The ORTOFON v3 corpus is automatically **annotated according to the SYN2020 standard**, see [[en:cnk:ortofon#morphological_tagging_of_the_ortofon_corpus|above]] for more details.
===== Acknowledgments =====

We thank all our collaborators who took part in the collection, transcription, and proofreading of the recordings. 

Namely, we would like to especially thank the transcription coordinators: PhDr. Ilona Adámková, Mgr. Vendula Hálková, Dr. Dana Hlaváčková, Mgr. Lenka Klatovská, Mgr. Anna Marklová, PhDr. Eva Pasáčková, Mgr. Pavla Smolová, Marika Svojanovská, Mgr. Pavel Šturm, Dr. Miloslav Vondráček and Mgr. Lenka Zábojová.

===== How to cite =====

<WRAP round tip 70%>
Kopřivová, M. – Laubeová, Z. – Lukeš, D. – Poukarová, P. – Škarpová, M.: //ORTOFON v2: Korpus neformální mluvené češtiny s víceúrovňovým přepisem//. Ústav Českého národního korpusu FF UK, Praha 2020. Retrieved from: http://www.korpus.cz

Kopřivová, M. – Komrsková, Z. – Lukeš, D. – Poukarová, P. – Škarpová, M.: //ORTOFON v1: Korpus neformální mluvené češtiny s víceúrovňovým přepisem//. Ústav Českého národního korpusu FF UK, Praha 2017. Retrieved from: http://www.korpus.cz

Komrsková, Z. – Kopřivová, M. – Lukeš, D. – Poukarová, P. – Goláňová, H. (2017): New Spoken Corpora of Czech: ORTOFON and DIALEKT. //Jazykovedný časopis//, 68(2), 219-228. ISSN 0021-8897.

Kopřivová M. – Goláňová H. – Klimešová P. – Komrsková Z. – Lukeš D. (2014): Multi-tier Transcription of Informal Spoken Czech: The ORTOFON Corpus Approach. In //Complex Visibles Out There//. Olomouc: Univerzita Palackého v Olomouci, 529-544.

Kopřivová M. – Goláňová H. – Klimešová P. – Lukeš D.(2014): Mapping Diatopic and Diachronic Variation in Spoken Czech: the ORTOFON and DIALEKT Corpora. In //Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC 2014)//. Reykjavík, Iceland, European Language Resources Association, 376-382.
</WRAP>

===== Related links =====

<WRAP round box 72%>
[[ORAL]] • [[ORAL2006]] • [[ORAL2008]] • [[ORAL2013]] • [[PMK]] • [[BMK]] • [[SCHOLA2010]] • [[en:cnk:dialekt|DIALEKT]] • [[en:cnk:lemtag_mluv|Lemmatization and tagging in spoken corpora]]
 </WRAP>
Trace: • frekvencni_distribuce • tagery • spojovnik_nespojovnik_sublemmata • syd • pozice2 • verze5 • negace • gen1 • olgarichterova • problemy_lemmatizace