CODIT corpus

Corpus diacronico dell’italiano – ‘Diachronic corpus of Italian’

The CODIT corpus is a balanced diachronic corpus of written Italian of around 33 million tokens; it covers a period ranging from the earliest attestations of the Italian language (i.e. the XIII century) to 1947. Its structure recalls that shown by the MIDIA corpus (Morfologia Italiana in Diacronia ‘Italian Morphology in Diachrony’, 7.5 million tokens). The corpus currently consists of raw (not annotated) texts, but POS annotation and lemmatization will be added. The corpus is structured into five subcorpora, depending on the chronological period. The periodization follows that adopted for the MIDIA corpus: it is based on important linguistic and social facts of the Italian history. Particularly, the five subcorpora are the following:

1. XIII century – 1375: this subcorpus represents a period ranging between the earliest attestations of the Italian language and the Boccaccio’s death.
2. 1376 – 1532: this subcorpus represents a period encompassing Humanism and Renaissance. It ends in 1532 with the publication of the third edition of the Orlando furioso by Ludovico Ariosto.
3. 1533 – 1691: this subcorpus represents the literary Mannerism and Baroque. It ends in 1691 with the publication of the third edition of the Vocabolario by the Accademia della Crusca.
4. 1692 – 1840: this subcorpus encompasses the Enlightenment and Romantic period. It ends in 1840 with the publication of the final edition of the Promessi Sposi by Alessandro Manzoni.
5. 1841 – 1947: this subcorpus represents a period ranging from the Risorgimento to the end of the Second World War. It ends in 1947 with the publication of the Italian Constitution.

Each subcorpus collects texts belonging to six genres, particularly essay, literary prose, poetry, letters, scientific texts, theatre. The only exception is the first subcorpus, which does not include scientific texts. Each text has been included in its entirety. As far as the size of the corpus is concerned (see Table 1), each subcorpus includes around 7 million tokens, with the exception of the first subcorpus which consists of 4.5 tokens, due to the difficulty in collecting texts in electronic form. The structure of the corpus, which includes five (almost) comparable subcorpora, allows to carry out empirical investigations on diachronic phenomena.  

Table 1: CODIT structure and size