After unzipping the downloaded archive, the data can be found in directory
data, where they are divided into four subdirectories representing four source corpora:
The fifth subdirectory there (
dictionaries) contains two lexicons related to the corpora:
pdtvallex-4.0.xml- Czech valency lexicon PDT-Vallex 4.0
czech-morfflex-2.0.xz- Czech morphological dictionary
All four corpora are uniformly published in three formats and placed in the respective directories:
pml- a PML format (see below) used in the previous versions of the PDT since version 2.0 (each document is represented by four files corresponding to four layers: t-layer (tectogrammatics), a-layer (analytics, surface syntax), m-layer (morphology) and w-layer (word layer, tokenized text)
treex- technically also a PML format, used in the NLP system Treex (all annotation layers are in a single file)
mrp- a JSON-based format used in the CoNLL 2019 and 2020 shared tasks on meaning representation parsing (see Uniform Graph Interchange Format); unlike the PML and Treex formats, the conversion to the MRP format is lossy - it extracts part of the annotation from the t- and w-layers while discarding morphology and surface syntax (Zeman and Hajič 2020)
Corpora with singular properties are available also in additional formats/directories:
PDTSC/full; please note that the numbering of files in this directory differs from the PDTSC 1.0; also, in some files, links from the wdata layer to the zdata layer were unfortunately lost during the annotation process of the PDTSC 2.0 and could not be restored. It concerns the following wdata files:
pdtsc_148; they correspond to the following higher-layers files:
In each directory, the PDT data are further divided into ten subdirectories (
etest), suggesting their recommended use in machine-learning experiments (train data, development test data, evaluation test data).
tamw- documents annotated on all three annotation layers (morphological, analytical, tectogrammatical)
amw- documents annotated on the morphological and analytical layer (but not on the tectogrammatical layer)
mw- documents annotated on the morphological layer only.
Please note that for the PDTSC, directory
PDTSC/full should be considered the primary data source, as directory
PDTSC/pml only contains (for each document) one reconstructed m-layer file, an artificial w-layer file and no lower layers. However, the morphological annotation is only present in the m-layer files in directory
PDTSC/pml (it is not in the mdata files in directory
The Prague Markup Language format (PML, Pajas and Štěpánek 2008) is an XML based format for linguistic annotation (esp. treebanks). With the exception of the MRP and audio files, all data formats of the corpora in the PDT-C are instances of the PML. For the sake of completeness, PML schemata of the files can be found in directory
resources. (The schemata are XML files that describe the structure of the annotated files.)
Tree editor TrEd (Pajas and Štěpánek 2008) can be used to open and browse the PML data, i.e. data in directories
treex and, for the PDTSC, also directory
full. Please note that in directories
PDTSC/full, only t-files, a-files and m-files (mdata-files) can be opened directly in TrEd.
The editor can be downloaded for various platforms from its home page. Please follow installation instructions specified for your operating system.
PDTSC/full, make sure that at least the extension "Prague Dependency Treebank - Consolidated 1.0 (pdtc10)" is checked to install (if it is not in the list, it may have already been installed).
treex, make sure that at least the extension "EasyTreex - browse and edit Treex files (*.treex, *.treex.gz, *.streex) (easytreex)" is checked to install (if it is not in the list, it may have already been installed).
Now, TrEd is able to open t-layer, a-layer and m-layer (mdata-layer) files in directories
PDTSC/full, and files in directories
treex of the PDT-C 1.0.
In case of troubles with the installation of TrEd or the extensions, or with browsing the data, please refer to the Troubleshooting section or contact the authors at (tred
Editor MEd can be used to open lower-layer files of data in directory
PDTSC/full, i.e. mdata files interlinked down to the audio layer. To install the editor, please follow installation instructions at its home page.
Before opening the mdata files, make sure that you have schemata
wdata_c_schema.xml from directory
resources in the same directory as the mdata files.
PML Tree Query (PML-TQ; Pajas and Štěpánek 2009) is a powerful client-server system for querying treebanks, developed primarily for searching in the PDT data. The PDT-C as a whole and also all its subcorpora separately are available for searching using the PML-TQ from ÚFAL's public PML-TQ server. There are two clients available:
For further information about the clients, see the PML-TQ clients documentation. For general info about the PML-TQ, please refer to the PML-TQ web page. For documentation about the query language and tutorials, see the PML-TQ user documentation.
There are several PDT-C data sets available for searching (treebank ids for the TrEd client are in parentheses):
pdtc10): the whole PDT-C 1.0 data (without the English part of the PCEDT and the audio-related layers of the PDTSC)
pdtc10_faust): the Faust part of the PDT-C 1.0
pdtc10_pcedt-cz): the Czech PCEDT part of the PDT-C 1.0
pdtc10_pdt): the PDT part of the PDT-C 1.0
pdtc10_pdtsc): the PDTSC part of the PDT-C 1.0 (without the audio-related layers)
In case of troubles with the PML-TQ or with searching in the PDT-C data particularly, please refer to the Troubleshooting section or try to contact the developers at (pmltq
Pajas, P. and Štěpánek, J.: Recent Advances in a Feature-Rich Framework for Treebank Annotation. In: The 22nd International Conference on Computational Linguistics - Proceedings of the Conference, The Coling 2008 Organizing Committee, Manchester, UK, ISBN 978-1-905593-45-3, pp. 673-680, 2008.
Pajas, P. and Štěpánek, J.: System for Querying Syntactically Annotated Corpora. In: Proceedings of the ACL-IJCNLP 2009 Software Demonstrations, Association for Computational Linguistics, Suntec, Singapore, ISBN 1-932432-61-2, pp. 33-36, 2009.
Zeman, D. and Hajič, J.: FGD at MRP 2020: Prague Tectogrammatical Graphs. In: Proceedings of the CoNLL 2020 Shared Task: Cross-Framework Meaning Representation Parsing, Association for Computational Linguistics, Stroudsburg, PA, USA, ISBN 978-1-952148-64-4, pp. 33-39, 2020.
It seems that the TrEd extension easytreex has not succeeded in installing Perl modules Treex::Core. Try to install them manually from the command line via
cpanm Treex::Core or
It seems that your Perl modules Treex::Core are outdated. To solve this issue quickly, copy schemas
treex_subschema_t_layer.xml from directory
resources of the PDT-C distribution to the same directory as the .treex files you are opening. For a more permanent solution, try to uninstall and install again the easytreex TrEd extension. Finally, you can try to reinstall manually Perl modules Treex::Core, from the command line by
cpanm --reinstall Treex::Core.