| commit | 4fbd0950591a7748c97061944ec1c0bd7bde7815 | [log] [tgz] |
|---|---|---|
| author | lora-sp <lora.spassova@swhk.ids-mannheim.de> | Thu Apr 06 11:46:04 2023 +0200 |
| committer | lora-sp <lora.spassova@swhk.ids-mannheim.de> | Thu Apr 06 11:46:04 2023 +0200 |
| tree | 9acadc4d657602fe3f59270f0a4dc16102b85d54 | |
| parent | 97c3e5373df62a4cab0925438f0e21636378ceaf [diff] |
updated readme Change-Id: Ic0dd0d3520ce888d58a152b5ec5241b87437500b
This tool contains two python scripts,bunc2tei.py and escape_amp.py.
The script bunc2tei.py can be executed with the command bunc2tei.py *.xml > corpus.p5.xml.
teiCorpus as its root. The corpus file will be built from it.extract_data. Extract_data tries to parse the xml file. If the parsing fails, it means the xml file is faulty and needs to be repaired first. This is done by the script escape_amp.py and will be explained in the next section. If the parsing succeeds, the relevant data is then extracted by saving the metadata and text elements in a dictionary. The dictionary is then passed to the function create_tree.Create_tree creates a new xml tree with the element teiDoc as its root. All relevant elements are then inserted at the desired position in the xml tree and filled with the data from the dictionary.The script escape_amp.py aims at fixing xml files that cannot be processed due to unescaped symbols. In the Bulgarian National Corpus, this was the case for ampersand symbols inside text elements. The script can be executed using escape_amp.py *.xml.
escape.Escape looks for all &-symbols that are not yet escaped and that are not themselves used to escape another symbol using a regular expression.&-symbols are replaced by their escaped variant inside the file.