7b9f1a37-d6ec-4628-a0a5-994c2a865a3c 1.0 Phytosociological Inventory Import: ZIP with XMLs to Database 2023-12-31T00:00:00 This workflow aims to streamline the integration of phytosociological inventory data stored in multiple XML files within a ZIP archive into a MongoDB database. This process is crucial for effective data management within the project's Virtual Research Environment (VRE). The workflow involves extracting XML files from the ZIP archive, converting them to JSON format for MongoDB compatibility, checking for duplicates to ensure data integrity, and uploading the data to increment the inventory count. This enhances the robustness and reliability of the inventory dataset for comprehensive analysis.<div><br></div><div>Background</div><div>Efficient data management is crucial in phytosociological inventories, necessitating seamless integration of inventory data. This workflow addresses a key aspect by facilitating the importation of phytosociological inventories stored in multiple XML files within a ZIP archive into the MongoDB database. This integration is vital for the project's Virtual Research Environment (VRE), providing a foundation for robust data analysis. The workflow comprises two essential components: converting XML to JSON and checking for inventory duplicates, ultimately enhancing the integrity and expansiveness of the inventory database.</div><div><br></div><div>Introduction</div><div>In phytosociological inventories, effective data handling is paramount, particularly concerning the integration of inventory data. This workflow focuses on the pivotal task of importing phytosociological inventories, stored in multiple XML files within a ZIP archive, into the MongoDB database. This process is integral to the VRE of the project, laying the groundwork for comprehensive data analysis. The workflow's primary goal is to ensure a smooth and duplicate-free integration, promoting a reliable dataset for further exploration and utilization within the project's VRE.</div><div><br></div><div>Aims</div><div>The primary aim of this workflow is to streamline the integration of phytosociological inventory data, stored in multiple XML files within a ZIP archive, into the MongoDB database. This ensures a robust and duplicate-free dataset for further analysis within the project's VRE. To achieve this, the workflow includes the following key components:</div><div>- ZIP Extraction and XML to JSON Conversion: Extracts XML files from the ZIP archive and converts each phytosociological inventory stored in XML format to JSON, preparing the data for MongoDB compatibility. - Duplicate Check and Database Upload: Checks for duplicate inventories in the MongoDB database and uploads the JSON files, incrementing the inventory count in the database.</div><div><br></div><div>Scientific Questions</div><div>- ZIP Archive Handling: How effectively does the workflow handle ZIP archives containing multiple XML files with distinct phytosociological inventories?</div><div>- Data Format Compatibility: How successful is the conversion of XML-based phytosociological inventories to the JSON format for MongoDB integration? - Database Integrity Check: How effective is the duplicate check component in ensuring data integrity by identifying and handling duplicate inventories? - Inventory Count Increment: How does the workflow contribute to the increment of the inventory count in the MongoDB database, and how is this reflected in the overall project dataset?</div> José Francisco Aldana Montes University of Malaga jfaldana@uma.es Francisco Manuel SÁNCHEZ-CANO LifeWatch ERIC ICT Core franciscom.sanchez@lifewatch.eu Antonio José SÁENZ-ALBANÉS LifeWatch ERIC ICT Core aj.saenz@lifewatch.eu ICT Core Group LifeWatch ERIC ICT Core ict.coordination@lifewatch.eu Phytosociological inventory ZIP archive XML files JSON conversion MongoDB database Data integration Duplicate check Data integrity Virtual Research Environment (VRE) Inventory count increment Copyright 2023 Khaos Research Group Import file ZIP Extract XML files from the provided ZIP archive https://gitlab.lifewatch.dev/lfw002-khaos/wrapper-library/-/tree/develop/core/ImportFile/0.0.5 ZIP XML to JSON Convert each extracted XML file, which contains phytosociological inventory data, into JSON format for compatibility with MongoDB. Check the JSON data against existing entries in the MongoDB database to identify and handle any duplicates, ensuring data integrity. https://gitlab.lifewatch.dev/lfw002-khaos/wrapper-library/-/tree/develop/data-processing/Zipxml2json/1.0.0 Import to DB Upload the verified, duplicate-free JSON data into the MongoDB database, updating the inventory count. https://gitlab.lifewatch.dev/lfw002-khaos/wrapper-library/-/tree/develop/data-sink/Json2db/1.0.0 https://helpdesk.lifewatch.eu DOI