The EXA4MIND project enables Extreme Data analytics, leveraging top-notch computing facilities and optimum data stores – from object stores over relational databases to NoSQL databases. EXA4MIND aims to facilitate data-flow connectivity between its database and object-storage deployments, computing systems at supercomputing centres, and the European data ecosystem (EUDAT, EOSC, European Data Spaces). In such demanding setting, using the databases efficiently and effectively is critical. Deliverable D3.3 presents how different types of databases and data storage systems are used in the Platform and Application Cases with a focus on improvement provided with the effective data management in the AQIS workflows. The obtained improvements are presented under two subtitles: (i) Functional Improvements, and (ii) Performance Improvements. The functional improvements describe the new functionalities provided to the Application Cases with the use of databases and database querying, whereas the performance improvements include the improvements obtained in comparison to previous status of the functionalities and services by the Application Cases with the integration of databases or tailoring the way databases are accessed and queried. The solutions we present are also applicable to a variety of other possible use cases.
The EXA4MIND Consortium (Fri,) studied this question.