An Architecture for the Development of Distributed Analytics Based on Polystore Events

Zolotas, Athanasios, Barmpis, Konstantinos, Medhat, Fady orcid.org/0000-0003-2827-4487 et al. (3 more authors) (2021) An Architecture for the Development of Distributed Analytics Based on Polystore Events. In: Gadepally, Vijay, Mattson, Timothy, Stonebraker, Michael, Kraska, Tim, Wang, Fusheng, Luo, Gang, Kong, Jun and Dubovitskaya, Alevtina, (eds.) Heterogeneous Data Management, Polystores, and Analytics for Healthcare - VLDB Workshops, Poly 2020 and DMAH 2020, Revised Selected Papers. VLDB workshops: International Workshop on Polystore Systems for Heterogeneous Data in Multiple Databases with Privacy and Security Assurances, Poly 2020, and 6th International Workshop on Data Management and Analytics for Medicine and Healthcare, DMAH 202, 31 Aug - 04 Sep 2020 Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) . Springer , Virtual, Online , pp. 54-65.

Abstract

To balance the requirements for data consistency and availability, organisations increasingly migrate towards hybrid data persistence architectures (called polystores throughout this paper) comprising both relational and NoSQL databases. The EC-funded H2020 TYPHON project offers facilities for designing and deploying such polystores, otherwise a complex, technically challenging and error-prone task. In addition, it is nowadays increasingly important for organisations to be able to extract business intelligence by monitoring data stored in polystores. In this paper, we propose a novel approach that facilitates the extraction of analytics in a distributed manner by monitoring polystore queries as these arrive for execution. Beyond the analytics architecture, we presented a pre-execution authorisation mechanism. We also report on preliminary scalability evaluation experiments which demonstrate the linear scalability of the proposed architecture.

Metadata

Item Type:	Proceedings Paper
Authors/Creators:	Zolotas, Athanasios (amz502@york.ac.uk) Barmpis, Konstantinos (konstantinos.barmpis@york.ac.uk) Medhat, Fady https://orcid.org/0000-0003-2827-4487 Neubauer, Patrick https://orcid.org/0000-0002-9811-4772 Kolovos, Dimitris https://orcid.org/0000-0002-1724-6563 Paige, Richard F. https://orcid.org/0000-0002-1978-9852
Editors:	Gadepally, Vijay Mattson, Timothy Stonebraker, Michael Kraska, Tim Wang, Fusheng Luo, Gang Kong, Jun Dubovitskaya, Alevtina
Copyright, Publisher and Additional Information:	Funding Information: Acknowledgements. This work is funded by the TYPHON project (#780251). Funding Information: This work is funded by the European Union Horizon 2020 TYPHON project (#780251). Publisher Copyright: © 2021, Springer Nature Switzerland AG. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details.
Keywords:	Analytics,Hybrid databases,Polystores,Queries
Dates:	Published: 4 March 2021
Institution:	The University of York
Academic Units:	The University of York > Faculty of Sciences (York) > Computer Science (York) The University of York > Faculty of Sciences (York) > Electronic Engineering (York)
Depositing User:	Pure (York)
Date Deposited:	25 Apr 2024 07:40
Last Modified:	08 Feb 2025 00:12
Published Version:	https://doi.org/10.1007/978-3-030-71055-2_5
Status:	Published
Publisher:	Springer
Series Name:	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Identification Number:	10.1007/978-3-030-71055-2_5
Related URLs:	http://www.scopus.com/inward/record.url?...
Open Archives Initiative ID (OAI ID):	oai:eprints.whiterose.ac.uk:211852

Download

Accepted Version

Filename: An_architecture_for_the_development_of_distributed_analytics_based_on_polystore_events.pdf

Description: An architecture for the development of distributed analytics based on polystore events

CLICK TO DOWNLOAD

[thumbnail of An architecture for the development of distributed analytics based on polystore events]

CORE (COnnecting REpositories)

An Architecture for the Development of Distributed Analytics Based on Polystore Events

Abstract

Metadata

Download

Accepted Version

Export

Statistics