A conceptual model and reference architecture in BigDataStack
Description
BigDataStack aims to deliver a complete stack including an infrastructure management system that drives decisions according to the live and historical data, thus being fully scalable, runtime adaptable and high-performant. In this way, BigDataStack will address the emerging needs of big data operations and data-intensive applications. On top of the infrastructure management system, “Data as a Service” will be offered to data providers, decision-makers, private and public organisations.
Building blocks in the BigDataStack architecture
To provide the required information towards enhanced infrastructure management BigDataStack will provide a range of services, such as:
- Application dimensioning workbench to facilitate data-focused application analysis and dimensioning in terms of predicting the required data services, their interdependencies with the application micro-services and the underlying resources necessary.
- Data toolkit to enable data scientists to ingest their data analytics functions and to specify their preferences and constraints, which will be exploited by the infrastructure management system for resources and data management.
- Process modelling framework to enable functionality-based modelling of processes, which will be mapped in an automated way to concrete technical-level process mining analytics.
The aforementioned key outcomes of BigDataStack are reflected in a set of main building blocks in the corresponding overall architecture of the stack reflected in the figure with key offerings below.
This document summarizes the initial version of the BigDataStack architecture, including the capabilities of the overall environment to different stakeholders as well as the architecture of the complete environment. Additional information is provided on a component level, while the report also captures the main interactions between key components of the architecture.
Conclusions and next steps
The basis is set for the detailed design specifications of the individual components of the architecture and drives the activities of the project towards the overall vision and objectives. An updated version of the architecture will be released on June 2019, following the outcomes of the initial integrated prototypes and the obtained experimentation and validation results.
To learn more join our BigDataStack community on bigdatastack.eu
Follow us on Twitter @BigDataStackEU and LinkedIn
Number:
D2.40
