D4.1 - Demonstrating Data as a Service in Big Data Stack

Demonstrating Data as a Service in Big Data Stack

Overview

The Data as a Service block presents a fine set of data services which can be mapped to the major phases of Big Data processing. The architecture and the design of these data services are achieved through dedicated techniques, contextualized in the BigDataStack environment in order to run on top of the data-driven infrastructure management system and provide the required data services.

Results obtained

  • The adaptable distributed storage component is based on the LeanXcale relational data store;
  • Big Data Layout and data skipping covers automated big data layout, as well as state of the art skipping techniques, in order to improve SQL analytics on rectangular data in object storage. This component also aims to research automatic algorithms for dynamic data layout and data skipping index creation;
  • The Data Quality mechanisms offer domain-agnostic data cleaning, veracity and enhancement;
  • The Predictive and Process Analytics component strives, using multiple process mining algorithms, to analyse, structure and process models derived from event-driven data;
  • The Complex Event Processing will run on geo-distributed environments in order to avoid delays in the processing and optimize resource consumption;
  • The Seamless data analytics framework builds on top of the LeanXcale database and IBM Cloud Object Storage.

Main Take-aways

This set of data services is very powerful and it fits 2 particular important scenarios: data ingestion and data query. The goal is not only to show the strength of solutions built out of BigDataStack data services but also the ease with which they can be assembled.

 

 

To learn more join our BigDataStack community on bigdatastack.eu
Follow us on Twitter @BigDataStackEU  and LinkedIn

Number: 
D4.10

Privacy Overview


Cookies consist of portions of code installed in the browser that assist the owner in providing the service based on the purposes described. Some of the purposes of installing cookies may also require the consent of the user. When the installation of cookies takes place on the basis of consent, this consent can be revoked freely at any time following the instructions contained in this document.

Please read the privacy policy

Strictly Necessary Cookies

These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work. These cookies do not store any personally identifiable information.

3rd Parties Cookies

These cookies enable the website to provide enhanced functionality and personalisation. They may be set by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly. We'd like also to set Google Analytics cookies to help us to improve our website by collecting and reporting information on how you use it. The cookies collect information in a way that does not directly identify anyone. Under current GDPR, the installation of these third-party cookies requires your prior consent. For more information on how these cookies work, please see our 'Cookies policy'.