Deze website is verplaatst naar Data-docent.nl



Big Data Mechanisms overview

Technology mechanisms represent well-defined IT artifacts that are established within an IT industry.

Version 1.0
Created date 08-05-2016

Compression Engine

Big data sets can be voluminous so compressing has advantages for storage and/or processing

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Compression Engine

Processing Engine

Processing of data for transformation, cleaning and filtering of data

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Processing Engine

Security Manager

Administration and registration of security concepts in a Big Data environment.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Security Manager

Serialization Engine

Serialization and deserialization of proprietary datasets to standardized stored datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Serialization Engine

Productivity Portal

Portal functionality to give users and administrator access to the other logical functionalities in a Big Data environment.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Productivity Portal

Data Transfer Engine

Transformation and transfer functionality from data sources to storage, processing and usage.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data Transfer Engine

Analytics Engine

Functionality for analysing the transformed and standardized data in a data analytics tool.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Analytics Engine

Coordination Engine

Coordination of automated tasks for example in batch processes and mapreduce.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Coordination Engine

Visualization Engine

Visualisation of query and analytics results to data scientists and end users.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Visualization Engine

Workflow Engine

Functionality to design workflows to automatically perform transformations and cleaning of datasets.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Workflow Engine

Cluster Manager

Management of clusters in a distributed or cloud based infrastructure

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Cluster Manager

Query Engine

Retrieval and querying function on the transformed and standardized datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Query Engine

Resource Manager

Management function for the various resources in a Big Data environment

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Resource Manager

Storage Device

Storage function of big data sets.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Storage Device

Data Governance Manager

Register function for the governance of data sets in relation to consumers, business owners and qualities.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data Governance Manager