WENDELIN combines Scikit Learn machine learning and NEO distributed storage for out-of-core data analytics in python
Table of Contents
Agenda
- Create Data Supply
- Create Data Supply Lines
This tutorial teaches how to create Data Supply to prepare Wendelin to receive data sent by fluentd from IoT Gateway.
Data Supplies
On the modules page click on Data Supplies.
Add
Click on Add button to add new Data Supply.
Create Document
Continue with clicking on Create Document.
Fill the Form
First fill in the Title and Reference for the Data Supply.
Pay attention on the reference, we name it simply sensor_1 as we have only 1 sensor that will be sending data to wendelin.
This reference will be used in later tutorials when we will configure fluentd.
Fill the Form Cont.
Imagine an example of a Sample Company that owns a Sample Factory where is a sensor that sends data to wendelin.
Then the source of the data is Sample Factory.
Source - where data comes from.
Fill the Form Cont.
Continuing the example, the Source Section is Sample Company.
Source Section - owner of data before the ingestion.
Fill the Form Cont.
Destination - physical place where data is stored.
Destination Section - owner of data after ingestion. Can be the same as the source.
Save
After click on Save button to save the changes.
Validate
After it is saved, click on Validate on left side panel to validate the Data Supply.
Confirm Valdation
Click on Validate to confirm validation.
Add Data Supply Line
Click on Add button to add Data Supply Line.
Create Document
Continue with clicking on Create Document.
Fill the Form
Title: Ingest Bucket Data
Reference: ingestion_operation
For Product or Service - data operation by default exists in wendelin. when you type in the field Ingest Data from drop down list choose the existing one.
Fill the Form Cont.
For Item we choose Data Acquisition Unit that we created in the previous tutorial.
Save
After click on Save button to save the changes.
Back to Data Supply
Click on Data Supply Line: Ingest Bucket Data to go back and create another Data Supply line
Add Data Supply Line
Click on Add button to add Data Supply Line.
Create Document
Continue with clicking on Create Document.
Fill the Form
Title: Sample Environment Data
Reference: out_stream
For Product or Service we choose Data Product that we created in the previous tutorial.
Fill the Form Cont.
For Use from drop down list choose Big Data/Ingestion/Stream Ingestion.
Save
After click on Save button to save the changes.
Data Supply
Data Supply with Data Supply Lines is ready.
Related Articles