Wendelin Exanalytics Libre

WENDELIN combines Scikit Learn machine learning and NEO distributed storage for out-of-core data analytics in python

Agenda

  • See Data In Wendelin
  • Download Data

 

This tutorial teaches how to verify data arrival on wendelin and how to download the data. 

Before doing this tutorial make sure you read and completed the following tutorials

 

Wendelin Dashboard

Open your Wendelin dashboard. 

You see that new Data Stream and Data Ingestion were created. 

Data Stream

From your Wendelin dashboard click on Data Stream. 

In Data Stream you can see the Total size (bytes) of the ingested data.

If you reload the page the size will change as new data arrives.

Download Data

You can see and download  data using the curl commad: 

curl -k -u [user]:[password] https://[hostname]/erp5/data_stream_module/[id] -r [start]-[end] --output data.txt

As data can be very big you can define start and stop bytes to download a slice of data.