WENDELIN combines Scikit Learn machine learning and NEO distributed storage for out-of-core data analytics in python
Table of Contents
Agenda
- See Data In Wendelin
- Download Data
This tutorial teaches how to verify data arrival on wendelin and how to download the data.
Before doing this tutorial make sure you read and completed the following tutorials
Wendelin Dashboard
Open your Wendelin dashboard.
You see that new Data Stream and Data Ingestion were created.
Data Stream
From your Wendelin dashboard click on Data Stream.
In Data Stream you can see the Total size (bytes) of the ingested data.
If you reload the page the size will change as new data arrives.
Download Data
You can see and download data using the curl commad:
curl -k -u [user]:[password] https://[hostname]/erp5/data_stream_module/[id] -r [start]-[end] --output data.txt
As data can be very big you can define start and stop bytes to download a slice of data.
Related Articles