WENDELIN combines Scikit Learn machine learning and NEO distributed storage for out-of-core data analytics in python

HowTos explain how to use Wendelin and achieve specific elementary tasks. If you can not find a howto replying to your need here, please get in touch with us through the contact section.

HowTos are grouped by keywords. Click on a keyword for displaying a list of related documents across the full documentation.

Jupyter

Jupyter Lab Extension Notes - This document provides a summary about the extension of file manager in Jupyter classic and Jupyter Lab in order to store Jupyter notebooks in ERP5.

Numpy

Out-of-core NumPy - A minimal tutorial to learn how to use wendelin.core library. It shows how to install wendelin.core and do basic out-of-core operations on ndarrays.

Scikit-Learn

Is my scikit-learn code run on Wendelin changed? - Using same Python, same stack, compiled from source.

Wendelin

Architecture - Wendelin Architecture
Evaluate Wendelin Tutorial - A tutorial for executives or data scientists evaluating Wendelin's big data capabilities.
Request Wendelin using SlapOS Dashboard - Step by step guide on requesting a Wendelin Instance in the SlapOS Panel
HowTo ingest data with ebulk inside Wendelin - A tutorial showing how to ingest data into Wendelin using ebulk.
Wendelin vs. Hadoop - Wendelin vs. Hadoop
HowTo Install Wendelin on Webrunner - Tutorial showing how to install Wendelin on webrunner.
HowTos, FAQs and Tutorials - Wendelin Documentation Links
HowTo Create Notebook with Plotly Chart Editor - HowTo Create Notebook with Poltly Chart Editor
Wendelin Data Analysis - A tutorial explaining how to use Wendelin to work with ingested data, including using out-of-core capabilities.
Installing and Using Wendelin on KVM - Tutorial showing how to install and work with Wendelin.
HowTo setup Fluentd on IOT Gateway - HowTo setup Fluentd on IOT Gateway
HowTo Create Data Supply - HowTo Create Data Supply
HowTo Enable User Registration - HowTo Enable User Registration
HowTo Transform Data - HowTo Transform Data
HowTo Resample Data - HowTo Resample Data
Getting Wendelin - Tutorial showing how to install Wendelin on multiple platforms.
Installing and Using Wendelin on Webrunner - Tutorial showing how to install and work with Wendelin.
HowTo Configure Wendelin Site - Tutorial showing how to install and work with Wendelin.
Wendelin for Data Engineers - Introduction to Wendelin for Data Science Industrialisation
HowTo Create Data Acquisition Unit - HowTo Create Data Acquisition Unit
What Is Wendelin - A tutorial introducing the Wendelin big data platform as well as the software components that power it.
Data Lake Security Model - Data Lake Security Model
HowTo Create Basic Prediction - HowTo Create Basic Prediction with scikit-learn
HowTo Setup Sensor and IOT Gateway - Tutorial showing how to setup Sensor and IOT Gateway
Visualization With Wendelin - A tutorial showing how to build websites with Wendelin to display computed data.
HowTo Check Data Arrival - HowTo Check Data Arrival on Wendelin
Installing and Using Wendelin on Linux machine - Tutorial showing how to install and work with Wendelin.
HowTo Create Data Product - HowTo Create Data Product
HowTo setup Fluentd on Sensor - HowTo setup Fluentd on Streamig Device
HowTo Use Wendelin for Big Data Collaboration - HowTo Use Wendelin for Big Data Collaboration
HowTo Create Notebook with Graphs - HowTo Create Notebook with Graphs

Wendelin.Core

Out-of-core NumPy - A minimal tutorial to learn how to use wendelin.core library. It shows how to install wendelin.core and do basic out-of-core operations on ndarrays.

Analysis

Wendelin Data Analysis - A tutorial explaining how to use Wendelin to work with ingested data, including using out-of-core capabilities.

Beginner

Evaluate Wendelin Tutorial - A tutorial for executives or data scientists evaluating Wendelin's big data capabilities.
HowTo ingest data with ebulk inside Wendelin - A tutorial showing how to ingest data into Wendelin using ebulk.
HowTo ingest data with ebulk in to Wendelin - A tutorial showing how to ingest data in to Wendelin using ebulk.
What Is Wendelin - A tutorial introducing the Wendelin big data platform as well as the software components that power it.

Big Data

Wendelin Data Analysis - A tutorial explaining how to use Wendelin to work with ingested data, including using out-of-core capabilities.
Visualization With Wendelin - A tutorial showing how to build websites with Wendelin to display computed data.

Computation

How can I process data? - Providing links to examples and test files showing data processing.
How can I add more nodes to Wendelin? - Not possible in the standard setup. Requires to use Webrunner.
Can I run parallel processes with Wendelin? - Setting process order using ERP5 CMFActivity Tool.
Is my scikit-learn code run on Wendelin changed? - Using same Python, same stack, compiled from source.

Configuration

Configure Wendelin With ERP5 - Instructions on how to modify the Wendelin standalone default configuration.

Console

Get Slice of Data Stream with curl - Wendelin Documentation How to get a slice of data in a Data Stream from the console using curl

Curl

Get Slice of Data Stream with curl - Wendelin Documentation How to get a slice of data in a Data Stream from the console using curl

Data

Wendelin Format - This document definies the Wendelin Data Format

Data Access

How can I access my data? - Information on the getData API and usage examples.

Data Model

Wendelin Data Model - This design document describes the Wendelin data model and how it derives from the generic Unified Business Model.

Data Stream

Get Slice of Data Stream with curl - Wendelin Documentation How to get a slice of data in a Data Stream from the console using curl

Database

What backend is Wendelin using? - Wendelin can be used with ZEO (standard) and NEO (distributed) databases.

Evaluate

Install Wendelin Standalone - Step by step guide on installing Wendelin Standalone
Evaluate Wendelin Tutorial - A tutorial for executives or data scientists evaluating Wendelin's big data capabilities.

Faq

FAQ - Wendelin frequently asked questions for developers, users and consultants try to answer the most common questions around Wendelin Big Data.

Fluentd

HowTo Setup Fluentd on SlapOS - HowTo Setup Fluentd

Format

Wendelin Format - This document definies the Wendelin Data Format

Getting Started

Configure Wendelin With ERP5 - Instructions on how to modify the Wendelin standalone default configuration.
Install Wendelin Standalone - Step by step guide on installing Wendelin Standalone
Request Wendelin using SlapOS Dashboard - Step by step guide on requesting a Wendelin Instance in the SlapOS Panel
Developer - Introduction to the Wendelin developer documentation including key indices and info on getting started.
What is Wendelin? - Wendelin is an open source Big Data and Machine Learning platform written entirely in Python.

Howto

HowTo - How Tos are short guides that describe precisely how to achieve specific elementary tasks with Wendelin.

Import

Uploading Data to Wendelin? - information on automatic ingestion via FluentD and manual uploads.
How to stream other formats (csv)? - Wendelin supports all types of raw datasets (including csv).

Install

Install Wendelin Standalone - Step by step guide on installing Wendelin Standalone

Installation

How can I install Wendelin? - Installation and Contribution guides
Architecture - Wendelin Architecture
Request Wendelin using SlapOS Dashboard - Step by step guide on requesting a Wendelin Instance in the SlapOS Panel
Wendelin vs. Hadoop - Wendelin vs. Hadoop
HowTo Install Wendelin on Webrunner - Tutorial showing how to install Wendelin on webrunner.
HowTos, FAQs and Tutorials - Wendelin Documentation Links
HowTo Create Notebook with Plotly Chart Editor - HowTo Create Notebook with Poltly Chart Editor
Installing and Using Wendelin on KVM - Tutorial showing how to install and work with Wendelin.
HowTo setup Fluentd on IOT Gateway - HowTo setup Fluentd on IOT Gateway
HowTo Enable User Registration - HowTo Enable User Registration
HowTo Transform Data - HowTo Transform Data
HowTo Resample Data - HowTo Resample Data
HowTo Setup Fluentd on SlapOS - HowTo Setup Fluentd
Getting Wendelin - Tutorial showing how to install Wendelin on multiple platforms.
Installing and Using Wendelin on Webrunner - Tutorial showing how to install and work with Wendelin.
HowTo Configure Wendelin Site - Tutorial showing how to install and work with Wendelin.
Data Lake Security Model - Data Lake Security Model
HowTo Setup Sensor and IOT Gateway - Tutorial showing how to setup Sensor and IOT Gateway
HowTo Check Data Arrival - HowTo Check Data Arrival on Wendelin
Installing and Using Wendelin on Linux machine - Tutorial showing how to install and work with Wendelin.
HowTo setup Fluentd on Sensor - HowTo setup Fluentd on Streamig Device
HowTo Use Wendelin for Big Data Collaboration - HowTo Use Wendelin for Big Data Collaboration
HowTo Create Notebook with Graphs - HowTo Create Notebook with Graphs

Memory

Out-of-core NumPy - A minimal tutorial to learn how to use wendelin.core library. It shows how to install wendelin.core and do basic out-of-core operations on ndarrays.

Out Of Core

Wendelin Data Analysis - A tutorial explaining how to use Wendelin to work with ingested data, including using out-of-core capabilities.

Out-Of-Core

Out-of-core NumPy - A minimal tutorial to learn how to use wendelin.core library. It shows how to install wendelin.core and do basic out-of-core operations on ndarrays.

Release

Wendelin.core - Release howto - This howto documents wendelin.core release procedure. It also applies to other Python software, for example to zodbtools and pygolang.

Setup

Architecture - Wendelin Architecture
Request Wendelin using SlapOS Dashboard - Step by step guide on requesting a Wendelin Instance in the SlapOS Panel
Wendelin vs. Hadoop - Wendelin vs. Hadoop
HowTo Install Wendelin on Webrunner - Tutorial showing how to install Wendelin on webrunner.
HowTos, FAQs and Tutorials - Wendelin Documentation Links
HowTo Create Notebook with Plotly Chart Editor - HowTo Create Notebook with Poltly Chart Editor
Installing and Using Wendelin on KVM - Tutorial showing how to install and work with Wendelin.
HowTo setup Fluentd on IOT Gateway - HowTo setup Fluentd on IOT Gateway
HowTo Enable User Registration - HowTo Enable User Registration
HowTo Transform Data - HowTo Transform Data
HowTo Resample Data - HowTo Resample Data
HowTo Setup Fluentd on SlapOS - HowTo Setup Fluentd
Getting Wendelin - Tutorial showing how to install Wendelin on multiple platforms.
Installing and Using Wendelin on Webrunner - Tutorial showing how to install and work with Wendelin.
HowTo Configure Wendelin Site - Tutorial showing how to install and work with Wendelin.
Data Lake Security Model - Data Lake Security Model
HowTo Setup Sensor and IOT Gateway - Tutorial showing how to setup Sensor and IOT Gateway
HowTo Check Data Arrival - HowTo Check Data Arrival on Wendelin
Installing and Using Wendelin on Linux machine - Tutorial showing how to install and work with Wendelin.
HowTo setup Fluentd on Sensor - HowTo setup Fluentd on Streamig Device
HowTo Use Wendelin for Big Data Collaboration - HowTo Use Wendelin for Big Data Collaboration
HowTo Create Notebook with Graphs - HowTo Create Notebook with Graphs

Stack

HowTo ingest data with ebulk inside Wendelin - A tutorial showing how to ingest data into Wendelin using ebulk.
HowTo ingest data with ebulk in to Wendelin - A tutorial showing how to ingest data in to Wendelin using ebulk.
What Is Wendelin - A tutorial introducing the Wendelin big data platform as well as the software components that power it.

Storage

Where can I store my work? - Information on working with scripts in ERP5 Portal Components

Technical Note

Technical Notes - Technical Notes include discussions and notes on certain topics made public to help Wendelin developers.

Unified Business Model

Wendelin Data Model - This design document describes the Wendelin data model and how it derives from the generic Unified Business Model.

Visualization

How can I visualize computation results? - Info on use of Jupyter Notebook and ERP5 web applications.
Visualization With Wendelin - A tutorial showing how to build websites with Wendelin to display computed data.

Wendelin

Wendelin Format - This document definies the Wendelin Data Format
HowTo ingest data with ebulk in to Wendelin - A tutorial showing how to ingest data in to Wendelin using ebulk.

Computation

How can I process data? - Providing links to examples and test files showing data processing.
How can I add more nodes to Wendelin? - Not possible in the standard setup. Requires to use Webrunner.
Can I run parallel processes with Wendelin? - Setting process order using ERP5 CMFActivity Tool.
Is my scikit-learn code run on Wendelin changed? - Using same Python, same stack, compiled from source.

Data Access

How can I access my data? - Information on the getData API and usage examples.

Data Model

Wendelin Data Model - This design document describes the Wendelin data model and how it derives from the generic Unified Business Model.

Data Stream

Get Slice of Data Stream with curl - Wendelin Documentation How to get a slice of data in a Data Stream from the console using curl

Database

What backend is Wendelin using? - Wendelin can be used with ZEO (standard) and NEO (distributed) databases.

Faq

FAQ - Wendelin frequently asked questions for developers, users and consultants try to answer the most common questions around Wendelin Big Data.

Fluentd

HowTo Setup Fluentd on SlapOS - HowTo Setup Fluentd

Getting Started

Configure Wendelin With ERP5 - Instructions on how to modify the Wendelin standalone default configuration.
Install Wendelin Standalone - Step by step guide on installing Wendelin Standalone
Developer - Introduction to the Wendelin developer documentation including key indices and info on getting started.
What is Wendelin? - Wendelin is an open source Big Data and Machine Learning platform written entirely in Python.

Howto

HowTo - How Tos are short guides that describe precisely how to achieve specific elementary tasks with Wendelin.

Import

Uploading Data to Wendelin? - information on automatic ingestion via FluentD and manual uploads.
How to stream other formats (csv)? - Wendelin supports all types of raw datasets (including csv).

Installation

How can I install Wendelin? - Installation and Contribution guides

Jupyter

Jupyter Lab Extension Notes - This document provides a summary about the extension of file manager in Jupyter classic and Jupyter Lab in order to store Jupyter notebooks in ERP5.

Numpy

Out-of-core NumPy - A minimal tutorial to learn how to use wendelin.core library. It shows how to install wendelin.core and do basic out-of-core operations on ndarrays.

Release

Wendelin.core - Release howto - This howto documents wendelin.core release procedure. It also applies to other Python software, for example to zodbtools and pygolang.

Storage

Where can I store my work? - Information on working with scripts in ERP5 Portal Components

Technical Note

Technical Notes - Technical Notes include discussions and notes on certain topics made public to help Wendelin developers.

Visualization

How can I visualize computation results? - Info on use of Jupyter Notebook and ERP5 web applications.

Wendelin

Architecture - Wendelin Architecture
Wendelin Format - This document definies the Wendelin Data Format
Evaluate Wendelin Tutorial - A tutorial for executives or data scientists evaluating Wendelin's big data capabilities.
Request Wendelin using SlapOS Dashboard - Step by step guide on requesting a Wendelin Instance in the SlapOS Panel
HowTo ingest data with ebulk inside Wendelin - A tutorial showing how to ingest data into Wendelin using ebulk.
Wendelin vs. Hadoop - Wendelin vs. Hadoop
HowTo Install Wendelin on Webrunner - Tutorial showing how to install Wendelin on webrunner.
HowTos, FAQs and Tutorials - Wendelin Documentation Links
HowTo ingest data with ebulk in to Wendelin - A tutorial showing how to ingest data in to Wendelin using ebulk.
HowTo Create Notebook with Plotly Chart Editor - HowTo Create Notebook with Poltly Chart Editor
Wendelin Data Analysis - A tutorial explaining how to use Wendelin to work with ingested data, including using out-of-core capabilities.
Installing and Using Wendelin on KVM - Tutorial showing how to install and work with Wendelin.
HowTo setup Fluentd on IOT Gateway - HowTo setup Fluentd on IOT Gateway
HowTo Create Data Supply - HowTo Create Data Supply
HowTo Enable User Registration - HowTo Enable User Registration
HowTo Transform Data - HowTo Transform Data
HowTo Resample Data - HowTo Resample Data
Getting Wendelin - Tutorial showing how to install Wendelin on multiple platforms.
Installing and Using Wendelin on Webrunner - Tutorial showing how to install and work with Wendelin.
HowTo Configure Wendelin Site - Tutorial showing how to install and work with Wendelin.
Wendelin for Data Engineers - Introduction to Wendelin for Data Science Industrialisation
HowTo Create Data Acquisition Unit - HowTo Create Data Acquisition Unit
What Is Wendelin - A tutorial introducing the Wendelin big data platform as well as the software components that power it.
Data Lake Security Model - Data Lake Security Model
HowTo Create Basic Prediction - HowTo Create Basic Prediction with scikit-learn
HowTo Setup Sensor and IOT Gateway - Tutorial showing how to setup Sensor and IOT Gateway
Visualization With Wendelin - A tutorial showing how to build websites with Wendelin to display computed data.
HowTo Check Data Arrival - HowTo Check Data Arrival on Wendelin
Installing and Using Wendelin on Linux machine - Tutorial showing how to install and work with Wendelin.
HowTo Create Data Product - HowTo Create Data Product
HowTo setup Fluentd on Sensor - HowTo setup Fluentd on Streamig Device
HowTo Use Wendelin for Big Data Collaboration - HowTo Use Wendelin for Big Data Collaboration
HowTo Create Notebook with Graphs - HowTo Create Notebook with Graphs