Scipy and scikit-learn compiled to WebAssembly in Pyodide

The Pyodide project aims to compile the CPython interpreter and scientific Python stack to WebAssembly allowing to use Python libraries in the browser. In the past, numpy, pandas and matplotlib have been packaged in Pyodide. In this post we will outline latest developments funded by Nexedi, which include packaging scipy and scikit-learn, improvements in testing workflow and ability to install packages from custom URLs.
0 comment | Share: Facebook logo Twitter Logo |

Cython nogil extension on multi core introduction

In this blog post, we show a proof of concept to make multi-core processing possible in CPython. It involves adding a new data type in Cython which is not limited by the CPython GIL and a new coroutine which together make real multi-core possible.
0 comment | Share: Facebook logo Twitter Logo |

Open Source / Free Software for Effective Industry 4.0

Programme and Information about the Industry 4.0 Meetup by Nexedi GmbH and Fraunhofer IAO on November 12th, 2018 in Stuttgart with Amarisoft, Linutronix, Olimex and Télécom ParisTech.
0 comment | Share: Facebook logo Twitter Logo |

Can Free big data regulate AI and the data economy?

Market does not seem to provide any valid solution to the new issues posed by a data economy which is characterised by a combination of increasing returns and legal blockers to community or ecosystem based competition. As a consequence, the current known optimal organisation to monetise big data and A.I. is the private or state monopoly. We review in this article possible alternatives that could be considered in the future and how to enforce them.
0 comment | Share: Facebook logo Twitter Logo |

Are Linux containers stable enough for production and why Nexedi uses SlapOS nano-containers instead ?

Nexedi does not use LXC containers or docker because it is impossible to ensure their stable operation especially in case of kernel ABI mismatch or missing containerisation of system calls. Instead, we use SlapOS nano-containers which have provided since 2010 similar benefits in a more stable way while using less resources. SlapOS nano-containers will soon be deployed on embedded device using Elbe embedded Linux with over-the-air (OTA) upgrade and secure boot.
0 comment | Share: Facebook logo Twitter Logo |

Five Evolutions of Cloud Computing

Cloud Computing is essentially the automation of IT service provisioning through software which replace human tasks. It is currently evolving in multiple directions. Free Software and Open Hardware will eventually lead to massive price cuts compared to current price levels in USA or Asia. Edge Computing will reduce the need of data centres whenever network latency or availability become critical. Service Workers will eliminate the need of servers, both at the edge or at the data centre, in 90% cases. Big Servers will eventually replace smaller servers as the standard fabric the data centre.
0 comment | Share: Facebook logo Twitter Logo |

OfficeJS Iodide: Migration of Jupyter Notebooks to Iodide Notebooks

OfficeJS Iodide notebooks can be used offline or online on any modern HTML5 web browser such as Firefox or Chrome. With the support of data science libraries such as NumPy, Pandas, Matplotlib, Plotly, etc. and soon scikit-learn, its nice to be server independent and carry on with data science just using browser. Hence, we tried to migrate some already famous lectures on data science on github. This web page mentions the steps and problems faced while migrating and obviously, the final result.
0 comment | Share: Facebook logo Twitter Logo |

Rapid.Space: High Performance, Low Cost, Ethical Cloud based on Open Hardware and Free Software

Nexedi launches beta phase of rapid.space * low cost, high performance, ethical cloud * based on Open Hardware, Open Source Free Software and circular economy
0 comment | Share: Facebook logo Twitter Logo |

High Performance Virtual Machines for Database Applications

Rapid.Space is a new provider of low cost, ethical yet high performance servers targeted at big data applications, high performance computing, software development and large database applications. Rapid.Space provisions on each server a single "dedicated virtual machine" which takes control of all resources of the server. Performance degradation for memory, CPU or 10 Gbps networking is not noticeable. Performance degradation for disk I/O is at most 30%, a 800% improvement compared to traditional storage virtualisation technologies used by some cloud computing services.
0 comment | Share: Facebook logo Twitter Logo |

OfficeJS Iodide: Ubiquitous Data Science Notebooks for Business and Education

Iodide and Pyodide have brought a standard notebook application to OfficeJS that can be used for business reporting, research and education. They support data science libraries such as NumPy, Pandas, Matplotlib, Plotly, etc. and soon scikit-learn. OfficeJS Iodide notebooks can be used offline or online on any modern HTML5 web browser such as Firefox or Chrome. Thanks to JIO, notebooks can be synchronised with Dropbox, WebDAV, ERP5 and any other storage supported by a JIO plugin. Iodide notebooks can also be embedded through RenderJS into any business application. The dream of ubiquitous data sciences at no infrastructure cost has come to a reality.
0 comment | Share: Facebook logo Twitter Logo |

5G without USA: yes we can!

European technology suppliers combined with Shenzen ecosystem of small and medium businesses can provide everything that is needed to create latest generation 4G and 5G virtual radio access network (VRAN) infrastructure without depending on USA suppliers and at a fraction of the cost of traditional approaches of the four dominant telecom infrastructure providers.
0 comment | Share: Facebook logo Twitter Logo |

Multi-threaded coroutines with work stealing in Cython

After making a proof of concept multi-core HTTP server for Python using Lwan and Cython, we decided to extract Lwan's coroutines and evaluate them on their own. This experiment shows that system programming in Cython is possible.
0 comment | Share: Facebook logo Twitter Logo |

How Nexedi moved to HTTP2 with Caddy

After trying and failing to move to HTTP2 using Apache in 2017, Nexedi has adopted Go language based Caddy server. Initial results of HTTP2 show significant speed improvement and good stability. Next step will be the adoption of QUIC. Migration was smooth and entirely automated thank to a test driver devops approach recently introduced in SlapOS.
0 comment | Share: Facebook logo Twitter Logo |

Edge Computing for Industrial Automation and Control

The business of industrial automation and control will move away over time from existing, highly profitable, proprietary product lines towards much more flexible yet less profitable open hardware and Free Software. Future profits will eventually emerge from online services based on industrial big data, personalisation, legal regulation and trade secret powered by increasingly smart sensors and gateways at the edge.
0 comment | Share: Facebook logo Twitter Logo |

A multi-core Python HTTP server (much) faster than Go (spoiler: Cython)

A multi-core Python HTTP server that is about 40% to 110% faster than Go can be built by relying on the Cython language and LWAN C library. A proof of concept validates the possibility of high performance system programming in the Cython language.
0 comment | Share: Facebook logo Twitter Logo |

Python multi-core benchmark in uvloop context

The existence of cython combined with a clean concurrency model based on technologies such as gevent and pygolang could change the situation if both can be tightly integrated into cython's static cdef code rather than scattered as it is today.
0 comment | Share: Facebook logo Twitter Logo |

Free Big Data for Free AI

Nexedi has introduced during Zhejiang International Smart Healthcare Innovation Conference the role of Free Big Data to regulate AI market and preserve medical knowledge sharing. Wendelin IA platform was first demoed.
0 comment | Share: Facebook logo Twitter Logo |

NayuOS's future after Google

Little by little, Google is extending ChromeOS while leaving ChromiumOS in a kind of incomplete state. What will be the future of NayuOS in this context?
0 comment | Share: Facebook logo Twitter Logo |

Improving the performance of Ansible

Since Ansible switched to v2, the deep rebuild of its architecture has led to a huge slowdown in its performance. Here we show two ways of improvement that can be easily implemented.
0 comment | Share: Facebook logo Twitter Logo |

Nexedi Demonstrates Open Source Network Management System for 5G/4G Networks at MWC 2018

Nexedi is demonstrating during Mobile World Congress 2018 a preview of a Network Management System (NMS) designed for low latency 5G and 4G networks. NMS is published under Free Software license, integrated with Amarisoft 5G / 4G stack and supports Edge Computing for AI offloading.
0 comment | Share: Facebook logo Twitter Logo |