Jean-Paul Smets
- Efficient memory management with python and multiprocessing
- Jean-Paul Smets | jp (at) nexedi (dot) com | +33 629 02 44 25
- https://www.nexedi.com/NXD-Python.Paris.2017
Nexedi
- Largest OSS Publisher in Europe
- About 35 staff around the world
- Mostly using Python | JavaScript
- Flexible | Sustainable | Resilient
Nexedi - Clients
The following image could not be found in erp5 OR is not following guidelines for links (eg no ./ prefix): NXD-Media.Image.Nexedi.Map.Reference.Locations.Logos
Python3 in 2017
A great language if one can accept to:
- run multiple threads on a single core
- experience poor performance for arithmetics
- rewrite all your python2 code
- learn another language in addition to Javascript
Leaving Python3?
- Alphabet (Grumpy)
- Dropbox (dropped pyston)
Good reasons to stay with Python3
- NumPy
- scipy
- scikit-learn
- pandas
- jupyter
- etc.
Nexedi Free Software Code Base: 12 Mlc
- ERP5 ERP and CRM (python2.7)
- Wendelin Big Data (python2.7)
- SlapOS Edge Computing (python2.7)
- re6st reslient network (python2.7)
- Webrunner web based IDE (python2.7)
- cloudooo multimedia converter (python2.7)
- NEO distributed NoSQL database (python2.7)
- JIO virtual storage (JS)
- RenderJS light components (JS)
- OfficeJS web office (JS)
- NayuOS laptop OS (various)
Python3 in 2017
A great language if one can accept to:
- run multiple processes on a multiple cores
- experience native performance / native threads with Cython and Numpy
- hack cpython3 runtime and run all python2 code with little change
- integrate with JS (transcrypt) and golang (NEO)
Multiprocessing
this is how ERP5 works for 15 years
- scalable
- reliable
- clean
- compute efficient
- memory inefficient
A Big Array
Multithreading
Python Multithreading
Python Multiprocessing
Adding more RAM
System memory management
Demo
Licensing
GPLv3 with wide exception
- Free for Free Software (any license)
- Must sponsor or advertise for Non Free Software
Thank You
- Nexedi SA
- 270 bd Clémenceau
- 59700 Marcq-en-Baroeul
- France
- nexedi.com/contact
- +33 6 29 02 44 25