Talk Proposal Submission
If you are interested in attending this talk at PyCon JP 2017, please use the social media share buttons below. We will consider the popularity of the proposals when making our selection.
talk
Running Dask in the Cloud(en)
Speakers
Shane Cousins
Audience level:
Intermediate
Category:
Distributed Computing
Description
Is pandas running out of memory? Have you wanted to more easily process large scale data?
dask may be what your looking for.
Here I'll introduce the dask framework and talk about how you can get it running in the cloud
Objectives
Define what is Dask
Explain why you'd want to use it.
Learn how to get started setting up a dask distributed computing cluster
Abstract
Dask is a general purpose Spark-like big data computing framework that allows you to take advantage of Numpy/Pandas/Scikit-learn level complex algorithms, written in Pure Python.
This talk provides a brief introduction of dask and focuses on how a dask cluster can be setup in the cloud to get you started with migrating your pandas/numpy workflows to more easily work with and process larger datasets.