List: Distributed Computing | Curated by Nikhil Gupta

Jul 19, 2023
9 stories
Distributed Computing
In
TDS Archive
by
Nicolas Vandeput
Do You Read Excel Files with Python? There is a 1000x Faster Way.In this article, I’ll show you five ways to load data in Python. Achieving a speedup of 3 orders of magnitude.
Jul 3, 2021
21
Jul 3, 2021
21
In
TDS Archive
by
azul garza ramirez
Distributed Forecast of 1M Time Series in Under 15 Minutes with Spark, Nixtla, and FugueScalable Time Series Modeling with open-source projects StatsForecast, Fugue, and Spark
Sep 16, 2022
Sep 16, 2022
In
TDS Archive
by
Fahad Akbar
A Data Scientist's Dream: Python, Big Data, Multi-Processing, and PyCaretTrain multiple models using all your cores with Python’s multiprocessing module and PyCaret
Oct 27, 2021
Oct 27, 2021
In
TDS Archive
by
Nicolas Vandeput
Do You Use Apply in Pandas? There is a 600x Faster WayBy leveraging vectorization and data types, you can massively speed up complex computations in Pandas
Aug 23, 2021
7
Aug 23, 2021
7
In
The Pythoneers
by
Pavel Dubovik
Visualize your multiprocessing calculations in python with parallelbar modulePerhaps every data scientist sooner or later faces the need to use multiprocessor data processing. In this article, we will not analyze in…
Feb 1, 2022
1
Feb 1, 2022
1
In
TDS Archive
by
Kevin Kho
Introducing Fugue — Reducing PySpark Developer FrictionIncrease developer productivity and decrease costs for big data projects
Feb 14, 2022
2
Feb 14, 2022
2
In
TDS Archive
by
Kevin Kho
Scaling PyCaret with Spark (or Dask) through FugueRun PyCaret functions on each partition of data distributedly
Jan 7, 2022
2
Jan 7, 2022
2
In
TDS Archive
by
Christy Bergman
How to Train Time Series Forecasting Faster Using Ray, part 2 of 2Time Series Forecasting using an LSTM version of RNN with PyTorch Forecasting and Torch Lightning
Dec 23, 2021
Dec 23, 2021
In
TDS Archive
by
Christy Bergman
Running ML Python Code in Parallel With RAYTime Series Forecasting using ARIMA and Prophet
Nov 24, 2021
Nov 24, 2021