Batch Processing

Search every project in one place

Press / to search. Tap a tag to filter. Click any row for details.

Filtering for

Row number				Tags
1	pyspark Batch Processing	43,308	2026-05-19	Batch Processing Distributed Computing DevOps	→
	Apache Spark Python API.
	apache/github.com/apache/spark /2026-05-19
2	ray Batch Processing	42,595	2026-05-20	Batch Processing Distributed Computing DevOps	→
	A system for parallel and distributed Python that unifies the machine learning ecosystem.
	ray-project/github.com/ray-project/ray/ /2026-05-20
3	luigi Batch Processing	18,722	2026-05-19	Batch Processing Distributed Computing DevOps	→
	A module that helps you build complex pipelines of batch jobs.
	spotify/github.com/spotify/luigi /2026-05-19
4	dask Batch Processing	13,840	2026-05-14	Batch Processing Distributed Computing DevOps	→
	A flexible parallel computing library for analytic computing.
	dask/github.com/dask/dask /2026-05-14
5	joblib Batch Processing	4,351	2026-03-03	Batch Processing Distributed Computing DevOps	→
	A set of tools to provide lightweight pipelining in Python.
	joblib/github.com/joblib/joblib /2026-03-03
6	mpi4py Batch Processing	909	2026-05-18	Batch Processing Distributed Computing DevOps	→
	Python bindings for MPI.
	mpi4py/github.com/mpi4py/mpi4py /2026-05-18

Contribute

Know a project that belongs here?

Tell us what it does and why it stands out.

Submit a project Star the repository