intel-analytics/BigDL-2.x

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

lakeFS - Data version control for your data lake | Git for data

Simple and Distributed Machine Learning

酷玩 Spark: Spark 源代码解析、Spark 类库等

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Interactive and Reactive Data Science using Scala and Spark.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Apache Spark docker image

Feathr – A scalable, unified data and AI engineering platform for enterprise

A curated list of awesome Apache Spark packages and resources.