StarRank

databricks/LearningSparkV2

Scalalearning.oreilly.com/library/view/learning-spark-2nd/9781492050032/
总榜 #47,665Scala #132分析引擎 #442

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

apache-sparksparkstructured-streamingspark-sqlspark-mllibmllibmlflowdelta-lake
Star 增长趋势
Star
1.4k
Forks
797
周增长
+2
Issues
2
5001k
2020年6月2022年7月2024年8月2026年9月
README

Learning Spark 2nd Edition

Welcome to the GitHub repo for Learning Spark 2nd Edition.

Chapters 2, 3, 6, and 7 contain stand-alone Spark applications. You can build all the JAR files for each chapter by running the Python script: python build_jars.py. Or you can cd to the chapter directory and build jars as specified in each README. Also, include $SPARK_HOME/bin in $PATH so that you don't have to prefix SPARK_HOME/bin/spark-submit for these standalone applications.

For all the other chapters, we have provided notebooks in the notebooks folder. We have also included notebook equivalents for a few of the stand-alone Spark applications in the aforementioned chapters.

Have Fun, Cheers!

相关仓库
mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

PythonPyPIApache License 2.0machine-learningai
mlflow.org
27.9k6.3k
treeverse/lakeFS

lakeFS - Data version control for your data lake | Git for data

GoGo ModulesApache License 2.0data-engineeringdata-versioning
docs.lakefs.io
5.5k475
microsoft/SynapseML

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

ScalaMIT Licensesparkpyspark
aka.ms/spark
5.2k868
lw-lin/CoolplaySpark

酷玩 Spark: Spark 源代码解析、Spark 类库等

Scalatutorialsparkspark-streaming
3.5k1.4k
lakehq/sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Rustcrates.ioApache License 2.0arrowbig-data
lakesail.com
3.4k213
kubeflow/spark-operator

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

PythonPyPIApache License 2.0kuberneteskubernetes-operator
spark.kubeflow.org/en/latest/
3.2k1.5k
spark-notebook/spark-notebook

Interactive and Reactive Data Science using Scala and Spark.

JavaScriptnpmApache License 2.0apache-sparknotebook
3.1k640
intel/BigDL

BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray

Jupyter NotebookApache License 2.0apache-sparkdeep-neural-network
bigdl.readthedocs.io
2.7k730
dotnet/spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

C#MIT Licensesparkcsharp
dot.net/spark
2.1k333
big-data-europe/docker-spark

Apache Spark docker image

Shellspark-kuberneteskubernetes
2.1k684
feathr-ai/feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise

ScalaApache License 2.0feature-engineeringfeature-store
join.slack.com/t/feathrai/shared_invite/zt-1ffva5u6v-voq0Us7bbKAw873cEzHOSg
1.9k246
awesome-spark/awesome-spark

A curated list of awesome Apache Spark packages and resources.

ShellawesomeCreative Commons Zero v1.0 Universalapache-sparkpyspark
1.9k345