StarRankExplorer

ランキングに戻る

databricks/LearningSparkV2

Scalalearning.oreilly.com/library/view/learning-spark-2nd/9781492050032/

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

apache-sparksparkstructured-streamingspark-sqlspark-mllibmllibmlflowdelta-lake

主要指標

スター成長

スター

1.4k

フォーク

796

週間成長

—

Issue

2

5001k

2020年6月2021年6月2022年6月2023年6月2024年7月2025年7月2026年7月

README

Learning Spark 2nd Edition

Welcome to the GitHub repo for Learning Spark 2nd Edition.

Chapters 2, 3, 6, and 7 contain stand-alone Spark applications. You can build all the JAR files for each chapter by running the Python script: python build_jars.py. Or you can cd to the chapter directory and build jars as specified in each README. Also, include $SPARK_HOME/bin in $PATH so that you don't have to prefix SPARK_HOME/bin/spark-submit for these standalone applications.

For all the other chapters, we have provided notebooks in the notebooks folder. We have also included notebook equivalents for a few of the stand-alone Spark applications in the aforementioned chapters.

Have Fun, Cheers!

関連リポジトリ

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

PythonPyPIApache License 2.0machine-learningai

treeverse/lakeFS

lakeFS - Data version control for your data lake | Git for data

GoGo ModulesApache License 2.0data-engineeringdata-versioning

microsoft/SynapseML

Simple and Distributed Machine Learning

ScalaMIT Licensesparkpyspark

lw-lin/CoolplaySpark

酷玩 Spark: Spark 源代码解析、Spark 类库等

Scalasparkspark-streaming

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Rustcrates.ioApache License 2.0arrowbig-data

spark-notebook/spark-notebook

Interactive and Reactive Data Science using Scala and Spark.

JavaScriptnpmApache License 2.0apache-sparknotebook

kubeflow/spark-operator

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

PythonPyPIApache License 2.0kuberneteskubernetes-operator

spark.kubeflow.org/en/latest/

BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray

Jupyter NotebookApache License 2.0apache-sparkdeep-neural-network

bigdl.readthedocs.io

intel-analytics/BigDL-2.x

BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray

Jupyter Notebookapache-sparkdeep-neural-network

bigdl.readthedocs.io

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

C#MIT Licensesparkcsharp

big-data-europe/docker-spark

Apache Spark docker image

Shellspark-kuberneteskubernetes

feathr-ai/feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise

ScalaApache License 2.0feature-engineeringfeature-store

join.slack.com/t/feathrai/shared_invite/zt-1ffva5u6v-voq0Us7bbKAw873cEzHOSg