Volver al ranking

jacksu/utils4s

Scalajacksu.github.io/utils4s

scala、spark使用过程中,各种测试用例以及相关资料整理

sparkscala-demoscala-sparkjson4sbreezescalaakkaspark-streaming
Crecimiento de estrellas
Estrellas
1.1k
Forks
421
Crecimiento semanal
Issues
5
5001k
sept 2015abr 2019dic 2022jul 2026
README

utils4s

公众号: 公众号

Build StatusJoin the chat at https://gitter.im/jacksu/utils4s

Issues 中包含我们平时阅读的关于scala、spark好的文章,欢迎推荐

utils4s包含各种scala通用、好玩的工具库demo和使用文档,通过简单的代码演示和操作文档,各种库信手拈来。

同时欢迎大家贡献各种好玩的、经常使用的工具库。

开源中国地址

QQ交流群 432290475(已满),请加530066027 Scala Spark 或者点击上面gitter图标也可以参与讨论

作者博客专注大数据、分布式系统、机器学习,欢迎交流

微博:jacksu_

scala语法学习

说明:scala语法学习过程中,用例代码都放在scala-demo模块下。

利用IntelliJ IDEA与Maven开始你的Scala之旅

快学scala电子书(推荐入门级书)

scala理解的比较深

scala99问题

scala初学者指南(这可不是初学者可以理解的欧,还是写过一些程序后再看)

scala初学者指南英文版

scala学习用例

scala入门笔记

Databricks风格

scala/java 通过maven编译(Mixed Java/Scala Projects)

common库

日志操作log4s

单元测试scalatest

日期操作lama)(注:只支持日期操作,不支持时间操作)

日期时间操作nscala-time)(注:没有每月多少天,每月最后一天,以及每年多少天)

json解析json4s

resources下文件加载用例

文件操作better-files

单位换算squants

线性代数和向量计算(breeze)

分布式并行实现库akka(akka)

Twitter工具库twitter util

日常脚本工具

BigData库

Spark

Spark core

[spark远程调试源代码](http://hadoop1989.com/2016/02/01/Spark-Remote-Debug/)

spark介绍

一个不错的spark学习互动课程

spark 设计与实现

aliyun-spark-deploy-tool---Spark on ECS

Spark Streaming

Spark Streaming使用Kafka保证数据零丢失

spark streaming测试用例

spark streaming源码解析

基于spark streaming的聚合分析(Sparkta)

Spark SQL

spark DataFrame测试用例

Hive Json加载

SparkSQL架构设计和代码分析

Spark 机器学习

spark机器学习源码解析

KeyStoneML KeystoneML is a software framework, written in Scala, from the UC Berkeley AMPLab designed to simplify the construction of large scale, end-to-end, machine learning pipelines with Apache Spark.

spark TS

Spark zeppelin

Z-Manager--Simplify getting Zeppelin up and running

zeppelin--a web-based notebook that enables interactive data analytics. You can make beautiful data-driven, interactive and collaborative documents with SQL, Scala and more.

helium--Brings Zeppelin to data analytics application platform

Spark 其它

spark专题在简书

databricks spark知识库

spark学习知识总结

Spark library for doing exploratory data analysis in a scalable way

图处理(cassovary)

基于spark进行地理位置分析(gagellan)

spark summit east 2016 ppt

ES

ES 非阻塞scala客户端

Beam

[Apache Beam:下一代的数据处理标准](http://geek.csdn.net/news/detail/134167)

贡献代码步骤

1. 首先 fork 我的项目 2. 把 fork 过去的项目也就是你的项目 clone 到你的本地 3. 运行 git remote add jacksu git@github.com:jacksu/utils4s.git 把我的库添加为远端库 4. 运行 git pull jacksu master 拉取并合并到本地 5. coding 6. commit后push到自己的库( git push origin master ) 7. 登陆Github在你首页可以看到一个 pull request 按钮,点击它,填写一些说明信息,然后提交即可。 1~3是初始化操作,执行一次即可。在coding前必须执行第4步同步我的库(这样避免冲突),然后执行5~7既可。

贡献者

[jjcipher](https://github.com/jjcipher)
Repositorios relacionados
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼

Jupyter Notebookdata-engineeringkafka
airtable.com/appzbS8Pkg9PL254a/shr6oVXeQvSI5HuWD
43.9k8.6k
apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

ScalaApache License 2.0pythonscala
spark.apache.org
43.7k29.3k
donnemartin/data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

PythonPyPIOtherpythonmachine-learning
29.3k8k
getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

PythonPyPIBSD 2-Clause "Simplified" Licenseredashpython
redash.io
28.7k4.6k
yeasy/docker_practice

最新Docker容器技术,从真实案例中学习最佳实践!| Learn and understand Docker&Container technologies, with real DevOps practice!

GoGo Modulesdockerbook
yeasy.gitbook.io/docker_practice/
26.2k5.8k
heibaiying/BigData-Notes

大数据入门指南 :star:

JavaMavenhadoophdfs
16.9k4.3k
FavioVazquez/ds-cheatsheets

List of Data Science Cheatsheets to rule the world

MIT Licensedatasciencepython
16.3k4k
GaiZhenbiao/ChuanhuChatGPT

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

PythonPyPIGNU General Public License v3.0chatbotchatgpt-api
huggingface.co/spaces/JohnSmith9982/ChuanhuChatGPT
15.3k2.2k
zhisheng17/flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

JavaMavenApache License 2.0flinkkafka
54tianzhisheng.cn/tags/Flink/
15.1k3.9k
aalansehaiyang/technology-talk

【大厂面试专栏】一份Java程序员需要的技术指南,这里有面试题、系统架构、职场锦囊、主流中间件等,让你成为更牛的自己!

javaspring
offercome.cn
14.7k3.8k
horovod/horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

PythonPyPIOthertensorflowuber
horovod.ai
14.7k2.2k
deeplearning4j/deeplearning4j

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

JavaMavenApache License 2.0javagpu
deeplearning4j.konduit.ai
14.2k3.8k