Back to rankings

apache/streampark

Javastreampark.apache.org

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

streamingstreamparkapachedevelopment-frameworkeasy-to-useetl-pipelineoperation-platform
Star Growth
Stars
4.3k
Forks
1.1k
Weekly Growth
โ€”
Issues
299
2k4k
Feb 2020Mar 2022May 2024Jul 2026
ArtifactsMavengit clone https://github.com/apache/streampark.git
README

Apache StreamPark

StreamPark logo

StreamPark: a streaming application development framework and cloud-native real-time computing platform.

GitHub stars Latest release X Follow

๐Ÿ“Š Overview

StreamPark is an open-source framework for building and managing real-time streaming applications, designed to simplify the end-to-end lifecycle of stream processing. It provides a unified development framework for Apache Flink and Apache Spark, along with a powerful cloud-native platform for application management.

StreamPark enables users to develop, debug, deploy, and operate large-scale streaming applications efficiently and consistently. Originally named StreamX, the project was renamed StreamPark in August 2022 and became an Apache Top-Level Project (TLP) in January 2025.

  • Streaming Application Development Framework
    • Simplifies Flink and Spark streaming development with prebuilt APIs, connectors, and templates.
  • Cloud-Native Real-Time Computing Platform
    • Offers a one-stop real-time computing platform for development, deployment, monitoring, and operations.
  • Unified Batch & Streaming Processing
    • Supports Apache Flink and Apache Spark, enabling both stream processing and batch processing.
  • Multi-Engine & Multi-Version Support
    • Run and manage multi-version Flink/Spark applications.
  • Multi-Environment Compatibility
    • Works on Standalone, YARN (Hadoop 2.x/3.x), and Kubernetes.
  • Rich Ecosystems
    • Compatible with big-data ecosystem tools (e.g., Apache Flink/Spark/Paimon/Doris) and ML/AI ecosystems.
  • Easy to use
    • Single-service deployment; go from zero to running jobs in minutes.

๐Ÿš€ QuickStart

๐Ÿณ Play StreamPark in Docker

  docker run -d -p 10000:10000 apache/streampark:latest

๐Ÿ–ฅ๏ธ Local Quick Installation Experience

  curl -L https://streampark.apache.org/quickstart.sh | sh

https://github.com/user-attachments/assets/dd7d5a89-bc28-4ccc-9ad5-258925fc4f34

๐Ÿ”จ How to Build

 ./build.sh

๐Ÿ—„ how to Development

โฌ‡๏ธ Downloads

Please head to the releases page to download a release of Apache StreamPark.

๐Ÿ“š Docs

Official Documentation

๐Ÿ’‹ Our users

Various companies and organizations use Apache StreamPark for research, production and commercial products. Are you using this project? Welcome to add your company!

Our users

๐Ÿค Contribution

PRs Welcome

๐Ÿ™‹ Submit Pull Request and Issues

You can submit any ideas as pull requests or as issues.

If you're new to posting issues, we ask that you read How To Ask Questions The Smart Way (This guide does not provide actual support services for this project!), How to Report Bugs Effectively prior to posting. Well written bug reports help us help you!

๐Ÿป How to Contribute

We welcome your suggestions, comments (including criticisms), comments and contributions. See How to Contribute and Code Submission Guide

Thank you to all the people who already contributed to Apache StreamPark!

๐Ÿ’ฌ Contact Us

Contact us through the following mailing list.

Name Mailing list
dev@streampark.apache.org Subscribeใ€Unsubscribe ใ€Archives

๐Ÿ’ฟ Social Media

Join the Group

๐Ÿ“œ License

Licensed under the Apache License, Version 2.0

Related repositories
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

PythonPyPIOtherbatch-processingkafka
pathway.com
62.6k1.7k
FFmpeg/FFmpeg

Mirror of https://git.ffmpeg.org/ffmpeg.git

COtherffmpegvideo
ffmpeg.org
62.3k14k
apache/kafka

Apache Kafka - A distributed event streaming platform

JavaMavenApache License 2.0scalakafka
kafka.apache.org
33.3k15.4k
webtorrent/webtorrent

โšก๏ธ Streaming torrent client for the web

JavaScriptnpmMIT Licensewebtorrentbittorrent
webtorrent.io
31.3k2.9k
iperov/DeepFaceLive

Real-time face swap for PC streaming or video calls

PythonPyPIGNU General Public License v3.0deepfakereal-time
31k1.3k
ossrs/srs

SRS is a simple, high-efficiency, real-time media server supporting RTMP, WebRTC, HLS, HTTP-FLV, HTTP-TS, SRT, MPEG-DASH, and GB28181, with codec support for H.264, H.265, AV1, VP9, AAC, Opus, and G.711.

C++MIT Licensertmplive-streaming
ossrs.io
29.1k5.7k
apache/rocketmq

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

JavaMavenApache License 2.0rocketmqcloud-native
rocketmq.apache.org
22.5k12k
bluenviron/mediamtx

Ready-to-use Media-over-QUIC / SRT / WebRTC / RTSP / RTMP / LL-HLS / MPEG-TS / RTP live media server and media proxy that allows to read, publish, proxy, record and playback real-time video and audio streams.

GoGo ModulesMIT Licensertsprtp
mediamtx.org
19.6k2.3k
nukeop/nuclear

Streaming music player that finds free music for you

TypeScriptnpmGNU Affero General Public License v3.0music-playermusic
nuclearplayer.com
18.1k1.3k
asciinema/asciinema

Terminal session recorder, streamer and player ๐Ÿ“น

Rustcrates.ioGNU General Public License v3.0asciicastterminal
asciinema.org
17.6k1k
koel/koel

Music streaming solution that works.

PHPPackagistMIT Licenselaravelvue
koel.dev
17.2k2.1k
video-dev/hls.js

HLS.js is a JavaScript library that plays HLS in browsers with support for MSE.

TypeScriptnpmOtherhlshtml5
hlsjs.video-dev.org/demo
16.8k2.7k