Retour au classement

apache/streampark

Javastreampark.apache.org

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

streamingstreamparkapachedevelopment-frameworkeasy-to-useetl-pipelineoperation-platform
Croissance des étoiles
Étoiles
4.3k
Forks
1.1k
Croissance hebdomadaire
Issues
300
2k4k
févr. 2020mars 2022mai 2024juil. 2026
ArtefactsMavengit clone https://github.com/apache/streampark.git
README

Apache StreamPark

StreamPark logo

StreamPark: a streaming application development framework and cloud-native real-time computing platform.

GitHub stars Latest release X Follow

📊 Overview

StreamPark is an open-source framework for building and managing real-time streaming applications, designed to simplify the end-to-end lifecycle of stream processing. It provides a unified development framework for Apache Flink and Apache Spark, along with a powerful cloud-native platform for application management.

StreamPark enables users to develop, debug, deploy, and operate large-scale streaming applications efficiently and consistently. Originally named StreamX, the project was renamed StreamPark in August 2022 and became an Apache Top-Level Project (TLP) in January 2025.

  • Streaming Application Development Framework
    • Simplifies Flink and Spark streaming development with prebuilt APIs, connectors, and templates.
  • Cloud-Native Real-Time Computing Platform
    • Offers a one-stop real-time computing platform for development, deployment, monitoring, and operations.
  • Unified Batch & Streaming Processing
    • Supports Apache Flink and Apache Spark, enabling both stream processing and batch processing.
  • Multi-Engine & Multi-Version Support
    • Run and manage multi-version Flink/Spark applications.
  • Multi-Environment Compatibility
    • Works on Standalone, YARN (Hadoop 2.x/3.x), and Kubernetes.
  • Rich Ecosystems
    • Compatible with big-data ecosystem tools (e.g., Apache Flink/Spark/Paimon/Doris) and ML/AI ecosystems.
  • Easy to use
    • Single-service deployment; go from zero to running jobs in minutes.

🚀 QuickStart

🐳 Play StreamPark in Docker

  docker run -d -p 10000:10000 apache/streampark:latest

🖥️ Local Quick Installation Experience

  curl -L https://streampark.apache.org/quickstart.sh | sh

https://github.com/user-attachments/assets/dd7d5a89-bc28-4ccc-9ad5-258925fc4f34

🔨 How to Build

 ./build.sh

🗄 how to Development

⬇️ Downloads

Please head to the releases page to download a release of Apache StreamPark.

📚 Docs

Official Documentation

💋 Our users

Various companies and organizations use Apache StreamPark for research, production and commercial products. Are you using this project? Welcome to add your company!

Our users

🤝 Contribution

PRs Welcome

🙋 Submit Pull Request and Issues

You can submit any ideas as pull requests or as issues.

If you're new to posting issues, we ask that you read How To Ask Questions The Smart Way (This guide does not provide actual support services for this project!), How to Report Bugs Effectively prior to posting. Well written bug reports help us help you!

🍻 How to Contribute

We welcome your suggestions, comments (including criticisms), comments and contributions. See How to Contribute and Code Submission Guide

Thank you to all the people who already contributed to Apache StreamPark!

💬 Contact Us

Contact us through the following mailing list.

Name Mailing list
dev@streampark.apache.org SubscribeUnsubscribeArchives

💿 Social Media

Join the Group

📜 License

Licensed under the Apache License, Version 2.0

Dépôts similaires
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

PythonPyPIOtherbatch-processingkafka
pathway.com
62.6k1.7k
FFmpeg/FFmpeg

Mirror of https://git.ffmpeg.org/ffmpeg.git

COtherffmpegvideo
ffmpeg.org
62.3k14k
apache/kafka

Apache Kafka - A distributed event streaming platform

JavaMavenApache License 2.0scalakafka
kafka.apache.org
33.3k15.4k
webtorrent/webtorrent

⚡️ Streaming torrent client for the web

JavaScriptnpmMIT Licensewebtorrentbittorrent
webtorrent.io
31.3k2.9k
iperov/DeepFaceLive

Real-time face swap for PC streaming or video calls

PythonPyPIGNU General Public License v3.0deepfakereal-time
31k1.3k
ossrs/srs

SRS is a simple, high-efficiency, real-time media server supporting RTMP, WebRTC, HLS, HTTP-FLV, HTTP-TS, SRT, MPEG-DASH, and GB28181, with codec support for H.264, H.265, AV1, VP9, AAC, Opus, and G.711.

C++MIT Licensertmplive-streaming
ossrs.io
29.1k5.7k
apache/rocketmq

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

JavaMavenApache License 2.0rocketmqcloud-native
rocketmq.apache.org
22.5k12k
bluenviron/mediamtx

Ready-to-use Media-over-QUIC / SRT / WebRTC / RTSP / RTMP / LL-HLS / MPEG-TS / RTP live media server and media proxy that allows to read, publish, proxy, record and playback real-time video and audio streams.

GoGo ModulesMIT Licensertsprtp
mediamtx.org
19.6k2.3k
nukeop/nuclear

Streaming music player that finds free music for you

TypeScriptnpmGNU Affero General Public License v3.0music-playermusic
nuclearplayer.com
18.1k1.3k
asciinema/asciinema

Terminal session recorder, streamer and player 📹

Rustcrates.ioGNU General Public License v3.0asciicastterminal
asciinema.org
17.6k1k
koel/koel

Music streaming solution that works.

PHPPackagistMIT Licenselaravelvue
koel.dev
17.2k2.1k
video-dev/hls.js

HLS.js is a JavaScript library that plays HLS in browsers with support for MSE.

TypeScriptnpmOtherhlshtml5
hlsjs.video-dev.org/demo
16.8k2.7k