ランキングに戻る

redpanda-data/redpanda

C++redpanda.com

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

kafkacppkubernetesgostreamingredpandacontainersrealtimeevent-drivenmicroservicesstorage-enginestream-processing
スター成長
スター
12.4k
フォーク
772
週間成長
Issue
293
5k10k
2020年11月2022年9月2024年8月2026年7月
README

Redpanda

Documentation Slack Twitter Redpanda University

redpanda icon

Redpanda is the most complete, Apache Kafka®-compatible streaming data platform, designed from the ground up to be lighter, faster, and simpler to operate. Free from ZooKeeper™ and JVMs, it prioritizes an end-to-end developer experience with a huge ecosystem of connectors, configurable tiered storage, and more.

Table of Contents

Get started

Prebuilt packages

Redpanda Data recommends using the following free, prebuilt stable releases.

Debian/Ubuntu

curl -1sLf \
  'https://linux.pkg.redpanda.com/setup-redpanda.deb.sh' \
  | sudo -E bash

sudo apt-get install redpanda

Fedora/RedHat/Amazon Linux

curl -1sLf \
  'https://linux.pkg.redpanda.com/setup-redpanda.rpm.sh' \
  | sudo -E bash

sudo yum install redpanda

macOS

Download the rpk binary here. Docker is required on MacOS.

brew install redpanda-data/tap/redpanda && rpk container start

Other Linux environments

To install from a .tar.gz archive, download the file and extract it into /opt/redpanda.

For amd64:

curl -LO https://vectorized-public.s3.us-west-2.amazonaws.com/releases/redpanda/25.2.7/redpanda-25.2.7-amd64.tar.gz

For arm64:

curl -LO https://vectorized-public.s3.us-west-2.amazonaws.com/releases/redpanda/25.2.7/redpanda-25.2.7-arm64.tar.gz

Replace 25.2.7 with the version you want to download. See Release Notes for available releases.

Build Manually

Redpanda Data uses Bazel as the build system. Bazel automatically manages most of the toolchains and third-party dependencies.

We rely on bazelisk to get the right version of bazel needed for the build. You can for example install it as follows and add it to your $PATH (or use one of the other suggested ways from their repo).

wget -O ~/bin/bazel https://github.com/bazelbuild/bazelisk/releases/latest/download/bazelisk-linux-amd64 && chmod +x ~/bin/bazel

There are a few system libraries and preinstalled tools our build assumes are available locally. To bootstrap and build redpanda along with all its tests.

sudo ./bazel/install-deps.sh
bazel build --config=release //...

For more build configurations, see .bazelrc.

Release candidate builds

Redpanda Data creates a release candidate (RC) build when we get close to a new release, and we publish it to make new features available for testing. RC builds are not recommended for production use.

RC releases on Debian/Ubuntu

curl -1sLf \
  'https://linux.pkg.redpanda.com/setup-redpanda-unstable.deb.sh' \
  | sudo -E bash

sudo apt-get install redpanda

RC releases on Fedora/RedHat/Amazon Linux

curl -1sLf \
  'https://linux.pkg.redpanda.com/setup-redpanda-unstable.rpm.sh' \
  | sudo -E bash

sudo yum install redpanda

RC releases on Docker

Example with v25.1.1-rc1:

docker pull docker.redpanda.com/redpandadata/redpanda-unstable:v25.1.1-rc1

Community

Resources

関連リポジトリ
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

PythonPyPIOtherbatch-processingkafka
pathway.com
62.6k1.7k
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼

Jupyter Notebookdata-engineeringkafka
airtable.com/appzbS8Pkg9PL254a/shr6oVXeQvSI5HuWD
43.9k8.6k
apache/kafka

Apache Kafka - A distributed event streaming platform

JavaMavenApache License 2.0scalakafka
kafka.apache.org
33.3k15.4k
yudaocode/SpringBoot-Labs

一个涵盖六个专栏:Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖,右上角来个 Star,感恩 1024

JavaMavenspring-bootspring-cloud
20.1k6.2k
influxdata/telegraf

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

GoGo ModulesMIT Licensetelegrafmonitoring
influxdata.com/telegraf
17.7k5.8k
heibaiying/BigData-Notes

大数据入门指南 :star:

JavaMavenhadoophdfs
16.9k4.3k
zhisheng17/flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

JavaMavenApache License 2.0flinkkafka
54tianzhisheng.cn/tags/Flink/
15.1k3.9k
aalansehaiyang/technology-talk

【大厂面试专栏】一份Java程序员需要的技术指南,这里有面试题、系统架构、职场锦囊、主流中间件等,让你成为更牛的自己!

javaspring
offercome.cn
14.7k3.8k
sogou/workflow

C++ Parallel Computing and Asynchronous Networking Framework

C++Apache License 2.0taskinghttp
14.4k2.6k
debezium/debezium

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

JavaMavenApache License 2.0change-data-capturekafka-connect
debezium.io
12.9k3k
IBM/sarama

Sarama is a Go library for Apache Kafka.

GoGo ModulesMIT Licensekafkakafka-client
12.5k1.9k
provectus/kafka-ui

Open-Source Web UI for Apache Kafka Management

JavaMavenApache License 2.0kafka-uikafka-brokers
12.2k1.4k