랭킹으로 돌아가기

confluentinc/examples

Java

Apache Kafka, Apache Flink and Confluent Platform examples and demos

kafkademoexamplesconfluentreplicatorcloudconnectconnectorjdbcdebeziumquickstartschema-registry
스타 성장
스타
2.1k
포크
1.1k
주간 성장
이슈
86
1k2k
2015년 6월2019년 2월2022년 11월2026년 7월
아티팩트Mavengit clone https://github.com/confluentinc/examples.git
README

image

Overview

This is a curated list of demos that showcase Apache Kafka® event stream processing on the Confluent Platform, an event stream processing platform that enables you to process, organize, and manage massive amounts of streaming data across cloud, on-prem, and serverless deployments.

Where to start

The best demo to start with is cp-demo which spins up a Kafka event streaming application using ksqlDB for stream processing, with many security features enabled, in an end-to-end streaming ETL pipeline with a source connector pulling from live data and a sink connector connecting to Elasticsearch and Kibana for visualizations. cp-demo also comes with a tutorial and is a great configuration reference for Confluent Platform.

Confluent Cloud

There are many examples from full end-to-end demos that create connectors, streams, and KSQL queries in Confluent Cloud, to resources that help you build your own demos. You can find the documentation and instructions for all Confluent Cloud demos at https://docs.confluent.io/platform/current/tutorials/examples/ccloud/docs/ccloud-demos-overview.html

Demo Local Docker Description
Confluent CLI Y N Fully automated demo interacting with your Confluent Cloud cluster using the Confluent CLI
Clients in Various Languages to Cloud Y N Client applications, showcasing producers and consumers, in various programming languages connecting to Confluent Cloud
Cloud ETL Y N Fully automated cloud ETL solution using Confluent Cloud connectors (AWS Kinesis, Postgres with AWS RDS, GCP GCS, AWS S3, Azure Blob) and fully-managed ksqlDB
ccloud-stack Y N Creates a fully-managed stack in Confluent Cloud, including a new environment, service account, Kafka cluster, KSQL app, Schema Registry, and ACLs. The demo also generates a config file for use with client applications.
On-Prem Kafka to Cloud N Y Module 2 of Confluent Platform demo (cp-demo) with a playbook for copying data between the on-prem and Confluent Cloud clusters
DevOps for Apache Kafka® with Kubernetes and GitOps N N Simulated production environment running a streaming application targeting Apache Kafka on Confluent Cloud using Kubernetes and GitOps

Stream Processing

Demo Local Docker Description
Clickstream N Y Automated version of the ksqlDB clickstream demo
Kafka Tutorials Y Y Collection of common event streaming use cases, with each tutorial featuring an example scenario and several complete code solutions
Microservices ecosystem N Y Microservices orders Demo Application integrated into the Confluent Platform

Data Pipelines

Demo Local Docker Description
Clients in Various Languages Y N Client applications, showcasing producers and consumers, in various programming languages
Connect and Kafka Streams Y N Demonstrate various ways, with and without Kafka Connect, to get data into Kafka topics and then loaded for use by the Kafka Streams API

Confluent Platform

Demo Local Docker Description
Avro Y N Client applications using Avro and Confluent Schema Registry
CP Demo N Y Confluent Platform demo (cp-demo) with a playbook for Kafka event streaming ETL deployments
Kubernetes N Y Demonstrations of Confluent Platform deployments using the Confluent Operator
Multi Datacenter N Y Active-active multi-datacenter design with two instances of Confluent Replicator copying data bidirectionally between the datacenters
Multi-Region Clusters N Y Multi-Region clusters (MRC) with follower fetching, observers, and replica placement
Quickstart Y Y Automated version of the Confluent Quickstart: for Confluent Platform on local install or Docker, community version, and Confluent Cloud
Role-Based Access Control Y Y Role-based Access Control (RBAC) provides granular privileges for users and service accounts
Replicator Security N Y Demos of various security configurations supported by Confluent Replicator and examples of how to implement them

Build Your Own

As a next step, you may want to build your own custom demo or test environment. We have several resources that launch just the services in Confluent Cloud or on prem, with no pre-configured connectors, data sources, topics, schemas, etc. Using these as a foundation, you can then add any connectors or applications. You can find the documentation and instructions for these "build-your-own" resources at https://docs.confluent.io/platform/current/tutorials/build-your-own-demos.html.

Additional Demos

Here are additional GitHub repos that offer an incredible set of nearly a hundred other Apache Kafka demos. They are not maintained on a per-release basis like the demos in this repo, but they are an invaluable resource.

관련 저장소
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

PythonPyPIOtherbatch-processingkafka
pathway.com
62.6k1.7k
DataTalksClub/data-engineering-zoomcamp

Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼

Jupyter Notebookdata-engineeringkafka
airtable.com/appzbS8Pkg9PL254a/shr6oVXeQvSI5HuWD
43.9k8.6k
apache/kafka

Apache Kafka - A distributed event streaming platform

JavaMavenApache License 2.0scalakafka
kafka.apache.org
33.3k15.4k
yudaocode/SpringBoot-Labs

一个涵盖六个专栏:Spring Boot 2.X、Spring Cloud、Spring Cloud Alibaba、Dubbo、分布式消息队列、分布式事务的仓库。希望胖友小手一抖,右上角来个 Star,感恩 1024

JavaMavenspring-bootspring-cloud
20.1k6.2k
influxdata/telegraf

Agent for collecting, processing, aggregating, and writing metrics, logs, and other arbitrary data.

GoGo ModulesMIT Licensetelegrafmonitoring
influxdata.com/telegraf
17.7k5.8k
heibaiying/BigData-Notes

大数据入门指南 :star:

JavaMavenhadoophdfs
16.9k4.3k
zhisheng17/flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

JavaMavenApache License 2.0flinkkafka
54tianzhisheng.cn/tags/Flink/
15.1k3.9k
aalansehaiyang/technology-talk

【大厂面试专栏】一份Java程序员需要的技术指南,这里有面试题、系统架构、职场锦囊、主流中间件等,让你成为更牛的自己!

javaspring
offercome.cn
14.7k3.8k
sogou/workflow

C++ Parallel Computing and Asynchronous Networking Framework

C++Apache License 2.0taskinghttp
14.4k2.6k
debezium/debezium

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

JavaMavenApache License 2.0change-data-capturekafka-connect
debezium.io
12.9k3k
IBM/sarama

Sarama is a Go library for Apache Kafka.

GoGo ModulesMIT Licensekafkakafka-client
12.5k1.9k
redpanda-data/redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

C++kafkacpp
redpanda.com
12.4k772