The purpose of this document (Download pdf file from resources )and included Kubernetes support package (Download zip file from resources)is to provide a guide to install, configure, and run Apache Pulsar with Kafka (KOP) in a Kubernetes Environment. Following the instructions provided in this document and using the specified supported versions of products and components, users can run the above mentioned Apache Pulsar components in a supported fashion running using Kubernetes.
This document will outline:
- Configuring a Kubernetes cluster for Quasar. The Kubernetes Container can be configured on Azure Kubernetes Service (AKS), Amazon Elastic Kubernetes Service (EKS), Google Kubernetes Engine (GK), Red Hat OpenShift (OC), or a generic Kubernetes environment.
- Downloading the Pulsar Protocol handler for Kafka (nar) from Stream Native
- Creating multiple Docker® images for the Quasar Core, where the containers will be hosted in a Docker Registry
- Creating persisted volumes for Zookeeper, Bookkeeper, and the Broker
- Configuring and creating Kubernetes containers based on the Docker images for the individual components
- Downloading and configuring the Grepp Labs Kafka Proxy and configuring it in Kubernetes
- Configuring Load Balancer(s) in Kubernetes to access Quasar
- Ensuring Quasar is instrumented (JMX) for TIBCO Message Monitor with the Quasar extension.
Support Product and Component Versions:
- TIBCO Messaging Quasar - Powered by Apache Pulsar 2.9.1-1 or later (TIBCO Distribution)
- Quasar can be downloaded from either edelivery.tibco.com , or https://www.tibco.com/products/tibco-messaging/downloads.
- StreamNative pulsar-protocol-handler-kafka v2.9.2.
- The StreamNative protocol handler can be downloaded from https://github.com/streamnative/kop/releases/tag/v2.9.2.21. Download pulsar-protocol-handler-kafka-2.9.2.21.nar
- The most current version of Grepp Labs kafka-proxy is used. Nothing specific is required to download the kafka-proxy Docker image for GitHub. The Kubernetes yaml file will download it from GitHub when it is applied in Kubernetes.
- Docker Community/Enterprise Edition should be the most recent version.
- Kubernetes 1.22 or Red Hat OpenShift Container Platform 4.8. Recommend latest versions of the container platform
- Red Hat Enterprise Linux 7.9 (or comparable OS) or newer
- TIBCO Messaging Monitor version 1.0 or newer (optional)
Prerequisites:
- Kubernetes concepts, installation, and administration
- Kubernetes CLI, kubectl
- Apache Pulsar configuration
- Apache Kafka configuration
- TIBCO Msgmon (optional)
how_to_configure_tibco_quasar_with_kop_in_a_kubernetes_environment.pdf
Recommended Comments
There are no comments to display.
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now