StreamNative Cloud: Deploying Amazon SQS Source using pulsarctl
This video was created using StreamNative Hosted, a fully-hosted Pulsar cluster option available from StreamNative.
Quickly deploy the Pulsar Amazon SQS Source Connector to StreamNative Cloud. This source connector allows you to persist Amazon SQS data to StreamNative Cloud. In this video we create and configure an Amazon SQS Queue, deploy the Amazon SQS Source Connector using pulsarctl, add a message to the SQS Queue, and consume the message from a topic using the Pulsar Java Client.
[00:00] Deploying Amazon SQS Source using pulsarctl
[00:48] Create Amazon SQS Queue, obtain region and queue name
[01:27] Add required permissions to Amazon SQS Queue
[03:30] Create service account, service account binding, and add tenant/namespace permissions
[05:17] Deploy Amazon SQS Source Connector using pulsarctl
[07:07] Test connector by creating message in Amazon SQS Queue and consume from Pulsar topic using Pulsar Java Client
To view list of permissions Source Connectors required in Amazon SQS Queue:
https://docs.streamnative.io/hub/conn...
If you are unfamiliar with using pulsarctl, the following video provides an example of downloading pulsarctl, getting pulsarctl connection information from StreamNative Cloud UI, and connecting using your service account (needed to deploy the source as the service account):
• Deploying Pulsar Functions to SN Hosted wi...
Pulsarctl command used to deploy source:
pulsarctl sources create --archive builtin://sqs \
--tenant sqstenant \
--namespace sqsnamespace \
--name sqssource \
--destination-topic-name sqstenant/sqsnamespace/myfirstqueue \
--source-config '{"awsRegion":"us-east-2","queueName":"myfirstqueue","awsCredentialPluginParam":"{\"accessKey\":\"{access key}\",\"secretKey\":\"{secret key}\"}"}'
If you are unfamiliar with using Pulsar Java Client, the following video provides detailed directions on obtaining sample Java code from StreamNative UI and setting up Intellij:
• Test Pulsar Functions with SNProducer and ...