Destinations
A destination determines where replayed data will be sent.
Batch currently supports the following replay destinations:
Kafka
RabbitMQ
Amazon SQS
HTTP
NATS
Redis PubSub
Redis Streams
A replay destination can either be:
A publicly accessible resource (such as an internet connected Kafka instance on Confluent)
or
A tunnel created via
plumber
A destination will be automatically health-checked for you and its status will be available in the destination view and on the dashboard.
If a destination is "unhealthy", it means that Batch is not able to communicate with it and a replay is likely going to fail.
Batch will replay data to the destination from the following IP's.
Optimal Destination (Geo) Location
Batch's "replayers" are hosted in AWS in the us-west-2
region.
To optimize for throughput, your destinations should be located as physically close as possible to Batch's servers.
If you are unable to "get closer" and require high throughput (10,000+ events/s), reach out to us and we'll see what we can do about standing up infrastructure that's located closer to you.
Kafka Destination
Expose a destination to Batch's outbound IPs
Navigate to 'Destination' and select 'New Destination'
3. Select Kafka as Destination 'Type'
4. Fill in relevant details about Kafka Cluster and Topic
5. Confirm Destination health
RabbitMQ Destination
Expose a destination to Batch's outbound IPs
Navigate to 'Destination' and select 'New Destination'
3. Select RabbitMQ as Destination 'Type'
4. Fill in relevant details about RabbitMQ Cluster and Exchange
5. Confirm Destination health
Amazon SQS Destination
<TODO: INSTRUCTIONS + CONSOLE SCREENSHOT(S)>
HTTP Destination
Expose a destination to Batch's outbound IPs
Navigate to 'Destination' and select 'New Destination'
3. Select HTTP as Destination 'Type'
4. Fill in relevant details about HTTP endpoint
5. Confirm Destination health
Last updated