# Sink Kafka

# Purpose

Defines the outbound connection parameters for a Kafka sink. This Asset is required by:

# Prerequisite

You need:

# Configuration

# Name & Description

Name & Description (Kafka Sink)

Name : Name of the Asset. Whitespaces are not allowed in the name.

Description : Enter a description.

The Asset Usage box shows how many times this Asset is used and which parts are referencing it. Click to expand and then click to follow, if any.

# Required roles

Required Roles (Kafka Sink)

In case you are deploying to a Cluster which is running (a) Reactive Engine Nodes which have (b) specific Roles configured, then you can restrict use of this Asset to those Nodes with matching roles. If you want this restriction, then enter the names of the Required Roles here. Otherwise, leave empty to match all Nodes (no restriction).

# Kafka Connection

Kafka Connection (Kafka Sink)

Select the Kafka Connection to use with this Asset. If it does not exist, you need to create it first.

# Kafka Producer Settings

# General

General Kafka Producer Settings (Kafka Sink)

  • Parallelism: Tuning parameter of how many messages can be sent to Kafka in parallel. If nothing is specified, the default is 10,000.

# Additional Kafka Properties

Use this section to add configuration parameters available for Kafka Platform such as compression.type or even ssl.keystore.key.

Additional Kafka Properties (Kafka Sink)

For a list of available properties please check Confluent Producer Configurations (opens new window).

Attention: Kafka properties take precedence

Please note that properties defined here, take precedence over all other settings you may have provided in this UI. You can use this to add, or override Kafka properties using these settings.

# Exclusive partition access

In case you want to exclusively write to one or more partitions, then Enable exclusive partition access.

Exclusive partition access (Kafka Sink)

Click ADD TOPIC to add new topics. Enter the Topic in the new table row.

# Internal

# External

# Potential problems

Can't find what you are looking for?

Please note, that the creation of the online documentation is Work-In-Progress. It is constantly being updated. Should you have questions or suggestions, please don't hesitate to contact us at support@layline.io .

Last Updated: 7/5/2022, 4:50:56 PM