Skip to Main Content
Integration


This is an IBM Automation portal for Integration products. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:

Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,

Post your ideas
  1. Post an idea.

  2. Get feedback from the IBM team and other customers to refine your idea.

  3. Follow the idea through the IBM Ideas process.


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.


Status Delivered
Workspace App Connect
Created by Guest
Created on May 5, 2021

Support Kafka client properties

Apache Kafka is changing quite fast. It adds new properties to configure its behavior. On other side ACE/IIB provide UI to modify only some of them. It requires creation of RFE to enable access to new properties.
We'd like to have an option to add properties as a generic set of key/value pairs. So it will make ACE/IIB Kafka nodes more flexible and will support more use cases.

Idea priority High
RFE ID 150333
RFE URL
RFE Product IBM App Connect Enterprise (formerly IBM Integration Bus)
  • Admin
    Ben Thompson
    Reply
    |
    Jul 7, 2021

    Idea / RFE Review. Thank you for taking the time to raise this enhancement request, and also for supplying the background of the Case number which was resolved by IBM support. For the benefit of other future readers, the case concerned the ability of the Kafka Consumer node to start reading messages from Kafka at a particular specific offset. The KafkaConsumer node has this capability, but specifically your use case wanted to seed the value for the offset from an external jar file. This kind of extension has not previously been requested and is not an area we are intending to invest in at the moment. Note that such a jar file could be accessed from a midflow position using a JavaCompute node, and then the offset value could be passed to a downstream KafkaRead node (using LocalEnvironment.Destination.Kafka.Read.offset):

    https://www.ibm.com/docs/en/app-connect/11.0.0?topic=messages-using-local-environment-variables-kafka-nodes

    Also note that the KafkaConsumer node Advanced Properties includes a "Properties file" which takes the full path name of a kafka.properties file to set Kafka client properties. You can use a properties file to set properties on the Kafka consumer that cannot be set through the KafkaConsumer node properties. If the properties file specifies a property that is also set on the KafkaConsumer node or by a Kafka policy, the value set in the properties file takes precedence.