Streaming Input Component Talend DI Job

[Anonymous]

Hi,

I am building a custom streaming RabbitMQ input component to put in a Data Integration job and am having some problems with it behaving as it is still batching; aka it stops when I don't have a message.  When I created the component through the Talend Component Kit (1.1.19), I set it to streaming and the following entry is in my Mapper class ...

So, following the docs, it leads you to your local config file.  Where is the local config file?  The docs point towards setting that in the Java code itself instead of reading off the file, can someone give a simple example of how to do that; I know it is like @Config("value").  Can I just put that in a method somewhere that gets called?

Also can you run a streaming input component in a DI job, or does this need to go in a Big Data job because DI jobs really don't support streaming inputs?

https://talend.github.io/component-runtime/main/1.1.19/component-implementing-streaming.html

https://talend.github.io/component-runtime/main/1.1.19/services-built-in.html#_localconfiguration

Thanks,

Jason

[undx]

Hi @jason_schilli jason_schilli​ ,

You can add custom properties via a `resources/TALEND-INF/local-configuration.properties` file. In that one, you can set properties related to streaming like:

```

mycomponent.talend.input.streaming.retry.strategy=constant

mycomponent.talend.input.streaming.retry.maxRetries=1

mycomponent.talend.input.streaming.retry.constant.timeout=0

```

Streaming should work in DI jobs.

br