Failed to produce message to exception stream while using kinesis as a target

[sush_1]

Hi team, 

We are transferring data from oracle to kinesis. In one of the task which contained 38 tables got failed due to error that is failed to produce message to the exception stream. After giving warning for data error in one of the table that is A data error was encountered.refer to the attrep_apply_exceptions table for details.

Please let us know in which scenario this happens. Is there any workaround for this issue.

Attaching error screenshot for your reference.

Regards,

Sushant 

[john_wang]

Hello @sush_1  ,
Thanks for reaching out to Qlik Community!
Please provide TEXT format messages in the future, it's much easier for analysis.

Regarding the error message:
[TARGET_APPLY ] A data error was encountered. Refer to the table 'attrep_apply_exceptions' for details

In general it's caused by invalid data especially in AVRO message format, a NULL column value may cause this error.
1. Please check topic 'attrep_apply_exceptions' to see if any detailed information there
2. If it's caused by NULL value then you may convert the NULL to empty by using transform, a sample expression:
ifnull($COLx, ' ')

Hope this helps.
John.

[sush_1 · Accepted solution]

Hi John,

We need to understand, why this task went to error state stating failed produce message to exception stream.

Ideally it has to log the data error to the exception stream.

Regards

Sushant

[Kathlyn · Accepted solution]

Have you tested the integration with Kinesis using different message payloads or data formats to determine if the issue is specific to certain types of messages?

[john_wang · Accepted solution]

Hello Sushant @sush_1 ,

Thanks for the feedback.

We need additional information to understand the issue completely. Please open a support ticket and upload the Diag Packages with SOURCE_CAPTURE/TARGET_APPLY set to Verbose. BTW, please do not forget to decrypt the task log files before attaching to case.

Regards,

John.