Unmach data in databrick datalake and SAP ODP for Numeric data type

Farzaneh_71 — Fri, 14 Jun 2024 12:00:07 GMT

Hi all,

We are encountering a strange issue with data from the SAP ODP connection to the Databricks Delta Lakehouse.

As you can see from the example, data in SAP (for instance, in the "trame" column) appears as 10.00 but becomes 0.00 in Databricks. The data type in SAP is QUAN, which, according to the documentation, is supported by Qlik and should be recognized as numerical.

Databricks supports numerical data and typically casts it to decimal. However, it seems that this casting is not happening correctly, as we do not get the same data.

As a quick fix, we applied a global rule to convert all numerical data to strings, and this workaround is functioning correctly.

Is this a bug, or do you have any suggestions on how to resolve this issue?

Re: Unmach data in databrick datalake and SAP ODP for Numeric data type

john_wang — Fri, 14 Jun 2024 14:24:25 GMT

Hello @Farzaneh_71 ,

Welcome to Qlik Community forum and thanks for reaching out here!

We need additional information to understand the issue. I'd like to suggest opening a support ticket with below information:

1- Verbose task log

If the problem occurs during Full Load, then set SOURCE_UNLOAD/TARGET_LOAD to Verbose;

If the problem occurs during CDC stage, then set SOURCE_CAPTURE/TARGET_APPLY to Verbose;

Recreate the behavior and provide the Task Diagnostics Packages

2- Please do not forget the decrypt the task log file and attach it to case. The task log file default location in Windows is "C:\Program Files\Attunity\Replicate\data\logs"

3- Attach endpoint server log, in Windows the default location is "C:\Program Files\Attunity\Replicate\data\endpoint_srv\data\logs\rependsrv.log"

Our support team will be more than happy to assist you.

Regards,

John.

topic Unmach data in databrick datalake and SAP ODP for Numeric data type in Qlik Replicate

Unmach data in databrick datalake and SAP ODP for Numeric data type

Re: Unmach data in databrick datalake and SAP ODP for Numeric data type