Unmach data in databrick datalake and SAP ODP for Numeric data type

[Farzaneh_71]

Hi all,

We are encountering a strange issue with data from the SAP ODP connection to the Databricks Delta Lakehouse.

As you can see from the example, data in SAP (for instance, in the "trame" column) appears as 10.00 but becomes 0.00 in Databricks. The data type in SAP is QUAN, which, according to the documentation, is supported by Qlik and should be recognized as numerical.

Databricks supports numerical data and typically casts it to decimal. However, it seems that this casting is not happening correctly, as we do not get the same data.

As a quick fix, we applied a global rule to convert all numerical data to strings, and this workaround is functioning correctly.

Is this a bug, or do you have any suggestions on how to resolve this issue?

[john_wang]

Hello @Farzaneh_71 ,

Welcome to Qlik Community forum and thanks for reaching out here!

We need additional information to understand the issue. I'd like to suggest opening a support ticket with below information:

1- Verbose task log

     If the problem occurs during Full Load, then set SOURCE_UNLOAD/TARGET_LOAD to Verbose;

     If the problem occurs during CDC stage, then set SOURCE_CAPTURE/TARGET_APPLY to Verbose;

    Recreate the behavior and provide the Task Diagnostics Packages 

    

2- Please do not forget the decrypt the task log file and attach it to case. The task log file default location in Windows is "C:\Program Files\Attunity\Replicate\data\logs"

3- Attach endpoint server log, in Windows the default location is "C:\Program Files\Attunity\Replicate\data\endpoint_srv\data\logs\rependsrv.log"

Our support team will be more than happy to assist you.

Regards,

John.