Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik and ServiceNow Partner to Bring Trusted Enterprise Context into AI-Powered Workflows. Learn More!
cancel
Showing results for 
Search instead for 
Did you mean: 
gianlucasaturno
Partner - Contributor
Partner - Contributor

SAP Hana LogBased as a source not replicating date fields in CDC

Hello We are encountering an issue with our Replicate ver. Nov 2024 where a number of "Date" values are not replicating and are instead blanked in the target (SqlServer in our case but I tried with many other target as well as SAPHana itself)
turning on the verbose log we can clearly notice the values are read from the source and then set to NULL on the target.


----------------------------------------------------------------------------------------------------------------------------------------
00002775: 2025-01-10T16:14:48:555820 [METADATA_MANAGE ]V: get_table_def_from_source returns table 'TGK_TESTINFRA_BEEKEEPERS_TRUNK'.'NEWTABLE' (src) 'TGK_TESTINFRA_BEEKEEPERS_TRUNK'.'NEWTABLE' (trg) for component 'Deferred Constructor Source' (metadatamanager.c:2168)
00002775: 2025-01-10T16:14:48:555858 [DATA_RECORD ]V: Going to convert value for column [TIMESTAMP,2]
~{kgAAALaQO7co5JUl0zq67L9LDV0KMaUOrlJ4Id77ebE4nezaMBnMZ6qZ0o7QyRLkDbehcVd0jydlb0IOkExoVqgAQJnL4BBrEFOSBo/pXTO1xqYL}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555865 [SOURCE_CAPTURE ]V: Column [TIMESTAMP,2] set to NULL (saphana_cdc_event_constructor.c:314)
00002775: 2025-01-10T16:14:48:555877 [DATA_RECORD ]V: Going to convert value for column [DATE,3]
~{kwAAAEUPwMY2Ka7AjnEeYPnuIwZrRQ9YE1inGq1PXgT4mboT48/FKESsjh/jujeqE/0tWVZQwlepdrVMZTpVcfR2AybAO+I70qneMT5RtKT3SURm}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555888 [SOURCE_CAPTURE ]V: Column [DATE,3] set to NULL (saphana_cdc_event_constructor.c:314)
00002775: 2025-01-10T16:14:48:555898 [DATA_RECORD ]V: Going to convert value for column [TIME,4]
~{lAAAAKsJuRENjLx6NbwvR6mYGpoCAuRM9uBaw+Z5QmvV4+GirM9BFx/HLqSD43hYRtlXnuUDp3JBHL2ZSIAcywn5SeiT2UPsGXHjohAHb5Hb8iAa}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555911 [DATA_RECORD ]V: Going to convert value for column [VARCHAR,5]
~{lQAAAHN2p1Hehb9GBFkRDm7QvdbbiZxas0C3VgiF0csdSb2/jdZgJVaw7vqj7m81YxsiQuc/ch48wj+B8WerphM3Kcy0jYo/hsJUL8FrgzcbHfU5}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555917 [INFRASTRUCTURE ]V: using fast conversion (at_text.c:773)
00002775: 2025-01-10T16:14:48:555929 [DATA_RECORD ]V: Going to convert value for column [SECONDDATE,6]
~{lgAAADD4LYfb501uKnb2Gz414Aud3a1Mw/VYpC2HlZSFHlXOfqHoXTnRYDsPhgjYoF+JLraIJigvYjcy05ct7Ss9LirIpJaE09AoAX7dgw92cdUR}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555935 [SOURCE_CAPTURE ]V: Column [SECONDDATE,6] set to NULL (saphana_cdc_event_constructor.c:314)
00002775: 2025-01-10T16:14:48:555946 [DATA_RECORD ]V: Going to convert value for column [DOUBLE,7]
~{lwAAAGLtCpDVatwvCmrcTO/s7+1GsY0sYwa5jlT6xGbXU+39Qwx6M3R8LCygMFPh4lYu1ITMavJL1hZo9Lvz7qACKWi9X6HfZV2vQNL/4ugoME5a}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555957 [DATA_RECORD ]V: Going to convert value for column [hana__row_id,8]
~{mAAAABH/vzY2l+trGbhBSUcFrPd+2aGR0Tnzq1Jxo79qChyfuzdf1dxUuvrbCZTQWhHmU5ZzicfOkBL7WkIUn0LMbZiVcdZCpxs5cookDy2eobAs}~ (saphana_cdc_event_constructor.c:297)
00002775: 2025-01-10T16:14:48:555965 [SOURCE_CAPTURE ]V: Built Captured UPDATE (3) event: object 342765 stream position '766177152:766177157' xid [000000000031b887] (saphana_cdc_event_constructor.c:275)
----------------------------------------------------------------------------------------------------------------------------------------


As you can see while VARCHAR, DOUBLE and also TIME are converted and replicated correctly, TIMESTAMP, DATE and SECONDDATE are set to NULL after conversion.

We are using SAPHANA LogBased as source and during FULL load all the columns are replicated correctly, problem appears to be only a CDC issue

Has anyone encountered this before?

If you need any other information I'll be glad to answer as I'm sure I forgot some details here

Regards

Gianluca

Labels (1)
1 Reply
OritA
Support
Support

Hi Gianluca, 

You have already opened a case (case # 00343566) reporting the problem. As the problem is now being investigated by our internal team therfore, the problem will be handled via the case. 

 

Regards,

Orit