Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Write Table now available in Qlik Cloud Analytics: Read Blog
cancel
Showing results for 
Search instead for 
Did you mean: 
gopikrishnan06
Creator
Creator

Qlik Replicate Insert issue in the Databricks Delta lakehouse Delta on GCP.

hi all,

I have Source as oracle and target as Databricks Delta tables on GCP. Here Qlik not support for the Cloud native function as Data enrichment function in the 2024 and 2025 Version.

So i added one column manual at the target DBRX end as Current_timestamp.

ALTER TABLE vvv ADD COLUMN audit_created_datetime TIMESTAMP;
ALTER TABLE vvv SET TBLPROPERTIES('delta.feature.allowColumnDefaults' = 'supported');
ALTER TABLE vvv alter column audit_created_datetime set default current_timestamp();

But here when i get full load using Qlik replicate i need Current timestamp and when ever i got INSERT i need the col audit_Created_Datetime as current_timestamp values.

Even i add as Replace column value as audit_Created_datetime as datetime('now', 'UTC'). i got NULL in the column kindly give the solution.

 

Labels (1)
8 Replies
OritA
Support
Support

Hi, 

If you want to add a column with a value then I would suggest you try doing it through Replicate transformation option, i.e.: under the task designer screen choose the table you want and then choose table settings --> transform add the new column in the target side and then using the expression option you can choose the function you want with the value. This will affect all rows including during table full load. If you still have issues please open a case with the detailed description and attach to it the task diagnostic package . 

thanks & regards,

Orit

gopikrishnan06
Creator
Creator
Author

Hi OritA,

I already raised the concern with the Qlik Vendor. They said it not possible in the 2024 and Qlik 2025 version too.. Cloud databricks no support for data enrichment funcation.
So i added the column in the databricks end using alter table add column audit_created_datetime default timestamp;

Already i added for the Update case as when ever i get update for the table it should mark as using operation indicator as U and current timestamp placed.

Kindly suggest.

gopikrishnan06
Creator
Creator
Author

Hi Team,

Qlik replicate option not working with the Audit_created_column using the target_lookup function.

So i added the col in the databricks DB.

ALTER TABLE bbb ADD COLUMN audit_created_datetime TIMESTAMP;
ALTER TABLE bbb SET TBLPROPERTIES('delta.feature.allowColumnDefaults' = 'supported');
ALTER TABLE bbb alter column audit_created_datetime set default current_timestamp();
UPDATE bbb SET audit_created_datetime = current_timestamp() WHERE audit_created_datetime IS NULL;

 

Now i try to load it from Qlik replicate whenever i get insert i need to place in the audit_created_datetime as Current_timestamp.

am getting this error.

02693760: 2025-11-07T12:28:28 [TARGET_APPLY ]I: RetCode: SQL_ERROR SqlState: 42802 NativeError: 80 Message: [Simba][Hardy] (80) Syntax or semantic analysis error thrown in server while executing query. Error message from server: org.apache.hive.service.cli.HiveSQLException: Error running query: [DELTA_INSERT_COLUMN_ARITY_MISMATCH] com.databricks.sql.transaction.tahoe.DeltaAnalysisException:

Dana_Baldwin
Support
Support

Hi @gopikrishnan06 

Please continue to work with Support on the case that you have opened for this item.

Thanks,

Dana

gopikrishnan06
Creator
Creator
Author

hi Dana,

Already i raised concern with the support case. why iam posting here as it will reach bigger audience to get solution..

Even target_lookup function not working in the Qlik replicate Cloud native function. here need to find the alternative solution rite.. then why given as Databricks delta lake house on GCP supports the Qlik replicate..

beatricerascon
Contributor
Contributor

Hey, I faced the same issue before. Qlik Replicate doesn’t trigger Delta’s default expressions like current_timestamp() during inserts - it just writes data directly, so the column stays NULL.

You can fix it either by adding a small post-load SQL/Delta MERGE job to update the column with current_timestamp(), or by handling it inside Replicate using a transformation rule (e.g., TO_TIMESTAMP(sysdate) instead of datetime('now','UTC')).

Also, make sure your Delta table supports column defaults - sometimes it needs to be recreated with DEFAULT current_timestamp() defined.

Hope that helps!

gopikrishnan06
Creator
Creator
Author

Hi Beatricerascon,

Whenever i get Insert using Qlik replicate the timestamp placed as current timestamp in the Audit_created column..

The same for Update it will update as current timestamp in the Audit_updated column.

But here it replace as null in the Audit_Created col when ever we get UPDATE..

Qlik Vendor said as not possible in the Databricks cloud native.. 

So i added manually using table alter scripts in the databricks.

alter table zzzz ADD COLUMN audit_created_datetime TIMESTAMP;

ALTER TABLE zzzz SET TBLPROPERTIES('delta.feature.allowColumnDefaults' = 'supported');

alter table zzzz alter column audit_created_datetime set default now();

update zzzz set audit_created_datetime = current_timestamp()

So now using Qlik replicate to load either the same issue will populate?

Kindly suggest if any way to fix the Null

gopikrishnan06
Creator
Creator
Author

All,

Any update what ever the option tried in qlik replicate end too not working.. whenever i get update it changing the inserted timestamp as NULL alone.

From Databricks end tried with the Manual creation of Audit _created_Datetime and Update passing from /Qlik replicate still am getting as NULL in the inserted timestamp.

If any fixes please let me know. Already raised with Qlik Vendor Support ticket.. 

Thank you