topic Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time in Qlik Replicate

Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

priyankaraj — Sat, 16 Nov 2024 00:08:22 GMT

Hello Team,

We are noticing considerable Replicate performance degradation in Replication loads when switching from CSV file format to JSON.

Curious to know why and if someone else has same experience. Thank you!

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

john_wang — Sat, 15 Aug 2020 02:33:57 GMT

What's the Replicate version are you using now.

I got report that the CPU utilisation went significantly high when switching from CSV file format to JSON. We are working on it. Will keep this post updated.

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

priyankaraj — Sat, 15 Aug 2020 03:04:42 GMT

Hi John,

Thanks for your quick reply. The CPU utilization was variable 30-40%. I had multiple replication tasks running.

We are using version 6.6.0.298. Thank you.

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

JitenderR — Mon, 31 Aug 2020 21:47:03 GMT

@john_wang Is this targeted to fix in a specific release?

Regards

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

priyankaraj — Fri, 11 Sep 2020 05:07:02 GMT

Hello Team,

Any update? @john_wang

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

john_wang — Fri, 11 Sep 2020 05:42:52 GMT

Hi @priyankaraj , @JitenderR ,

Sorry for the delay.

I have not further information about it. I'd like suggest you open a support case in Salesforce and provide necessary information/files for SME/R&D analysis.

Regards,

John.

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

priyankaraj — Mon, 19 Jul 2021 20:12:00 GMT

Hi John,

Any update on this?

Re: Qlik Replicate ADLS Gen2 File Format JSON - Loads taking time

john_wang — Tue, 20 Jul 2021 02:04:33 GMT

Hello @priyankaraj ,

In the support case (#02042291) the behavior cannot reproduced any more and we cannot get further information about it. I'd like suggest you open a support case with below information if the behavior persists in your env:

1) It occurs during FL or CDC?

2) On which phase exactly the CPU raises - when the file was generated by Replicate?

3) What is the CPU for the same scenario comparing to CSV?

4) Please share the relevant details for reproduction (i.e. table DDL, what is the table size, diagnostic package, how many rows there are in the table).

Regards,

John.