How to Load Limited Records in Qlik Replicate

[deepaksahirwar]

Dear Community Users,

Let's say I have a Table A which  have around 5000 of Records.

It have 5 Columns id,fname,lname,city,country. 

How could we load only 2000 records out of it using Qlik Replicate?

Thanks and Regards,

Deepak Ahirwar

[SachinB · Accepted solution]

Hello @deepaksahirwar ,

There is an option to add a "Fullload Passthru Filter" - with this option everything you write in the filter is added following the WHERE clause of the SELECT statement of the full load, and the entire statement is passed directly to the source DB, so the statement must be in the source db sql syntax.

To add this, HOLD the Ctrl key, while you open "Table Settings" and keep it hold while you click on Filter.

By this way you can achieve your selection criteria, Please follow below community link for more information.

https://community.qlik.com/t5/Knowledge/Filter-for-last-90-days-of-data-in-Qlik-Replicate/ta-p/18807...

Regards,

Sachin B

[narendersarva]

Hi @deepaksahirwar,

I agree with sachin's solution, but please keep in mind below passthrough filters limitations.

Because the passthrough filter can interact directly with the source database, there is some risk involved if you use incorrect syntax or logic in the passthrough filter.

This applies to users with update permissions on the source DB. If you check the Qlik user guide by source, it will provide more information about what permissions are required for the replicate user. Additionally, you can check with source dba to see if replicate user has update permission.

Thus so long as your user does not have update privileges and you test your filter prior, it's safe to use.

Thanks

Naren

[Dana_Baldwin · Accepted solution]

Hi @deepaksahirwar 

If you are on a more recent version of Replicate, you will need to enable the passthrough filter feature. Edit the file repctl.cfg which you will find in the ..\Replicate\Bin directory and change this entry to true:

"enable_passthrough_filter": true

You may need to restart the Replicate services for this to take effect.

You also have the option of filtering out the data after it arrives on the Replicate server, but this will not perform as well because all rows are returned to Replicate and filtered there. If the table you are filtering isn't very large it might be an option for you. You can learn more here:

https://help.qlik.com/en-US/replicate/May2022/Content/Global_Common/Content/SharedEMReplicate/Custom...

Thanks,

Dana

[deepaksahirwar]

Thank You, Sachin. 

That's very helpful

[deepaksahirwar]

Thank You, Dana. 

That's very helpful

[deepaksahirwar]

Thank You, Narender.