Qlik Community

New to Qlik Sense

Discussion board where members can get started with Qlik Sense.

Announcements
QlikWorld 2020: Join us May 11 - 14, 2020 in Phoenix, AZ. Register early and save $400. Learn More
PeterHenskens
New Contributor II

How to Filter Values based on condition on other data column

hi,

in my case, i have a QVD database of 3M rows, (shipments)

every day the status of some of these shipments change and needs to be updated into the QVD file

now incremental load a large file and update the rows, this works but takes way to long (600k rows a day while only 200k are updated)

my table contains 25 fields, the update file contains 67fields (only 6 fields need to be updated, 1 is a key (same as the QVD file)

in excel it would be index('status', match('Id','Id',0))

Database:
LOAD Id,
[Forwarder Ref],
[Forwarder Track],
[Customer Ref],
[Project Name],
Performance,
[SLA Pickup Date],
[Actual Pickup Date],
[Actual Pickup Time],
[Pickup Postal Code],
[Pickup City],
[Pickup Country],
Forwarder,
[SLA Delivery Date],
[Actual Delivery Date],
[Actual Delivery Time],
[Delivery Name],
[Delivery Postal Code],
[Delivery City],
[Delivery Country],
Status,
[Last Event Date],
[Last Event],
Rootcause,
Responsible

from ****

Update:
LOAD Shipment_ID as Id,
Actual_Delivery_Date as [Actual Delivery Date],
Performance,
Actual_Pickup_Date as [Actual Pickup Date],
Shipment_Status as Status,
Event as [Last Event],
Event_Date as [Last Event Date]

from ***

could someone please help me? 🙂

 

thanks.

1 Reply
DavidŠtorek
Contributor III

Re: How to Filter Values based on condition on other data column

Hi,
is there some "last modified date" field in your database? Have you thought about splitting your QVD into two parts (one with fields to be updated and another with the rest)?