Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
gorkemakinci
Contributor II
Contributor II

Loading Only Unique Data From a Folder

Hello there,

I do have a workflow which generates a .qvx that runs daily. When it first runs it includes all groups and it also controls if a group is complete with this workflow and note it down if it is. To sum it up let's say I do have 3 groups A, B and C. A's data are complete but B and C's are not. When it first runs it generates all data and note it down that A is complete, on the 2nd run since it noted down that A was complete it doesn't run the data of A but it does the same thing for B and C which it did a day ago and so on.

After all I have this folder which has lots of .qvx's that looks like this:

Groups ID data
A 1 a
A 2 aa
B 1 b
B 2 bb
C 1 c
C 2 cc
C 3 ccc

(first qvx)

 

Groups ID data
B 1 b
B 2 bb
C 1 c
C 2 cc
C 3 ccc

(second qvx)

 

When I load this data to Qlik Sense Enterprise of course I do want it to be as fast as possible, And right now it loads all qvx files completely to the table. I do want to learn if there's any possibility to load from a folder and specify it to not load the same data twice (Distinct didn't work for me maybe I missed sth), or else can I specify some Group and ID combinations to be load once or something like that. Every help will be appreciated, I'm ready to try new things out, thanks in advance!

Labels (5)
10 Replies
Aasir
Creator III
Creator III

Yes