Skip to main content
Announcements
Qlik Connect 2024! Seize endless possibilities! LEARN MORE
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Filter data during Load

I am loading a small (50K) excel sheet and a large (2M) oracle table, I would like to only load the data in the oracle table that is common to both datasets thus reducing the load time. I know I could do this outside of Qlikview, just wondered if I was missing some option/script tip to do this?

Also, is a 2million row, 100 column considered big for qlikview to manage? Uusually I am looking at a good 3-4 hours to load this - any tips to improve performance or only load changes to the table not a full refresh each time?

Thanks in advance

11 Replies
suniljain
Master
Master

Is there any common primary key exist between oravle table and excel sheet ?

If exist then you can use left join to extract requires data.

Not applicable
Author

Yes there is a PK common to both data sets - How would I use left join when one data is in excel the other is in oracle, do you have any sample scripts? What I am trying to do is reduce load time by only bringing in the matching 50K records in the 2M oracle table. Thanks.

Not applicable
Author

if common key exit then you use inner join to find out common data both of table

Regards

Ashish

Not applicable
Author

thanks but I am not sure if that helps my main objective of cutting down the load time... obviously I could load the excel into oracle, do a join and bring in the result but I wanted to see if qlikview has any shortcuts to do this as you load the data

suniljain
Master
Master

Another Method is

Load *

From excel data

concatenate

Load *

From Oracle data where(Pk1 exist in pk2)

Not applicable
Author

i`m having a similar need, I have 2 excel files, one of them is too big for a quick load, and I would like to load only the records in common in the files, i`m having a little problems in doing this, if anyone could help, i`d be glad.

Not applicable
Author

could you show the syntax?

Not applicable
Author

Hello,

You can try using this:

small:

LOAD

    field1,

    field2

FROM Excel_Small;

large:

LOAD

    field1,

    field3

FROM Excel_Large

where exists (field1,field1);

Thanks,

ASINGH

qlikmsg4u
Specialist
Specialist

we can use exist() function for this..correct me if i'm wrong