Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in Bucharest on Sept 18th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
Not applicable

Loading a large data set causing performance issues

I'm trying to load a fairly large dataset (I've loaded larger with no issues).

After I load I place all the datapoints in a scatter plot with the following expressions:

Long = sum( round (256*pow(2,($(var_zoom)-1)))+( Long  *((256*pow(2,$(var_zoom)))/360)))

Lat= sum(((256*pow(2,($(var_zoom)-1)))+((0.5*log((1+(sin((Lat)*pi()/180)))/(1-(sin((Lat)*pi()/180)))))*((-256*pow(2,$(var_zoom)))/(2*pi())))))

(i'm doing this: Step-by-Step Google Map API v3 integration)

This works GREAT with my first test load of about 50k rows, but once I hit the 1.5 million rows it just spins and spins (trying to load the scatter plot) and stays like that until i give up a few minutes later.

Am I missing something from a performance standpoint, what could be wrong!?

PS: My QVW is not doing ANYTHING other than that scatter plot with the Google API Integration)

3 Replies
marcus_sommer

If there aren't any errors (synthetic keys, circular references) within the data-structure (tableviewer) you should look to the taskmanager and/or working sets if there are enough RAM available. Further it could be helpful to select a smaller data-ranges before you activate this object.

- Marcus

Not applicable
Author

I barely have enough RAM left, the QVW is taking about 6gigs of ram when loading the full dataset.

I did select a small range, and when I did it worked, it just breaks with the full range.

marcus_sommer

Objects have also a RAM limit - it could be somewhere changed on user-level but it's not recommended. Perhaps you have somewhere in your data errors and/or null-values - check for these and if there any null/errors wrapped your expressions(parts) within alt(Expression, AlternativeValue) or use if-loops.

- Marcus