Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi,
I want to load large amount of data daily(1 Millions records) from source. please suggest me any steps. and how can i take care of performance issue.
Very much depends on how many columns you have. I daily load in 37 Million, 50 column data table and additional reference tables - does the lot in 3-4 minutes. However that is working directly from .qvd files.
My recommendation would be to build and app which builds qvds then load them into your app. You would need to decide how you build those qvds - incremental, insert, update or recreate and then how you would divide them up as necessary - fr example by month or quarter etc.