My application holds data for 3yrs. We have following process:
1) ETL-Load 3 yrs data from different Qvds and create data model
2)UI-Binary load of data model
1St step is taking 6 hrs to load 3yrs data. So can we create data model with 2 yrs and for daily load we can call that 2yr binay load and mearge current yr data?
Is it possible? Let me know other ways to save data modeling time. Load 3yrs data is not going to work.
Binary load will get tables and their relations for the 2 years. You can concatenate the new data table by table. As long as it's just straight tables normally linked, it should work. Additional work would be needed for aggregate tables, for example. If you think some parts of the data model could be more tricky, feel free to post a sample.
