Is there an option to display a limited data set while developing?
I have a number of large data sets (20+ million rows) that have been loaded into the application. I'm wondering if while I'm developing charts etc if there is a way to have the application only use a subset of the overall data in order to improve development time (i.e. not having to wait for charts to load). Once I'm done, and/or I' ready to test the full data set after the chart is developed I can then go back and run against the full volume.
When you run the load script you can execute a limited load of x number of rows (you input the number of rows.
The only thing to be careful of is that if you have multiple dimensions joined to a fact, you need to be sure that you're limited load is enough to bring in all of the dimension values, otherwise your model ends up having some problems.
When you run the load script you can execute a limited load of x number of rows (you input the number of rows.
The only thing to be careful of is that if you have multiple dimensions joined to a fact, you need to be sure that you're limited load is enough to bring in all of the dimension values, otherwise your model ends up having some problems.
We have the same problem when developing. Once we have the data cloud correct, we will typically make selections down to a level that is reasonable for development and then reduce the data to those selections.
File --> Reduce Data --> Keep Possible Values.
Then all you have to do is reload to get all the data back.
As Nigel said, I would go to the debug mode and load a limited number of rows. That is also a best pratice to validate the script sintaxe and database connections.
