How to do calculations on scripting side .when data coming from two different sources
I have sensor data coming from impala data base,and i have locations data coming from postgres data base. I have written very complex formulas using aggr() , if condition, and such other which causing a lot of performance issues on dashboard.
As of now we are dealing with 1-2 crores of records,but due to heavy computational formulas on each and every chart,it is taking some 50-60 secs to open the dashboard.
To make my dashboard fast, i want to handle those formulas in db side or scripting side, as i am getting data from two different sources when i try to write the formula,it is showing error like xxx field not found .