Aggregate historical data

[poonam_kulwal]

Hi,

I have a dashboard with 3 months data. I am presenting complete Log analysis based on 3 months data.

Now I am looking forward to present a char (on same dashboard) to show analysis based on

• Year on Year (2016 - 2017)
• Month on Month (2016March - 2017March)
• Week on Week

For this kind of analysis I need to pull complete data starting year 2016 till data. It will be very large data.

It’s a log which are big in size. 5 kinds of logs, each 2 Gb in size for a month.

Is there any way I can pull/aggregate historical data weekly/monthly/yearly in QVDs (so that it will not consume too much space ) in order to display in chart only?

Could you please provide me some idea how to approach this?

Thanks & Regards,

Poonam

[YoussefBelloum]

Hi,

when you need to reduce the amount of data loaded, you will need to aggregate your data in the script, so you will need to use the GROUP BY clause. (no matter the source type, QVD, EXCEL, DATABASE)

If you have measure(s) in your table, here is one example

table:

LOAD

fieldA

fieldB

fieldC

sum(measure) as measure

from...

Group by

fieldA,

fieldB,

fieldC;

==> the rule is to group by all the fields that are not in an aggregation function.

Try to give us the structure of your table and we will try to help you with the groupby you need.

[poonam_kulwal]

I tried same approach.

[YoussefBelloum]

and ?