topic Re: Dynamic SUMIFS in set analysis in QlikView

Dynamic SUMIFS in set analysis

h_demarco — Thu, 11 Aug 2016 14:05:15 GMT

Hi all,

I have a table that contains production and stops data of a machine:

Type_ap	DATE_TIME_START	DATE_TIME_END	TIME_ELAPSED	NET_TIME_ELAPSED
Production	06/07/2016 05:20	06/07/2016 10:57	5,6333333	5,633333334
Production	06/07/2016 10:58	06/07/2016 12:58	2,0166667	2,016666667
Production	06/07/2016 12:59	06/07/2016 13:39	0,6833333	0,683333333
Production	06/07/2016 13:40	06/07/2016 17:00	3,35	3,35
Production	06/07/2016 17:01	06/07/2016 21:59	4,9833333	2,983333334
Stop	06/07/2016 17:01	06/07/2016 17:48	0,8
Stop	06/07/2016 18:00	06/07/2016 18:20	0,35
Stop	06/07/2016 20:00	06/07/2016 20:50	0,85
Production	06/07/2016 22:00	07/07/2016 05:19	7,3333333	6,61666666
Stop	07/07/2016 01:00	07/07/2016 01:42	0,7166667

In Excel I am calculating using SUMIFS (example regarding first row)

=D2-SUMIFS($D$2:$D$11;$A$2:$A$11;"Stop";$B$2:$B$11;">="&B2;$C$2:$C$11;"<="&C2)

Which means that for each row I am subtracting STOP TIME_ELAPSED from PRODUCTION TIME_ELAPSED, but only if STOP START TIME is greater or equal than PRODUCTION START TIME and if STOP END TIME is lower or equal than PRODUCTION END TIME.

Stop time must be between production time to be subtracted and generated NET_TIME_ELAPSED.

Any suggestion on how to create NET_TIME_ELAPSED in Qlikview using Set Analysis?

Thanks

NET_TIME_ELAPSED was wrong. Instead of 4,9833333 should be 2,983333334 and instead of 7,3333333 should be 6,61666666

Re: Dynamic SUMIFS in set analysis

Gysbert_Wassenaar — Fri, 12 Aug 2016 08:01:54 GMT

Production 06/07/2016 17:01 06/07/2016 21:59 4,9833333 4,983333334

Stop 06/07/2016 17:01 06/07/2016 17:48 0,8

How can one machine do both Production and Stop during the same time?

Re: Dynamic SUMIFS in set analysis

Anonymous — Fri, 12 Aug 2016 09:14:41 GMT

Hi ,

try this , But you have look in to your Date formats ..

SUM( {<Type_ap={"stop"},DATE_TIME_START={">=$(=max(DATE_TIME_START))"},

DATE_TIME_END={"<=$(=max(DATE_TIME_END))">} TIME_ELAPSED)

Re: Dynamic SUMIFS in set analysis

h_demarco — Fri, 12 Aug 2016 11:40:24 GMT

I agree with you.

But considering inputs are manuals, I will not change the logic of a whole factory if I can solve it in a simple way. Otherwise factory must hire more people just to be inputting every stop and restart.

Re: Dynamic SUMIFS in set analysis

Gysbert_Wassenaar — Fri, 12 Aug 2016 14:12:40 GMT

That's fine, but I don't understand the logic. How is determined what should be subtracted from what? Unless you can give an exact algorithm for that I don't know how to create a solution.

Re: Dynamic SUMIFS in set analysis

h_demarco — Fri, 12 Aug 2016 18:19:08 GMT

I need to subtract all stopped time, that are inside a production interval.

In example, my production shift is from 9am to 5pm. This interval contains some stops that I also know begin and end. First stop from 10am to 11am due to machine maintenance. Then I have another stop from noon to 1pm for operator lunch. So my net production elapsed time is not 8 hours, but 6.

Re: Dynamic SUMIFS in set analysis

h_demarco — Fri, 12 Aug 2016 18:35:21 GMT

Did not worked. Field returned error.

My date and time formats:

SET DateFormat='DD/MM/YYYY';

SET TimestampFormat='DD/MM/YYYY hh:mm:ss[.fff]';

Re: Dynamic SUMIFS in set analysis

Anonymous — Sat, 13 Aug 2016 08:18:13 GMT

try this

SUM( {<Type_ap={"stop"},DATE_TIME_START={">=$(=date(max(DATE_TIME_START),'DD/MM/YYYY')"},

DATE_TIME_END={"<=$(=date(max(DATE_TIME_END),'DD/MM/YYYY')">} TIME_ELAPSED)

Re: Dynamic SUMIFS in set analysis

Gysbert_Wassenaar — Mon, 15 Aug 2016 16:14:18 GMT

Perhaps something like this:

Data:

LOAD

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED

FROM

source_table

WHERE

Type_ap = 'Production'

;

JOIN (DATA)

LOAD

DATE_TIME_START as Stop_DATE_TIME_START,

DATE_TIME_END as Stop_DATE_TIME_END,

TIME_ELAPSED as Stop_TIME_ELAPSED

FROM

source_table

WHERE

Type_ap = 'Stop'

;

Temp1:

LOAD

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED - Stop_TIME_ELAPSED as NET_TIME_ELAPSED

RESIDENT

Data

WHERE

Stop_DATE_TIME_START >= DATE_TIME_START

AND Stop_DATE_TIME_END <= DATE_TIME_END

;

Temp2:

LOAD

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED

FROM

source_table

WHERE

Type_ap = 'Production'

;

JOIN (Temp2)

LOAD

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED ,

NET_TIME_ELAPSED

RESIDENT

Temp1

;

Result:

LOAD

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED ,

sum(NET_TIME_ELAPSED) as NET_TIME_ELAPSED

RESIDENT

Temp2

GROUP BY

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED

;

DROP TABLES Data, Temp1, Temp2;

Re: Dynamic SUMIFS in set analysis

h_demarco — Tue, 16 Aug 2016 12:03:30 GMT

Not worked.

My guess is that error is related to DATE_TIME_* fields are timestamp, and the result should by NET_TIME_ELAPSED for each production interval, and not for a day.

When we use DATE_TIME_START={">=$(=max(DATE_TIME_START))", considering we are only summing STOP, how will QV understands that (stop) DATE_TIME_START should be >= (production) DATE_TIME_START if both fields have the same name? Probably I will have to rename fields on loading.

We are getting closer.

Re: Dynamic SUMIFS in set analysis

h_demarco — Tue, 16 Aug 2016 12:21:37 GMT

We are getting closer. Thanks for your help.

During first join I get Out-of-Memory error.

Data:

LOAD

DATE_TIME_START ,

DATE_TIME_END ,

TIME_ELAPSED

FROM

source_table

WHERE

Type_ap = 'Production'

;

JOIN (DATA)

LOAD

DATE_TIME_START as Stop_DATE_TIME_START,

DATE_TIME_END as Stop_DATE_TIME_END,

TIME_ELAPSED as Stop_TIME_ELAPSED

FROM

source_table

WHERE

Type_ap = 'Stop'

Re: Dynamic SUMIFS in set analysis

h_demarco — Thu, 25 Aug 2016 14:19:12 GMT

Back to beginning, now data is more structured:

Here is table for PRODUCTION data load:

Apontamentos:
LOAD 'Produção' As Tipo_ap,
     RECURSO, 
     DATA_HORA_INI, 
     DATA_HORA_FIM, 
     Num((DATA_HORA_FIM+Time('00:01:00')-DATA_HORA_INI)*24,'#######') As Duração,
FROM QVDs\VIEW_PCPAPPRODUCAO.qvd (qvd);

And now I need to LEFT JOIN table STOP:

LEFT JOIN (Apontamentos) 
LOAD Sum(Duração_parada)
Resident Parada
Where DATA_HORA_INI<=DATA_HORA_INI_Parada AND DATA_HORA_FIM_Parada <=DATA_HORA_FIM;

But appears error:

Field not found - <DATA_HORA_INI>
LEFT JOIN 
LOAD Sum(Duração_parada)
Resident Parada
Where DATA_HORA_INI<=DATA_HORA_INI_Parada AND DATA_HORA_FIM_Parada <=DATA_HORA_FIM

My intention is to add a column [Duração_parada] for each row in [Apontamentos], only when DATA_HORA_INI<=DATA_HORA_INI_Parada AND DATA_HORA_FIM_Parada <=DATA_HORA_FIM

Any idea on how to deal with error?

Just in case Parada table is:

Parada:
LOAD 'Parada' As Tipo_ap,
  DATA_HORA_INI As DATA_HORA_INI_Parada, 
     DATA_HORA_FIM As DATA_HORA_FIM_Parada, 
     Num((DATA_HORA_FIM+Time('00:01:00')-DATA_HORA_INI)*24,'#######') As Duração_parada
FROM QVDs\VIEW_PCPAPPARADA.qvd (qvd);