qvd size of the file is getting bigger in size when i do the incremental loading

[shree909]

HI,

I am  getting the data on daily basis . when i do incremental loading on the Date field  and store it as a qvd.

each time i reload the script muliple times on the same day the size of the qvd size is  twice the size...

what could be the isssue which is increaing the size of the qvd.

below is the script

CA_KPI_Data:

LOAD K_DATE,

     [System Name],

     K_VALUE,

     [Process Type],

     [Event Type],

     Vendor,

     Area

FROM

[..\SharedDocs\QVDs\CA_KPI_Data.qvd]

(qvd);

//====Read the Max K_DATE ..So that for next data fetch we can get the data that is greater than this max date.

CA_MAX_DATE:

load

     Date(max(K_DATE),'DD/MM/YYYY') as CA_Max_Date

Resident CA_KPI_Data;

let vMaxCA=peek('CA_Max_Date',0,'CA_MAX_DATE');

/////================================New Data From Database=====================================================================

NEW_CA_KPI_Data:

Concatenate(CA_KPI_Data)

LOAD "K_DATE",

     "KPI_TYPE"       AS [System Name],

     "K_VALUE",

     "PROCESS_TYPE"  AS [Process Type],

     "EVENT_TYPE"    AS [Event Type],

     "VENDOR"        AS Vendor,

     "AREA"          AS Area;

SQL SELECT  K_DATE,

            decode(kpi_type,'CA','Corporate Actions',KPI_TYPE)    KPI_TYPE,

            K_VALUE,

            Initcap(process_type)                                PROCESS_TYPE,

            initcap(event_type)                                  EVENT_TYPE,

            initcap(vendor)                                      VENDOR,

            initcap(area)                                        AREA

FROM  "OPA_OWNER"."KPI_CORPACTION_CA"

WHERE K_DATE >to_date('$(vMaxCA)','DD/MM/YYYY');

STORE CA_KPI_Data into  .\CA_KPI_Data.qvd(qvd);

DROP table CA_KPI_Data;

please correect me if i am wrong

Thanks

[#2]

Hi Shree ,

                Please try the below code .

First Declare the IsIncrementaload varaible in a separate Text file as //Let IsIncrementaload='Yes'

Refer that file in Qvw document using Include statement like

$(Include=VariableSetting.text);

If '$(IsIncrementaload)'='Yes' Then

CA_KPI_Data:

LOAD K_DATE,

     [System Name],

     K_VALUE,

     [Process Type],

     [Event Type],

     Vendor,

     Area

FROM

[..\SharedDocs\QVDs\CA_KPI_Data.qvd]

(qvd);

//====Read the Max K_DATE ..So that for next data fetch we can get the data that is greater than this max date.

Else

/////================================New Data From Database=====================================================================

CA_KPI_Data:

LOAD "K_DATE",

     "KPI_TYPE"       AS [System Name],

     "K_VALUE",

     "PROCESS_TYPE"  AS [Process Type],

     "EVENT_TYPE"    AS [Event Type],

     "VENDOR"        AS Vendor,

     "AREA"          AS Area;

SQL SELECT  K_DATE,

            decode(kpi_type,'CA','Corporate Actions',KPI_TYPE)    KPI_TYPE,

            K_VALUE,

            Initcap(process_type)                                PROCESS_TYPE,

            initcap(event_type)                                  EVENT_TYPE,

            initcap(vendor)                                      VENDOR,

            initcap(area)                                        AREA

FROM  "OPA_OWNER"."KPI_CORPACTION_CA"

WHERE K_DATE >to_date('$(vMaxCA)','DD/MM/YYYY');

concatenate(CA_KPI_Data)

Load * from [.\CA_KPI_Data.qvd](qvd);

End If

STORE CA_KPI_Data into  .\CA_KPI_Data.qvd(qvd);

DROP table CA_KPI_Data;

CA_MAX_DATE:

load

Date(max(K_DATE),'DD/MM/YYYY') as CA_Max_Date

Resident CA_KPI_Data;

let vMaxCA=peek('CA_Max_Date',0,'CA_MAX_DATE');

Let IsIncrementaload='No'

Hope it helps you .

Please reply me if there is anything.