Skip to main content
Announcements
Global Transformation Awards! Applications are now open. Submit Entry
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Incremental load override sorce and as well QVD, not able to concatenate

Hi,

I have a data file which is fact table data and is override daily. So, even my QVD also being override with data and not able to find my historical data in that QVD. It should concatenate old data with new data.

Give me any clue. or sample file.

Regards,

Kumar

21 Replies
Anonymous
Not applicable
Author

Anonymous
Not applicable
Author

Hi Balaraj,

Thanks for sharing valuable information.

Can u see I am doing only inserts on daily.

I know load * from table;

store table into path.

But Here if our table is overriding we don't see old data in QVD. It will hold only fresh data, i mean latest run data only.

Anonymous
Not applicable
Author

Hi,

Here I am attaching two data sample files and my script as well. First load one test data file and replace that second data file with another data file. So QVD also will be override with latest data file. But I want include all data in single QVD.

Can anyone share me idea.

settu_periasamy
Master III
Master III

Hi,

In your attached file, How did you test that? using table box?, If there is similar data, the table box will give single row only. May be you can create a flag and check..

I just load your excel files and stored it as a QVD, it seems to be fine.  You can see 6 rows in the table viewer..

Check the below screen shot.. (Let us know, if this not you are looking)

Capture.JPG

Anonymous
Not applicable
Author

Hi,

You loaded two files at a time.

What my problem is load 1st test file.

2nd time remove that file and again reload that one. And see QVD data. We will have only latest data only.

settu_periasamy
Master III
Master III

Hi,

For Increment Load, You first need to create the Initial Script. Then store as a qvd file.

Again, remove your Initial script, Load your recent file. and Concatenate with you qvd.

May be try the below steps for your files:

//Initial Script

T1:

Load * from ExcelSource; 

Store T1 into T1.qvd(qvd);

//Remove  / Comment the above script after Load your T1 qvd stored

//Keep the Below One

T1:

Load * From QVDSource;

Concatenate(T1)

Load * From ExcelSource;  //Recent File

Store T1 into T1.qvd(qvd);  //This will overwrite your existing table with new records..

varshavig12
Specialist
Specialist

I am using personal edition, so i cannot open your script.

What all i understood from your explanation is loading one file and then the second one.

Anonymous
Not applicable
Author

Thanks for your reply. For this I have to maintain two scripts

1. initial script

2. loading qvd from initial script and again loading latest source file.

I should not run two times, but I want everything in one script.

settu_periasamy
Master III
Master III

This is not two time process.. At the very first time, you need to create the Qvd file (this is the base)

Then you just concatenate your New records into your existing Qvd. That's it..

Check the Attachment..