Skip to main content
Announcements
See what Drew Clarke has to say about the Qlik Talend Cloud launch! READ THE BLOG
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Difference in two simple ways of data loading (from qvd and excel)

Hello!

Problem:

I've got an excel file that I stored into QVD and I load some fields from there in the script attached below.

There are two ways of data loading with the difference only in 2 and 5 rows: loading from the qvd and from the excel.

The problem is I get different results.

When I try to count of "Ins" and "Outs" the first way give that count of "In" = count of "Out" (It doesn't correct), but the second one give a difference. How can I get the difference in calculation of count using loading from qvd?  What's the difference in these ways?!

First way:

  1. DataTemp:
  2. Load 'In' as DataType, Field_1, Field_2, etc... from Data.QVD;
  3. Concatenate(DataTemp)
  4. Load 'Out' as DataType, Field_1, Field_2, etc... from Data.QVD;

  5. NoConcatenate
  6. DataTemp2:
  7. Load
  8. DataType, Field_1, Min (Field_2) as In
  9. Resident DataTemp where DataType='In' Group by ...

  10. Concatenate(DataTemp2)
  11. Load
  12. DataType, Field_1, Max (Field_2) as Out
  13. Resident DataTemp where DataType='Out'  Group by ...
  14. Drop table DataTemp;

Second way:

  1. DataTemp:
  2. Load 'In' as DataType, Field_1, Field_2, etc... from Data.xlsx;
  3. Concatenate(DataTemp)
  4. Load 'Out' as DataType, Field_1, Field_2, etc... from Data.xlsx;
  5. NoConcatenate
  6. DataTemp2:
  7. Load

... (the same script)

Best wishes,

Evgeniy

1 Solution

Accepted Solutions
m_woolf
Master II
Master II

Why don't you load all the data from the QVD and then do a send to Excel. You can compare that Excel with the other Excel to look for differences.

Can you share your data?

View solution in original post

4 Replies
m_woolf
Master II
Master II

I don't see any difference in your load script, so I presume that the QVD contents differ from the Excel workbook.

Anonymous
Not applicable
Author

But the QVD file is based on the same excel file that I use on my way.

My steps:

1. Load <All Fields> from Data.xlsx

2. Store loaded data into Data.qvd

3. Load <some fields> from Data.qvd

4. Concatenate load <some fields> from Data.qvd

etc. (script was described earlier)

But when I load directly from the Data.xlsx I get another result. Why?

m_woolf
Master II
Master II

Why don't you load all the data from the QVD and then do a send to Excel. You can compare that Excel with the other Excel to look for differences.

Can you share your data?

Anonymous
Not applicable
Author

It was a really helpful advice! I checked qvd(s) and Excel data on a small part of the data and I found that a condition are missed.

I just needed to talk to an expert. Thanks a million!