Difference in two simple ways of data loading (from qvd and excel)

[Anonymous]

Hello!

Problem:

I've got an excel file that I stored into QVD and I load some fields from there in the script attached below.

There are two ways of data loading with the difference only in 2 and 5 rows: loading from the qvd and from the excel.

The problem is I get different results.

When I try to count of "Ins" and "Outs" the first way give that count of "In" = count of "Out" (It doesn't correct), but the second one give a difference. How can I get the difference in calculation of count using loading from qvd?  What's the difference in these ways?!

First way:

1. DataTemp:
2. Load 'In' as DataType, Field_1, Field_2, etc... from Data.QVD;
4. Concatenate(DataTemp)
5. Load 'Out' as DataType, Field_1, Field_2, etc... from Data.QVD;
6. 
   
7. NoConcatenate
8. DataTemp2:
9. Load
10. DataType, Field_1, Min (Field_2) as In
11. Resident DataTemp where DataType='In' Group by ...
12. 
    
13. Concatenate(DataTemp2)
14. Load
15. DataType, Field_1, Max (Field_2) as Out
16. Resident DataTemp where DataType='Out'  Group by ...
18. Drop table DataTemp;

Second way:

1. DataTemp:
2. Load 'In' as DataType, Field_1, Field_2, etc... from Data.xlsx;
4. Concatenate(DataTemp)
5. Load 'Out' as DataType, Field_1, Field_2, etc... from Data.xlsx;
7. NoConcatenate
8. DataTemp2:
9. Load

... (the same script)

Best wishes,

Evgeniy

[m_woolf]

I don't see any difference in your load script, so I presume that the QVD contents differ from the Excel workbook.

[Anonymous]

But the QVD file is based on the same excel file that I use on my way.

My steps:

1. Load <All Fields> from Data.xlsx

2. Store loaded data into Data.qvd

3. Load <some fields> from Data.qvd

4. Concatenate load <some fields> from Data.qvd

etc. (script was described earlier)

But when I load directly from the Data.xlsx I get another result. Why?

[m_woolf · Accepted solution]

Why don't you load all the data from the QVD and then do a send to Excel. You can compare that Excel with the other Excel to look for differences.

Can you share your data?

[Anonymous]

It was a really helpful advice! I checked qvd(s) and Excel data on a small part of the data and I found that a condition are missed.

I just needed to talk to an expert. Thanks a million!