Not all records loaded during reload.

kris_vliegen · ‎2026-09-04

Hi All,

I've noticed that after the reload of today that a lot of records are not loaded in the dashboard.

The selection is the same as the previous days and also the file was available.

This is a part of the log of Yesterday.

I load 2 files in the table.

In the first file are 33,598,635 records.

The second file 56,329,459 - 33,598,635 = 22,730,824 records.

33,598,635 lines fetched
20260903T112456.545+0200 1230 next
20260903T112456.546+0200 1180 let vFile = 'TRX_H_' & 2026 & '.QVD'
20260903T112456.550+0200 1181 concatenate
20260903T112456.550+0200 1182 TRX_H:
20260903T112456.550+0200 1183 LOAD
20260903T112456.550+0200 1184 AutoNumber(TRX_H_TYPE & TRX_H_DTME & TRX_H_DTMJ & TRX_H_DTMM & TRX_H_DTMD & TRX_H_UURT & TRX_H_STNR & TRX_H_REF & TRX_H_SEQ,'Key_TRXD') as Key_TRXD,
20260903T112456.550+0200 1185 AutoNumber(TRX_H_TYPE & TRX_H_DTME & TRX_H_DTMJ & TRX_H_DTMM & TRX_H_DTMD & TRX_H_UURT & TRX_H_STNR & TRX_H_REF & TRX_H_SEQ,'Key_TRXF') as Key_TRXF,
20260903T112456.550+0200 1186
20260903T112456.550+0200 1187
20260903T112456.550+0200 1188
20260903T112456.550+0200 1189
20260903T112456.550+0200 1190
20260903T112456.550+0200 1191 num(makedate(TRX_H_DTME & num(TRX_H_DTMJ,'00'),TRX_H_DTMM,TRX_H_DTMD)) as Datumtransactie,
20260903T112456.550+0200 1192
20260903T112456.550+0200 1193 if(0 = 1,
20260903T112456.550+0200 1194 Applymap('PBY_Map',num(TRX_H_STNR,'00000') & Left(num(TRX_H_REF,'0000000000'),4),num(Today())),
20260903T112456.550+0200 1195 num(makedate(TRX_H_DTME & num(TRX_H_DTMJ,'00') ,TRX_H_DTMM , TRX_H_DTMD))) as DatumNum,
20260903T112456.550+0200 1196
20260903T112456.550+0200 1197
20260903T112456.550+0200 1198 Left(num(TRX_H_UURT,'000000'),2) & ':' & Mid(num(TRX_H_UURT,'000000'),3,2) as Uur_Getankt,
20260903T112456.550+0200 1199
20260903T112456.550+0200 1200 Left(num(TRX_H_UURT,'000000'),2) as Uur,
20260903T112456.550+0200 1201 Left(num(TRX_H_UURT,'000000'),2) & ':' & mid(num(TRX_H_UURT,'000000'),3,2) & ':' & left(num(TRX_H_UURT,'000000'),2) as UurSec,
20260903T112456.550+0200 1202 num(TRX_H_STNR,'00000') as Stationnummer,
20260903T112456.550+0200 1203
20260903T112456.550+0200 1204
20260903T112456.550+0200 1205
20260903T112456.550+0200 1206 if(TRX_H_SHF=0, 'Terminal', TRX_H_SHF) as Shift_Id,
20260903T112456.550+0200 1207 TRX_H_STNR & '-' & if(len(trim(TRX_H_OPID)) = 0 or TRX_H_OPID = ' ' ,'Terminal', trim(TRX_H_OPID)) as Operator_Id,
20260903T112456.550+0200 1208 if(len(trim(TRX_H_OPID)) = 0 or TRX_H_OPID = ' ' ,'Terminal', 'Shop') as Terminal_Shop,
20260903T112456.550+0200 1209
20260903T112456.550+0200 1210
20260903T112456.550+0200 1211
20260903T112456.550+0200 1212
20260903T112456.550+0200 1213 TRX_H_CUST as KeyCust,
20260903T112456.550+0200 1214 if(len(trim(TRX_H_ID)) > 0,TRX_H_ID, TRX_H_PAN) as Firmakaart,
20260903T112456.550+0200 1215 'KL' & num(TRX_H_CUST,'00000') as Klant_Lev_Nummer,
20260903T112456.550+0200 1216 applymap('KLANT_MAP', 'KL' & num(TRX_H_CUST,'00000'),'UNKNOWN') as Klant_Naamtest,
20260903T112456.550+0200 1217 TRX_H_PAN,
20260903T112456.550+0200 1218
20260903T112456.550+0200 1219 TRX_H_ODO as Km_Stand,
20260903T112456.550+0200 1220
20260903T112456.550+0200 1221 TRX_H_CARR as Plaatnummer,
20260903T112456.550+0200 1222 TRX_H_TTNA as TRXHTotal
20260903T112456.550+0200 1223 FROM
20260903T112456.550+0200 1224 [..\03_QVD\TRX_H_2026.QVD]
20260903T112456.550+0200 1225 (qvd)
20260903T112456.550+0200 1226 where num(makedate(TRX_H_DTME & num(TRX_H_DTMJ,'00'), TRX_H_DTMM,TRX_H_DTMD)) >= 45658 and len(trim(TRX_H_STNR)) > 0 and TRX_H_STNR <= '1000'
20260903T112456.555+0200 19 fields found: Key_TRXD, Key_TRXF, Datumtransactie, DatumNum, Uur_Getankt, Uur, UurSec, Stationnummer, Shift_Id, Operator_Id, Terminal_Shop, KeyCust, Firmakaart, Klant_Lev_Nummer, Klant_Naamtest, TRX_H_PAN, Km_Stand, Plaatnummer, TRXHTotal,
20260903T114353.975+0200 56,329,459 lines fetched

This is the a part of the log of the reload of today.

Also in the first file I have less records then the day before (it should be more)

And in the second file I have almost no records loaded.

30,883,385 lines fetched
20260904T062431.542+0200 1230 next
20260904T062431.559+0200 1180 let vFile = 'TRX_H_' & 2026 & '.QVD'
20260904T062431.590+0200 1181 concatenate
20260904T062431.590+0200 1182 TRX_H:
20260904T062431.590+0200 1183 LOAD
20260904T062431.590+0200 1184 AutoNumber(TRX_H_TYPE & TRX_H_DTME & TRX_H_DTMJ & TRX_H_DTMM & TRX_H_DTMD & TRX_H_UURT & TRX_H_STNR & TRX_H_REF & TRX_H_SEQ,'Key_TRXD') as Key_TRXD,
20260904T062431.590+0200 1185 AutoNumber(TRX_H_TYPE & TRX_H_DTME & TRX_H_DTMJ & TRX_H_DTMM & TRX_H_DTMD & TRX_H_UURT & TRX_H_STNR & TRX_H_REF & TRX_H_SEQ,'Key_TRXF') as Key_TRXF,
20260904T062431.590+0200 1186
20260904T062431.590+0200 1187
20260904T062431.590+0200 1188
20260904T062431.590+0200 1189
20260904T062431.590+0200 1190
20260904T062431.590+0200 1191 num(makedate(TRX_H_DTME & num(TRX_H_DTMJ,'00'),TRX_H_DTMM,TRX_H_DTMD)) as Datumtransactie,
20260904T062431.590+0200 1192
20260904T062431.590+0200 1193 if(0 = 1,
20260904T062431.590+0200 1194 Applymap('PBY_Map',num(TRX_H_STNR,'00000') & Left(num(TRX_H_REF,'0000000000'),4),num(Today())),
20260904T062431.590+0200 1195 num(makedate(TRX_H_DTME & num(TRX_H_DTMJ,'00') ,TRX_H_DTMM , TRX_H_DTMD))) as DatumNum,
20260904T062431.591+0200 1196
20260904T062431.591+0200 1197
20260904T062431.591+0200 1198 Left(num(TRX_H_UURT,'000000'),2) & ':' & Mid(num(TRX_H_UURT,'000000'),3,2) as Uur_Getankt,
20260904T062431.591+0200 1199
20260904T062431.591+0200 1200 Left(num(TRX_H_UURT,'000000'),2) as Uur,
20260904T062431.591+0200 1201 Left(num(TRX_H_UURT,'000000'),2) & ':' & mid(num(TRX_H_UURT,'000000'),3,2) & ':' & left(num(TRX_H_UURT,'000000'),2) as UurSec,
20260904T062431.591+0200 1202 num(TRX_H_STNR,'00000') as Stationnummer,
20260904T062431.591+0200 1203
20260904T062431.591+0200 1204
20260904T062431.591+0200 1205
20260904T062431.591+0200 1206 if(TRX_H_SHF=0, 'Terminal', TRX_H_SHF) as Shift_Id,
20260904T062431.591+0200 1207 TRX_H_STNR & '-' & if(len(trim(TRX_H_OPID)) = 0 or TRX_H_OPID = ' ' ,'Terminal', trim(TRX_H_OPID)) as Operator_Id,
20260904T062431.591+0200 1208 if(len(trim(TRX_H_OPID)) = 0 or TRX_H_OPID = ' ' ,'Terminal', 'Shop') as Terminal_Shop,
20260904T062431.591+0200 1209
20260904T062431.591+0200 1210
20260904T062431.591+0200 1211
20260904T062431.591+0200 1212
20260904T062431.591+0200 1213 TRX_H_CUST as KeyCust,
20260904T062431.591+0200 1214 if(len(trim(TRX_H_ID)) > 0,TRX_H_ID, TRX_H_PAN) as Firmakaart,
20260904T062431.591+0200 1215 'KL' & num(TRX_H_CUST,'00000') as Klant_Lev_Nummer,
20260904T062431.591+0200 1216 applymap('KLANT_MAP', 'KL' & num(TRX_H_CUST,'00000'),'UNKNOWN') as Klant_Naamtest,
20260904T062431.591+0200 1217 TRX_H_PAN,
20260904T062431.591+0200 1218
20260904T062431.591+0200 1219 TRX_H_ODO as Km_Stand,
20260904T062431.591+0200 1220
20260904T062431.591+0200 1221 TRX_H_CARR as Plaatnummer,
20260904T062431.591+0200 1222 TRX_H_TTNA as TRXHTotal
20260904T062431.591+0200 1223 FROM
20260904T062431.591+0200 1224 [..\03_QVD\TRX_H_2026.QVD]
20260904T062431.591+0200 1225 (qvd)
20260904T062431.591+0200 1226 where num(makedate(TRX_H_DTME & num(TRX_H_DTMJ,'00'), TRX_H_DTMM,TRX_H_DTMD)) >= 45658 and len(trim(TRX_H_STNR)) > 0 and TRX_H_STNR <= '1000'
20260904T062431.629+0200 19 fields found: Key_TRXD, Key_TRXF, Datumtransactie, DatumNum, Uur_Getankt, Uur, UurSec, Stationnummer, Shift_Id, Operator_Id, Terminal_Shop, KeyCust, Firmakaart, Klant_Lev_Nummer, Klant_Naamtest, TRX_H_PAN, Km_Stand, Plaatnummer, TRXHTotal,
20260904T062456.643+0200 31,170,105 lines fetched

Who has an idea why he is not loading all data?

The data is the transaction header out of a shop. So every day there should be more records.

If I doe now a reload of the trx_h_2026 with the same selections in my desktop, this is the result.

Who can help me with this?

Chanty4u · ‎2026-09-04

Hi try this

1.45658 is a hard-coded Qlik date number.

Convert it to a date with Date(45658) and verify that it is the date you actually intend

.2.

Check TRX_H_STNR <= '1000'.

This is potentially problematic because TRX_H_STNR may be interpreted as text. For example, text comparison can produce unexpected results. Try:

and Num(TRX_H_STNR) <= 1000

3.Test each WHERE condition separately. This is the fastest way to identify what is filtering the records:

LOAD Count(*) as Records

FROM [..\03_QVD\TRX_H_2026.QVD] (qvd);

Then test:

WHERE len(trim(TRX_H_STNR)) > 0;

Then add:

AND Num(TRX_H_STNR) <= 1000;

4.TRX_H_STNR <= '1000' and the date expression. Change the station filter to Num(TRX_H_STNR) <= 1000 and validate the date calculation separately.

kris_vliegen · ‎2026-09-07

Hi,

thanks for your reply.

But I didn't change the script and 1 day it was going good and the next day he didn't read all records.

With the same script...

So I don't think the script can't be the issue.

marcus_sommer

The script might be not the cause for the unexpected amounts of records - else the data itself. For example if the sources have already a lesser number of records or the data-quality is different.

A quite simple check would be to comment the where-clause and transferring these conditions into the script as extra true/false flag-fields as well as adding further context, for example recno(), rowno(), filebasename() which enables a granular tracking to which data are really there and if they have the expected content/quality.

QlikView App Dev

Scripting