Solved: incremental load on txt file without date field. - Qlik Community

riishabhz · ‎2019-08-22

hello everyone

my txt file looks like this and link is here as they are not allowing me to attach txt file.

https://drive.google.com/file/d/1DlQW8Sc4h0JRmLu5diIgsV8b4lH1dhIr/view?usp=sharing

use delimater as this | pipe sign

please help me to do incremental and update the records on the basis of ean which is the column after MGRP4DESC column.

please help me i am in need.

i searched everywhere but didnt got solution.

rwunderlich · ‎2019-08-29

master:
LOAD
*,
RecNo() as RecId
FROM
[..\material master and customer master txt\MAT_MAS_20190731_131746.txt]
(txt, codepage is 1252, embedded labels, delimiter is '|', msq) ;

Inner Join(master)
LOAD EAN, Max(RecId) as RecId
Resident master
Group by EAN
;
DROP FIELD RecId;

-Rob
http://masterssummit.com
http://qlikviewcookbook.com
http://www.easyqlik.com

View solution in original post

dplr-rn · ‎2019-08-22

For incremental load you need to have at least one of below

1) Last updated date or any date field

2) Sequential ID

If EAN is a sequential one you can use that.

Why do you need to use incremental load here? Can you describe the scenario a bit

dplr-rn · ‎2019-08-22

correction to above. I saw you want to do update as well. for insert and update you need a date field.

As i said describe scenario a bit more

riishabhz · ‎2019-08-23

sir its a master table and everyday its updated like if today certain item has mrp of 500rs then tomorrow it can be changed to 700rs so i have to update that value.

moreover every day a new master is created .

dplr-rn · ‎2019-08-23

Does the new master file hold all the records? Or just new and updated ones?

riishabhz · ‎2019-08-27

new records and updated records.

like todays master will have certain mrp like 500 and after 2 days that master will be updated to another price and so on

dplr-rn · ‎2019-08-27

Few questions

1-does it contain only new and updated records?

2-How long does reload take?

riishabhz · ‎2019-08-27

yes it contain new record daily , sometimes price is also updated.

master file is small in size like 10-12mb so it wont take long to load the data.

dplr-rn · ‎2019-08-27

So the file will contain only new and updated records .

if so the question for you is do you have a unique id for a row. if you have you can easily do the incremental load . follow instructions from below link from insert update section

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

if the row doesnt have an 'ID' you will need to create a unique identifier in someway using hash key or something

riishabhz · ‎2019-08-27

Sir i AM new to qlikview please help me, i have also attached link of
Google drive where you can find the data, please look at it.