Skip to main content
Announcements
Qlik Connect 2025: 3 days of full immersion in data, analytics, and AI. May 13-15 | Orlando, FL: Learn More
cancel
Showing results for 
Search instead for 
Did you mean: 
riishabhz
Creator
Creator

incremental load on txt file without date field.

hello everyone

12.PNG

my txt file looks like this and link is here as they are not allowing me to attach txt file.

https://drive.google.com/file/d/1DlQW8Sc4h0JRmLu5diIgsV8b4lH1dhIr/view?usp=sharing

use delimater as this | pipe sign  

please help me to do incremental and update the records on the basis of ean which is the column after MGRP4DESC column.

please help me i am in need.

i searched everywhere but didnt got solution.

 

1 Solution

Accepted Solutions
rwunderlich
Partner Ambassador/MVP
Partner Ambassador/MVP

master:
LOAD
*,
RecNo() as RecId
FROM
[..\material master and customer master txt\MAT_MAS_20190731_131746.txt]
(txt, codepage is 1252, embedded labels, delimiter is '|', msq) ;

Inner Join(master)
LOAD EAN, Max(RecId) as RecId
Resident master
Group by EAN
;
DROP FIELD RecId;

 

-Rob
http://masterssummit.com
http://qlikviewcookbook.com
http://www.easyqlik.com

View solution in original post

20 Replies
dplr-rn
Partner - Master III
Partner - Master III

 For incremental load you need to have at least one of below

1) Last updated date or any date field

2) Sequential ID

If EAN is a sequential one you can use that.

Why do you need to use incremental load here? Can you describe the scenario a bit

dplr-rn
Partner - Master III
Partner - Master III

correction to above. I saw you want to do update as well. for insert and update you need a date field.

As i said describe scenario a bit more

 

riishabhz
Creator
Creator
Author

sir its a master table and everyday its updated like if today certain item has mrp of 500rs then tomorrow it can be changed to 700rs so i have to update that value.

moreover every day a new master is created .

dplr-rn
Partner - Master III
Partner - Master III

Does the new master file hold all the records? Or just new and updated ones?

 

 

riishabhz
Creator
Creator
Author

new records and updated records.

like todays  master will have certain mrp like 500 and after 2 days that master will be updated to another price and so on

dplr-rn
Partner - Master III
Partner - Master III

Few questions

1-does it contain only new and updated records? 

2-How long does reload take?

riishabhz
Creator
Creator
Author

yes it contain new record daily , sometimes price is also updated.

master file is small in size like 10-12mb so it wont take long to load the data.

 

dplr-rn
Partner - Master III
Partner - Master III

So the file will contain only  new and updated records . 

if so the question for you is do you have a unique id for a row. if you have you can easily do the incremental load . follow instructions from below link from insert update section

https://www.analyticsvidhya.com/blog/2014/09/qlikview-incremental-load/

 

if the row doesnt have an 'ID' you will need to create a unique identifier in someway using hash key or something

 

riishabhz
Creator
Creator
Author

Sir i AM new to qlikview please help me, i have also attached link of
Google drive where you can find the data, please look at it.