Source Table ----->tMap-------->Destination Table
I want to skip first few rows from source table to be processes. How can i do it?
PS: This job runs several times with new data added to source Table. I don't want the Data which were already loaded to Destination to be loaded again.
Thanks!
Each file is of approx 1mb. (Containing 3k-4k rows and around 60 columns)
there may be 1000s of files coming in.
Also, I do not have any such combination which leads to unique key formation. I am thinking of inserting a column as index and then make it work.
Hi Vaibhav,
I have inserted a timestamp as unique key. Is there any way other than A-B using which i can achieve the task? As it consumes a lot of extra memory.
