We are facing big problem in my project deployment. I've developed two qvw files one is for initial load and another for incremental load. I'm facing problem for incremental load. According to my code the incremental process is taking 7-8 hours. So we optimize the code which we devleoped and now it is taking only 30mins but it is not giving updated data. I think the concatenate process is giving problem.
Here i'm attaching my qvw files along initial load file.
1_IncrementalLoad.qvw -> 7-8 hours
2_IncrementalLoad.qvw ->30mins
I've huge amount of data in text files.
Can anyone please help me how to overcome all this problems.