Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Discover how organizations are unlocking new revenue streams: Watch here
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Read file per file inside folder

Hi,
I just wonder how do Talend read file inside specified folder and then do extraction as usual. After finished data extraction, move that file into another folder.
The scenario is like this, I want to extract data from excel file and load into mssql. However, there are several files of excel and I put those files inside "Folder_In" folder. Also, there may be another excel files will be added into "Folder_Input" and need to be extracted.
After that excel files extracted, that file will be moved and saved into another folder "Folder_Out". Is it possible for Talend to do this?
Plz help me 0683p000009MPcz.png

Regards,
Kal
Labels (2)
24 Replies
Anonymous
Not applicable
Author

Hi,
I just wonder, i have 2 files with same format inside a folder which refer to year 2006 and 2009 and i wants to extract these files automatically by using tFileList. I was successfully extracted the data each year with respective values but the year was replicate to 2006 even though the values are for year 2009.
Regards,
Kal
Anonymous
Not applicable
Author

Hi,
I just wonder, i have 2 files with same format inside a folder which refer to year 2006 and 2009 and i wants to extract these files automatically by using tFileList. I was successfully extracted the data each year with respective values but the year was replicate to 2006 even though the values are for year 2009.

I don't understand your requirement very well. Could you set a example for your source file format? and your expect file format? Thanks a lot.
Best regards
Sabrina
Anonymous
Not applicable
Author

I'm sorry for any difficulties. Hope you can understand my requirement by the following example. I have 2 excel files that contain table id, year, and values.
1st Excel
--------------
Table10|2009|11
Table10|2009|12
Table10|2009|13
2nd Excel
--------------
Table10|2009|22
Table10|2009|21
Table10|2009|20

Expected Result
--------------
Table10|2009|11
Table10|2009|12
Table10|2009|13
Table11|2006|22
Table11|2006|21
Table11|2006|20
But, after execute the job, i got the output as:
Current Result
--------------
Table11|2006|11
Table11|2006|12
Table11|2006|13
Table11|2006|22
Table11|2006|21
Table11|2006|20
You can see the table id and year was repeated. The files are the same format and structure and the only different is the value of each years. Hope you can understand the requirement.
Regards,
Kal
Anonymous
Not applicable
Author

Hi,
I have got your requirement clearly and need take a testing for your case, and then give you the response asap.
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
Thanks Sabrina for your concern. Btw, there's a little correction. Here is the correct info and I'm sorry for any mistype.
1st Excel
--------------
Table10|2009|11
Table10|2009|12
Table10|2009|13
2nd Excel
--------------
Table11|2006|22
Table11|2006|21
Table11|2006|20

Expected Result
--------------
Table10|2009|11
Table10|2009|12
Table10|2009|13
Table11|2006|22
Table11|2006|21
Table11|2006|20

Current Result
--------------
Table11|2006|11
Table11|2006|12
Table11|2006|13
Table11|2006|22
Table11|2006|21
Table11|2006|20

Regards,
Kal
Anonymous
Not applicable
Author

Hi ae_kel29,
I have designed a demo job for your issue. The work flow is tFileList-->tFileInputEXCEL-->tLogRow and the job works well.
See my following screenshots

Best regards
Sabrina
0683p000009MDYW.png 0683p000009MDQQ.png 0683p000009MDYb.png
Anonymous
Not applicable
Author

Hi,
Thanks Sabrina for your findings. Let me check my ETL job and will come back to you soon.

Regards,
Kal
Anonymous
Not applicable
Author

Hi ae_kel29,
Any new update for your issue?
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi Sabrina,
Thanks for your concern. I still try to amend my ETL job. Perhaps the way i built the job make the data mismatched. I'll come back to you later for any update.
Rgds,
Kal
Anonymous
Not applicable
Author

Hi,
I have 2 files and i used tFileList to extract both files and some components to get the expected output but i got little issue since there's missing value after execute the job. See below example:
File 1
--------
AAAA 2006
aaaa 2006
File 2
--------
BBBB 2009
bbbb 2009

Expected Output
-------------------
AAAA 2006 | aaaa 2006 | 2006
BBBB 2009 | bbbb 2009 | 2009

Current Output
-----------------
AAAA 2006 | null | 2006
BBBB 2009 | bbbb 2009 | 2009

Plz help me 0683p000009MPcz.png
Rgds,
Kal