Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Read file per file inside folder

Hi,
I just wonder how do Talend read file inside specified folder and then do extraction as usual. After finished data extraction, move that file into another folder.
The scenario is like this, I want to extract data from excel file and load into mssql. However, there are several files of excel and I put those files inside "Folder_In" folder. Also, there may be another excel files will be added into "Folder_Input" and need to be extracted.
After that excel files extracted, that file will be moved and saved into another folder "Folder_Out". Is it possible for Talend to do this?
Plz help me 0683p000009MPcz.png

Regards,
Kal
Labels (2)
24 Replies
Anonymous
Not applicable
Author

Hi,
The scenario is like this, I want to extract data from excel file and load into mssql. However, there are several files of excel and I put those files inside "Folder_In" folder. Also, there may be another excel files will be added into "Folder_Input" and need to be extracted.

We need confirm one thing. Are there two folder "Folder_In" and "Folder_Input" as the resource file or just one?
Waiting for your confirmation.
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi, ae_kel29
I have designed a demo job for your requirement.
tFilelist-->tFileInputDelimited-->tLogrow-->tMySqlOutput
|
tFileCopy
See my pics for details
Best regards
Sabrina
0683p000009MDB5.png 0683p000009MDYH.png
Anonymous
Not applicable
Author

Hi,
For any delays in response your inquiry. There are two folder with name "Folder_In" and "Folder_Out". "Folder_In" is used to stored the excel files which the data of each files will be extracted and once a file has competed extracted, that file will be moved-out and will be stored in "Folder_Out".
Is it possible i create etl job to do this situation? Plz help me 0683p000009MPcz.png

Regards,
Kal
Anonymous
Not applicable
Author

Hi,
Don't worried about that, it is possible you can create such a ETL job to meet your needs.
There are two folder with name "Folder_In" and "Folder_Out". "Folder_In" is used to stored the excel files which the data of each files will be extracted and once a file has competed extracted, that file will be moved-out and will be stored in "Folder_Out".

For your requirement, i have designed a demo job to help you.
See the related screenshots for details.
Best regards
Sabrina
0683p000009MDPQ.png 0683p000009MDYM.png 0683p000009MDYR.png
Anonymous
Not applicable
Author

Hi,
I don't understand the function of tFileInputDelimited since inside my TEST_FOLDER_IN, there are several excel file that i wants to extract. See image. How do i wants to set the setting for tFileInputDelimited?
Regards,
Kal
0683p000009MDQs.jpg
Anonymous
Not applicable
Author

Hi,
I tried to set up my job followed yours, but there's an error hit saying that no schema found. Is there any schema required to be defined on tFileInputDelimited?
Regards,
Kal
0683p000009MDXk.jpg
Anonymous
Not applicable
Author

Hi,
Sorry for the delay.
The function of component tFileInputDelimited is receiving these files in the folder. You must define schema in tFileInputDelimited so that it can get the content of file.
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
I think i found why, it is because my source files were excel files. I've changed to used tFileInput Excel and put the directory path ((String)global... just like you and it successfully extract the files 0683p000009MACn.png
But just wonder about little issue that currently i'm trying to figure it out. I'll come back to you later 0683p000009MACn.png
Regards,
Kal
Anonymous
Not applicable
Author

Hi,
OK, feel free to post your issue on forum. You are always welcome!
Best regards
Sabrina