topic Re: Load file content and filename into database in Talend Studio

Load file content and filename into database

Anonymous — Sat, 16 Nov 2024 11:13:00 GMT

I am currently trying to use talend to load all text files contained in a directory into an Oracle database.
I want to load the complete content of each of these files into one field, therefor tFileInputRaw seems best suited for me.
Additionally I need to load the source file name into a second column. Can anybody help me on how to achieve this?
The destination table was created with following query:

CREATE TABLE message_table (message CLOB, filename VARCHAR(256));

Thanks a lot!

Re: Load file content and filename into database

Anonymous — Tue, 19 May 2015 13:08:24 GMT

Hi
Take a look at this KB article, it shows how to iterate all files in a directory and insert them into database.
Best regards
Shong

Re: Load file content and filename into database

Anonymous — Tue, 19 May 2015 13:49:55 GMT

Thank you.
The second part of my question is, how do I load the filename together with every filecontent into the database?

Re: Load file content and filename into database

Anonymous — Tue, 19 May 2015 13:59:39 GMT

tFileList declares a global variable that stores the current file name, for example:

((String)globalMap.get("tFileList_1_CURRENT_FILE"))

You can get the current file name using this variable, so, add a new column and set its expression with this variable.
Shong

Re: Load file content and filename into database

Anonymous — Tue, 19 May 2015 16:14:17 GMT

hi alrond, if all your raw files have similar columns then u could finish yor Job like this:

after, doing the above steps dump all this values into thashouput and do the post job as per the below job design:

output will be :

Re: Load file content and filename into database

_AnonymousUser — Thu, 28 May 2015 00:26:20 GMT

thank you Talend team!
the article is about inserting a blob in the database, but how to download a blob from db to a specified filepath?
thanks and regards!

Re: Load file content and filename into database

_AnonymousUser — Thu, 28 May 2015 00:39:46 GMT

nevermind partners!
I found it in ""

Re: Load file content and filename into database

_AnonymousUser — Wed, 24 Aug 2016 12:24:03 GMT

Thank you so much for posting this.
A question if I may and I apologize if my post is bumping an old thread, but this is really a agood place to finish what I am trying to do.
The files I am trying to joinn are named in a pattern xxx_yyyy_zzzz and sometimes xxxx_yyyy_zzzz.
All I want to do is except of having the full name is adding the xxx or xxxx before the first underscore. I am aware that all I have to do is change the expression. But I am such a novice and I really apreciate any help.
Thank you.

Re: Load file content and filename into database

Anonymous — Thu, 25 Aug 2016 10:21:28 GMT

Thank you so much for posting this.
A question if I may and I apologize if my post is bumping an old thread, but this is really a a good place to finish what I am trying to do.
The files I am trying to joinn are named in a pattern xxx_yyyy_zzzz and sometimes xxxx_yyyy_zzzz.
All I want to do is except of having the full name is adding the xxx or xxxx before the first underscore. I am aware that all I have to do is change the expression. But I am such a novice and I really appreciate any help.
Thank you.

Hi
Can you please describe your requirement with more details in a new topic? I don't understand what you want to do...
Regards
Shong

Re: Load file content and filename into database

Anonymous — Thu, 11 Oct 2018 10:50:05 GMT

the link to the article is not working, can you please correct this?