topic reading a csv.gz file in Talend Studio

reading a csv.gz file

sushantk19 — Fri, 15 Nov 2024 23:45:19 GMT

Hello All,

I want to read a csv.gz file kept in shared location on my network. How can we do that ? does talend have any components to extract this data? my target database is amazon redshift.

Re: reading a csv.gz file

Anonymous — Fri, 10 Sep 2021 03:05:51 GMT

Hello,

Could you please let us know it is a local shared folder where all the files are stored or any http or FTP location?

Best regards

Sabrina

Re: reading a csv.gz file

sushantk19 — Fri, 10 Sep 2021 08:32:56 GMT

Its a local shared folder.

Re: reading a csv.gz file

Anonymous — Fri, 10 Sep 2021 09:19:36 GMT

Hello,

If you want to execute commands wherever the job is running, use tSystem component

If you want to execute a remote (from perspective of the job) command, you can use tSSH to execute commands in a remote server , via the ssh protocol.

Best regards

Sabrina

Re: reading a csv.gz file

sushantk19 — Mon, 13 Sep 2021 10:19:52 GMT

hello @xdshi: i read your post at the below link:

https://community.talend.com/s/feed/0D73p000004kJPGCA2

I created a similar deisgn in my talend studio:

tFilelist--->tFileUnarchive.

I kept all my Zipped files in .gz format the /samba/data/Talend/Archive location

I want to extract them to :

/samba/data/Talend/Output_Adjust_Files location

I get the below error:

/samba/data/Talend/Archive/*.gz (No such file or directory)

What could be the issue? i have uploaded the tUnarchive component screenshot for your ref.

Re: reading a csv.gz file

sushantk19 — Mon, 13 Sep 2021 10:20:10 GMT

Re: reading a csv.gz file

Anonymous — Tue, 14 Sep 2021 02:54:48 GMT

Hello,

In this thread: https://community.talend.com/s/feed/0D73p000004kJPGCA2

I'm using tftpxxx component to fetch files from remote server.

The unzip procedure takes place on you local machine. So far, talend don't support for handing data by air.

If the remote directories can be mounted with smb (Windows) or NFS (UNIX) you can extract the files directly on the remote machines because it works like a local file system. On Windows you can use an UNC path to address the files.

Best regards

Sabrina

Re: reading a csv.gz file

sushantk19 — Tue, 14 Sep 2021 06:48:26 GMT

@xdshi: it is working fine now. i have my files on mounted with smb (Windows). the syntax i was using in archive directory was incorrect. after correcting it, it worked fine for me.

Re: reading a csv.gz file

Anonymous — Tue, 14 Sep 2021 09:29:26 GMT

Hello,

Great your issue is fixed and have you thought of entering our competition?

https://community.talend.com/s/blog/aGn5b000000CaZw/getting-smart-about-talend-tip-of-the-day

There are rewards for winners!

Best regards

Sabrina