Skip to main content
Announcements
A fresh, new look for the Data Integration & Quality forums and navigation! Read more about what's changed.
cancel
Showing results for 
Search instead for 
Did you mean: 
sushantk19
Creator

reading a csv.gz file

Hello All,

I want to read a csv.gz file kept in shared location on my network. How can we do that ? does talend have any components to extract this data? my target database is amazon redshift.

Labels (3)
1 Solution

Accepted Solutions
Anonymous
Not applicable

Hello,

In this thread: https://community.talend.com/s/feed/0D73p000004kJPGCA2

I'm using tftpxxx component to fetch files from remote server.

The unzip procedure takes place on you local machine. So far, talend don't support for handing data by air.

If the remote directories can be mounted with smb (Windows) or NFS (UNIX) you can extract the files directly on the remote machines because it works like a local file system. On Windows you can use an UNC path to address the files.

Best regards

Sabrina

 

View solution in original post

8 Replies
Anonymous
Not applicable

Hello,

Could you please let us know it is a local shared folder where all the files are stored or any http or FTP location?

Best regards

Sabrina

sushantk19
Creator
Author

Its a local shared folder.

Anonymous
Not applicable

Hello,

If you want to execute commands wherever the job is running, use tSystem component

If you want to execute a remote (from perspective of the job) command, you can use tSSH to execute commands in a remote server , via the ssh protocol.

Best regards

Sabrina

sushantk19
Creator
Author

hello @xdshi: i read your post at the below link:

https://community.talend.com/s/feed/0D73p000004kJPGCA2

 

I created a similar deisgn in my talend studio:

tFilelist--->tFileUnarchive.

 

I kept all my Zipped files in .gz format the /samba/data/Talend/Archive location

 

I want to extract them to :

/samba/data/Talend/Output_Adjust_Files location

 

I get the below error:

/samba/data/Talend/Archive/*.gz (No such file or directory)

/samba/data/Talend/Archive/*.gz (No such file or directory)

/samba/data/Talend/Archive/*.gz (No such file or directory)

/samba/data/Talend/Archive/*.gz (No such file or directory)

 

What could be the issue? i have uploaded the tUnarchive component screenshot for your ref.

sushantk19
Creator
Author

0695b00000IdzbcAAB.png

Anonymous
Not applicable

Hello,

In this thread: https://community.talend.com/s/feed/0D73p000004kJPGCA2

I'm using tftpxxx component to fetch files from remote server.

The unzip procedure takes place on you local machine. So far, talend don't support for handing data by air.

If the remote directories can be mounted with smb (Windows) or NFS (UNIX) you can extract the files directly on the remote machines because it works like a local file system. On Windows you can use an UNC path to address the files.

Best regards

Sabrina

 

sushantk19
Creator
Author

@xdshi: it is working fine now. i have my files on mounted with smb (Windows). the syntax i was using in archive directory was incorrect. after correcting it, it worked fine for me.

Anonymous
Not applicable

Hello,

Great your issue is fixed and have you thought of entering our competition?

https://community.talend.com/s/blog/aGn5b000000CaZw/getting-smart-about-talend-tip-of-the-day

There are rewards for winners!

 

Best regards

Sabrina