topic Re: SFTP file to DB loading all NULLs on cloud in Talend Studio

SFTP file to DB loading all NULLs on cloud

RFAM1 — Fri, 15 Nov 2024 23:40:23 GMT

I am working on a job which connects to ftp server, gets the file, decrypts and loads to a table.

The same file when copied to my local worked fine. But when I migrated the job to cloud and ran on different environment, it loads all NULLs in the table.

I checked both target tables for data types and it is exactly same.

In the logs I don't see anything related to tGPGDecrypt component.

Re: SFTP file to DB loading all NULLs on cloud

Anonymous — Thu, 30 Sep 2021 02:32:13 GMT

What is your run time engine when the job is running on cloud? Is it Talend Cloud or remote engine? If the former, I think the component can't find a local file path on tFTPGet component.

Regards

Shong

Re: SFTP file to DB loading all NULLs on cloud

RFAM1 — Thu, 30 Sep 2021 14:05:55 GMT

I am running on remote engine. I see the ftp connection is established, getfile returned 1 row(loading only 1 file). But in decrypt component i am saving the file as decrypt.csv. So the next component which is tfileinputdelimited is failing with error that decrypt.csv file not found

Re: SFTP file to DB loading all NULLs on cloud

RFAM1 — Thu, 30 Sep 2021 16:19:46 GMT

How do I make sure that the tGPGDecrypt is working fine in remote engine?

I set the log level to info on TMC but still dont see much details. I am thinking it is not able to decrypt the file on the server. But not displaying any error or warning

Re: SFTP file to DB loading all NULLs on cloud

gjeremy1617088143 — Fri, 01 Oct 2021 07:40:46 GMT

Hi @Rekha Padala , as far as is see , it seems you use the tFileList_1 current file globalMap for both your tGPGDecrypt and tFileInputDelimited, but i think you want to use tFileinputDelimited to read the decryptedFile ? So in your tFileInputDelimited use "decrypted.csv" instead of current file global variable.

Send me love and kudos