topic File delimited metadata files not being processed in Management Console in Talend Studio

File delimited metadata files not being processed in Management Console

Anonymous — Sat, 16 Nov 2024 05:05:35 GMT

Hi. I'm very new to Talend, and have just started looking at scheduling jobs to run.

I have a particular job that reads in a series of CSV files, saved as "File delimited" in the Metadata section of the repository, and creates the contents as tables in a target database.

Here's a quick example:

When run in Talend Studio, this jobs works fine. The tables get created and are populated with the data from the CSV files.

However, when I publish to the cloud and run this using the remote engine through the Management Console, the job is reported as having run successfully, but the tables are empty. So the job is not actually completing successfully at all.

Am I missing something here? Can File Delimited files be used in this way in the Management Console?

Thanks

Steve

Re: File delimited metadata files not being processed in Management Console

Anonymous — Mon, 05 Aug 2019 08:49:29 GMT

Hello,

Are your job uses the resource file when it is deployed and run in the cloud?

Best regards

Sabrina

Re: File delimited metadata files not being processed in Management Console

Anonymous — Mon, 05 Aug 2019 08:55:28 GMT

Hi Sabrina.

I have figured this one out now. I was unaware that you had to manually upload the resource files to the cloud before they can be used. I assumed when you published a job to the cloud that it uploaded all the dependencies of the job. Clearly not, and to be honest, a bit of a pain.

I have also noticed that if I upload a new version of a resource in place of an existing one in the cloud, it disassociates itself with task parameters for some reason. Have made a note to ensure I check this in the future too.

Thanks

Steve

Re: File delimited metadata files not being processed in Management Console

Anonymous — Tue, 06 Aug 2019 10:13:29 GMT

Hello,

Thanks for letting us know it.

Feel free to create work item jira issue for your suggestion.

Best regards

Sabrina