topic Re: tSystem Linux array commands in Talend Studio

tSystem Linux array commands

MattE — Fri, 15 Nov 2024 22:03:24 GMT

I want to run this command on a tSystem on a Linux box. Note jq is already installed on the Linux box

sudo chmod 777 /temp/month_end/redemptions/ && jq -c '.[]' /temp/month_end/redemptions/BillingFile_February_2023_raw.json > /temp/month_end/redemptions/BillingFile_February_2023.json

But Talend can't handle this multiple commands it give a file not found error as mentioned here https://community.talend.com/s/article/Executing-a-Linux-command-with-a-pipe-using-a-tSystem-component-IOBiH?language=en_US

What is the correct way to do this?

I've tried the attached but it still gives the same error

Re: tSystem Linux array commands

Anonymous — Thu, 02 Mar 2023 04:42:55 GMT

Hello,

As the tSystem component truncates the command at the first space in the file name and you will encounter the following error:

"The system cannot find the specified file".

Could you please check this point as well?

Best regards

Sabrina

Re: tSystem Linux array commands

MattE — Thu, 02 Mar 2023 09:11:26 GMT

@Xiaodi Shi I don't understand what you mean. There are no spaces in the filename, they are BillingFile_February_2023_raw.json and BillingFile_February_2023.json

Re: tSystem Linux array commands

Anonymous — Thu, 02 Mar 2023 09:40:27 GMT

Hello,

Could you please try to add the commands as seen below in the Command table?

"sudo chmod 777 /temp/month_end/redemptions/"

"jq -c '.[]' /temp/month_end/redemptions/BillingFile_February_2023_raw.json"

" jq -c '.[]'/temp/month_end/redemptions/BillingFile_February_2023.json"

Best regards

Sabrina

Re: tSystem Linux array commands

MattE — Thu, 02 Mar 2023 10:23:06 GMT

I see what you mean. Unfortunately the full 2nd command needs to be jq -c '.[]' /temp/month_end/redemptions/BillingFile_February_2023_raw.json > /temp/month_end/redemptions/BillingFile_February_2023.json this is because the jq app is transforming the first file and sending the output to the second file . I've tried the below configuration but get the file not found error.