Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
I'm trying to trigger AWS Glue job's execution passing some input parameters.
I ran the command below in AWS CLI and it worked fine by triggering the Glue job with the parameters mentioned.
Command used in AWS CLI: aws glue start-job-run --job-name gluejobname --region us-east-1 --arguments='--source_format="csv",--target_format="parquet",--source_path="s3://bucketname/foldername/"'
I tried running the same command using 'tsystem' component by adding an escape character in Talend open studio, it is throwing the error below and I'm not able to identify what went wrong here. Can anyone help me on this issue.
Command used in tsystem: "aws glue start-job-run --job-name gluejobname --region us-east-1 --arguments=\'--source_format=\"csv\",--target_format=\"parquet\",--source_path=\"s3://bucketname/foldername/\"\'"
Error:
Error parsing parameter '--arguments': Expected: '=', received: ''' for input:
'--source_format="csv",--target_format="parquet",--source_path="s3://bucketname/foldername/"'
Hello @Shalini M ,
Could you please try the below command in tSystem component like:
"aws glue start-job-run --job-name gluejobname --region us-east-1 --arguments=--source_format=\"csv\",--target_format=\"parquet\",--source_path=\"s3://bucketname/foldername/\""
Hi @Aiming Chen,
Thank you! It worked.